2024-09-18T05:00:10.485 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T05:00:10.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T05:00:10.592 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813 branch: reef description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit} email: ceph-qa@ceph.com first_in_suite: false job_id: '7909813' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: conf: client: rbd qos iops burst: 100 rbd qos iops limit: 50 rbd qos schedule tick min: 100 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: a477b1894d5c5a613f23260ca0e6b96d79652ba7 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4623 sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 sleep_before_teardown: 0 subset: 80/128 suite: rbd suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: a477b1894d5c5a613f23260ca0e6b96d79652ba7 targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN+wzZQhyAmHg8/DyYx5k0UkAM2f0MMg+p23w5iMCXsFf/eeETrjjgMDVIs+mP4e6tTWDDBgx7ce4TXmsVpx5DQ= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBr3pn31Viimag/Viz9frM8mkQzg2Cl8euAoS/aNvpANd1JGApCOmyzSzKB/tECRemtFjRxeaCkwhGcLVm8FiQ= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_22:16:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-18T05:00:10.592 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa; will attempt to use it 2024-09-18T05:00:10.593 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa/tasks 2024-09-18T05:00:10.593 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T05:00:10.595 INFO:teuthology.task.internal:Checking packages... 2024-09-18T05:00:10.617 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9' 2024-09-18T05:00:10.617 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T05:00:10.617 INFO:teuthology.packaging:ref: None 2024-09-18T05:00:10.617 INFO:teuthology.packaging:tag: None 2024-09-18T05:00:10.617 INFO:teuthology.packaging:branch: reef 2024-09-18T05:00:10.617 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-18T05:00:10.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-09-18T05:00:10.868 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-855-g19e2a2be-1jammy 2024-09-18T05:00:10.870 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T05:00:10.875 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T05:00:10.875 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T05:00:10.920 INFO:teuthology.task.internal:Saving configuration 2024-09-18T05:00:10.932 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T05:00:10.953 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T05:00:10.971 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 04:54:34.679567', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID4BOnp34oVVUaqjzg7ENIeVAnBV4LnbvDpZ6pY8O/so'} 2024-09-18T05:00:10.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 04:54:34.681499', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO8l5JVUfmpieuSlqYgIfnNsME48EIL/3H0y80ASmJd9'} 2024-09-18T05:00:10.991 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T05:00:10.996 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-18T05:00:10.996 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-18T05:00:10.996 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T05:00:11.101 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f108376b520>, signals=[15]) 2024-09-18T05:00:11.101 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T05:00:11.109 INFO:teuthology.task.internal:Opening connections... 2024-09-18T05:00:11.109 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:00:11.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:00:11.195 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:00:11.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:00:11.282 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T05:00:11.290 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-18T05:00:11.296 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-18T05:00:11.297 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-18T05:00:11.342 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Ubuntu" 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="22.04" 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_CODENAME=jammy 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:ID=ubuntu 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE=debian 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-18T05:00:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:UBUNTU_CODENAME=jammy 2024-09-18T05:00:11.344 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-18T05:00:11.369 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-09-18T05:00:11.373 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-09-18T05:00:11.374 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-09-18T05:00:11.419 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-18T05:00:11.419 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2024-09-18T05:00:11.419 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="22.04" 2024-09-18T05:00:11.419 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-18T05:00:11.420 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=jammy 2024-09-18T05:00:11.420 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2024-09-18T05:00:11.420 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2024-09-18T05:00:11.420 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-18T05:00:11.420 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-18T05:00:11.420 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-18T05:00:11.421 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-18T05:00:11.421 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=jammy 2024-09-18T05:00:11.421 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-09-18T05:00:11.444 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T05:00:11.452 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T05:00:11.478 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T05:00:11.479 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-18T05:00:11.481 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-09-18T05:00:11.485 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T05:00:11.503 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T05:00:11.503 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-18T05:00:11.528 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-09-18T05:00:11.546 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T05:00:11.597 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T05:00:11.612 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T05:00:11.612 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T05:00:11.613 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T05:00:11.614 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T05:00:11.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:00:11.618 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-18T05:00:11.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:00:11.620 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-18T05:00:11.666 INFO:teuthology.orchestra.run.smithi017.stdout:5.15.0-56-generic 2024-09-18T05:00:11.667 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.15.0-56-generic 2024-09-18T05:00:11.667 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get clean 2024-09-18T05:00:11.668 INFO:teuthology.orchestra.run.smithi086.stdout:5.15.0-56-generic 2024-09-18T05:00:11.668 INFO:teuthology.task.kernel:Running kernel on smithi086: 5.15.0-56-generic 2024-09-18T05:00:11.668 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get clean 2024-09-18T05:00:11.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get update 2024-09-18T05:00:11.816 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-09-18T05:00:14.594 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T05:00:14.596 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-18T05:00:14.663 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-18T05:00:15.019 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-18T05:00:15.020 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-18T05:00:15.046 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T05:00:15.065 INFO:teuthology.orchestra.run.smithi017.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-18T05:00:15.129 INFO:teuthology.orchestra.run.smithi017.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-18T05:00:15.158 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-18T05:00:15.222 INFO:teuthology.orchestra.run.smithi017.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-18T05:00:15.308 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-18T05:00:15.314 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-18T05:00:15.352 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-18T05:00:15.376 INFO:teuthology.orchestra.run.smithi017.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-18T05:00:15.409 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-18T05:00:15.412 INFO:teuthology.orchestra.run.smithi017.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-18T05:00:15.413 INFO:teuthology.orchestra.run.smithi017.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-18T05:00:15.413 INFO:teuthology.orchestra.run.smithi017.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-18T05:00:15.445 INFO:teuthology.orchestra.run.smithi017.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-18T05:00:15.445 INFO:teuthology.orchestra.run.smithi017.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-18T05:00:15.445 INFO:teuthology.orchestra.run.smithi017.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-18T05:00:15.451 INFO:teuthology.orchestra.run.smithi017.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-18T05:00:15.455 INFO:teuthology.orchestra.run.smithi017.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-18T05:00:15.457 INFO:teuthology.orchestra.run.smithi017.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-18T05:00:15.457 INFO:teuthology.orchestra.run.smithi017.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-18T05:00:15.458 INFO:teuthology.orchestra.run.smithi017.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-18T05:00:15.458 INFO:teuthology.orchestra.run.smithi017.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-18T05:00:15.488 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-18T05:00:15.501 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-18T05:00:15.502 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-18T05:00:15.504 INFO:teuthology.orchestra.run.smithi017.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-18T05:00:15.505 INFO:teuthology.orchestra.run.smithi017.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-18T05:00:15.505 INFO:teuthology.orchestra.run.smithi017.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-18T05:00:15.505 INFO:teuthology.orchestra.run.smithi017.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-18T05:00:15.506 INFO:teuthology.orchestra.run.smithi017.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-18T05:00:15.507 INFO:teuthology.orchestra.run.smithi017.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-18T05:00:15.507 INFO:teuthology.orchestra.run.smithi017.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-18T05:00:15.507 INFO:teuthology.orchestra.run.smithi017.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-18T05:00:15.507 INFO:teuthology.orchestra.run.smithi017.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-18T05:00:15.507 INFO:teuthology.orchestra.run.smithi017.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-18T05:00:15.512 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-18T05:00:15.526 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-18T05:00:15.527 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-18T05:00:15.529 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-18T05:00:15.564 INFO:teuthology.orchestra.run.smithi017.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-18T05:00:15.587 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-18T05:00:15.611 INFO:teuthology.orchestra.run.smithi017.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-18T05:00:15.616 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-18T05:00:15.617 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-18T05:00:15.617 INFO:teuthology.orchestra.run.smithi017.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-18T05:00:15.618 INFO:teuthology.orchestra.run.smithi017.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-18T05:00:15.619 INFO:teuthology.orchestra.run.smithi017.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-18T05:00:15.624 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-18T05:00:15.624 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-18T05:00:15.625 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-18T05:00:15.625 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-18T05:00:15.636 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-18T05:00:15.647 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-18T05:00:15.650 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-18T05:00:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-18T05:00:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-18T05:00:15.654 INFO:teuthology.orchestra.run.smithi017.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-18T05:00:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-18T05:00:15.658 INFO:teuthology.orchestra.run.smithi017.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-18T05:00:15.659 INFO:teuthology.orchestra.run.smithi017.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-18T05:00:15.665 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-18T05:00:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-18T05:00:15.671 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-18T05:00:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-18T05:00:15.674 INFO:teuthology.orchestra.run.smithi017.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-18T05:00:15.674 INFO:teuthology.orchestra.run.smithi017.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-18T05:00:15.675 INFO:teuthology.orchestra.run.smithi017.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-18T05:00:15.675 INFO:teuthology.orchestra.run.smithi017.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-18T05:00:15.675 INFO:teuthology.orchestra.run.smithi017.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-18T05:00:15.677 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-18T05:00:15.679 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-18T05:00:15.679 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-18T05:00:15.734 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-18T05:00:15.734 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-18T05:00:15.754 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-18T05:00:15.755 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-18T05:00:15.756 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-18T05:00:15.758 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-18T05:00:15.759 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-18T05:00:15.759 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-18T05:00:15.760 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-18T05:00:15.841 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-18T05:00:15.842 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-18T05:00:21.657 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 16.2 MB in 5s (3,094 kB/s) 2024-09-18T05:00:22.061 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 16.2 MB in 5s (3,032 kB/s) 2024-09-18T05:00:23.109 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-18T05:00:23.125 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T05:00:23.190 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-18T05:00:23.380 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-18T05:00:23.380 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-18T05:00:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-18T05:00:23.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T05:00:23.546 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T05:00:23.546 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T05:00:23.546 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T05:00:23.546 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T05:00:23.547 INFO:teuthology.orchestra.run.smithi086.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-18T05:00:23.547 INFO:teuthology.orchestra.run.smithi086.stdout: python2.7-minimal 2024-09-18T05:00:23.547 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T05:00:23.548 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-09-18T05:00:23.548 INFO:teuthology.orchestra.run.smithi086.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-18T05:00:23.548 INFO:teuthology.orchestra.run.smithi086.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-18T05:00:23.548 INFO:teuthology.orchestra.run.smithi086.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-18T05:00:23.550 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-09-18T05:00:23.550 INFO:teuthology.orchestra.run.smithi086.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-18T05:00:23.550 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-09-18T05:00:23.550 INFO:teuthology.orchestra.run.smithi086.stdout: thermald 2024-09-18T05:00:23.565 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-18T05:00:23.596 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-09-18T05:00:23.596 INFO:teuthology.orchestra.run.smithi086.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-18T05:00:23.596 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-18T05:00:23.597 INFO:teuthology.orchestra.run.smithi086.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-18T05:00:23.597 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages will be upgraded: 2024-09-18T05:00:23.598 INFO:teuthology.orchestra.run.smithi086.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-18T05:00:23.648 INFO:teuthology.orchestra.run.smithi086.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-18T05:00:23.648 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 113 MB of archives. 2024-09-18T05:00:23.649 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-18T05:00:23.649 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-18T05:00:23.760 INFO:teuthology.orchestra.run.smithi017.stdout:Building dependency tree... 2024-09-18T05:00:23.761 INFO:teuthology.orchestra.run.smithi017.stdout:Reading state information... 2024-09-18T05:00:23.937 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T05:00:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T05:00:23.937 INFO:teuthology.orchestra.run.smithi017.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T05:00:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T05:00:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-18T05:00:23.938 INFO:teuthology.orchestra.run.smithi017.stdout: python2.7-minimal 2024-09-18T05:00:23.938 INFO:teuthology.orchestra.run.smithi017.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T05:00:23.939 INFO:teuthology.orchestra.run.smithi017.stdout:The following additional packages will be installed: 2024-09-18T05:00:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-18T05:00:23.939 INFO:teuthology.orchestra.run.smithi017.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-18T05:00:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-18T05:00:23.941 INFO:teuthology.orchestra.run.smithi017.stdout:Suggested packages: 2024-09-18T05:00:23.941 INFO:teuthology.orchestra.run.smithi017.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-18T05:00:23.942 INFO:teuthology.orchestra.run.smithi017.stdout:Recommended packages: 2024-09-18T05:00:23.942 INFO:teuthology.orchestra.run.smithi017.stdout: thermald 2024-09-18T05:00:23.985 INFO:teuthology.orchestra.run.smithi017.stdout:The following NEW packages will be installed: 2024-09-18T05:00:23.985 INFO:teuthology.orchestra.run.smithi017.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-18T05:00:23.985 INFO:teuthology.orchestra.run.smithi017.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-18T05:00:23.985 INFO:teuthology.orchestra.run.smithi017.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-18T05:00:23.987 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages will be upgraded: 2024-09-18T05:00:23.987 INFO:teuthology.orchestra.run.smithi017.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-18T05:00:24.038 INFO:teuthology.orchestra.run.smithi017.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-18T05:00:24.038 INFO:teuthology.orchestra.run.smithi017.stdout:Need to get 113 MB of archives. 2024-09-18T05:00:24.038 INFO:teuthology.orchestra.run.smithi017.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-18T05:00:24.038 INFO:teuthology.orchestra.run.smithi017.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-18T05:00:24.088 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-18T05:00:24.193 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-18T05:00:24.458 INFO:teuthology.orchestra.run.smithi017.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-18T05:00:24.555 INFO:teuthology.orchestra.run.smithi017.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-18T05:00:24.977 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-18T05:00:24.977 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-18T05:00:24.977 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-18T05:00:25.093 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-18T05:00:25.192 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-18T05:00:25.369 INFO:teuthology.orchestra.run.smithi017.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-18T05:00:25.369 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-18T05:00:25.369 INFO:teuthology.orchestra.run.smithi017.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-18T05:00:25.496 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-18T05:00:25.518 INFO:teuthology.orchestra.run.smithi017.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-18T05:00:25.591 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 113 MB in 2s (71.4 MB/s) 2024-09-18T05:00:25.764 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-18T05:00:25.929 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 113 MB in 2s (74.3 MB/s) 2024-09-18T05:00:26.099 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-18T05:00:27.748 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-18T05:00:27.753 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T05:00:27.819 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:28.028 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-18T05:00:28.032 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T05:00:28.112 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:30.104 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-18T05:00:30.125 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T05:00:30.203 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:30.445 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-18T05:00:30.467 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T05:00:30.566 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-18T05:00:30.653 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T05:00:30.690 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:31.032 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-18T05:00:31.053 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T05:00:31.090 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:37.266 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T05:00:37.392 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T05:00:37.489 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T05:00:37.614 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T05:00:37.758 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T05:00:37.879 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T05:00:38.089 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T05:00:38.089 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T05:00:38.148 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-18T05:00:38.159 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-18T05:00:38.190 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-18T05:00:38.345 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-18T05:00:38.368 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-18T05:00:38.412 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-18T05:00:43.759 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-18T05:00:43.796 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T05:00:43.833 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:44.300 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-18T05:00:44.338 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T05:00:44.383 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:46.493 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T05:00:46.627 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T05:00:46.969 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-18T05:00:47.080 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T05:00:47.090 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:47.203 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T05:00:47.216 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-18T05:00:47.328 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:47.947 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-18T05:00:48.534 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:48.635 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-18T05:00:48.739 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:48.970 INFO:teuthology.orchestra.run.smithi086.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-18T05:00:48.970 INFO:teuthology.orchestra.run.smithi086.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-18T05:00:48.970 INFO:teuthology.orchestra.run.smithi086.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-18T05:00:48.970 INFO:teuthology.orchestra.run.smithi086.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-18T05:00:49.130 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:50.073 INFO:teuthology.orchestra.run.smithi017.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-18T05:00:50.073 INFO:teuthology.orchestra.run.smithi017.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-18T05:00:50.073 INFO:teuthology.orchestra.run.smithi017.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-18T05:00:50.073 INFO:teuthology.orchestra.run.smithi017.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-18T05:00:50.232 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:50.564 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-18T05:00:50.690 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-18T05:00:50.816 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:51.667 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-18T05:00:51.784 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-18T05:00:51.894 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:52.218 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi086.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi086.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-18T05:00:53.287 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T05:00:53.354 INFO:teuthology.orchestra.run.smithi017.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-18T05:00:53.354 INFO:teuthology.orchestra.run.smithi017.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-18T05:01:06.169 INFO:teuthology.orchestra.run.smithi086.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-18T05:01:06.169 INFO:teuthology.orchestra.run.smithi086.stdout:Sourcing file `/etc/default/grub' 2024-09-18T05:01:06.187 INFO:teuthology.orchestra.run.smithi086.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi086.stdout:Generating grub configuration file ... 2024-09-18T05:01:06.462 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-18T05:01:06.482 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-18T05:01:06.769 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-18T05:01:06.774 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-18T05:01:06.849 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-18T05:01:06.854 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-18T05:01:07.009 INFO:teuthology.orchestra.run.smithi086.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-18T05:01:07.009 INFO:teuthology.orchestra.run.smithi086.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-18T05:01:07.009 INFO:teuthology.orchestra.run.smithi086.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-18T05:01:07.046 INFO:teuthology.orchestra.run.smithi086.stdout:done 2024-09-18T05:01:07.478 DEBUG:teuthology.orchestra.run.smithi086:> dpkg -s linux-image-generic 2024-09-18T05:01:07.501 INFO:teuthology.orchestra.run.smithi086.stdout:Package: linux-image-generic 2024-09-18T05:01:07.501 INFO:teuthology.orchestra.run.smithi086.stdout:Status: install ok installed 2024-09-18T05:01:07.502 INFO:teuthology.orchestra.run.smithi086.stdout:Priority: optional 2024-09-18T05:01:07.502 INFO:teuthology.orchestra.run.smithi086.stdout:Section: kernel 2024-09-18T05:01:07.502 INFO:teuthology.orchestra.run.smithi086.stdout:Installed-Size: 21 2024-09-18T05:01:07.503 INFO:teuthology.orchestra.run.smithi086.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T05:01:07.503 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: amd64 2024-09-18T05:01:07.503 INFO:teuthology.orchestra.run.smithi086.stdout:Source: linux-meta 2024-09-18T05:01:07.503 INFO:teuthology.orchestra.run.smithi086.stdout:Version: 5.15.0.122.122 2024-09-18T05:01:07.504 INFO:teuthology.orchestra.run.smithi086.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-18T05:01:07.504 INFO:teuthology.orchestra.run.smithi086.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T05:01:07.504 INFO:teuthology.orchestra.run.smithi086.stdout:Recommends: thermald 2024-09-18T05:01:07.504 INFO:teuthology.orchestra.run.smithi086.stdout:Description: Generic Linux kernel image 2024-09-18T05:01:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: This package will always depend on the latest generic kernel image 2024-09-18T05:01:07.504 INFO:teuthology.orchestra.run.smithi086.stdout: available. 2024-09-18T05:01:07.505 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-18T05:01:07.505 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T05:01:07.505 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T05:01:07.505 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-18T05:01:07.505 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T05:01:07.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get clean 2024-09-18T05:01:07.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-09-18T05:01:07.734 INFO:teuthology.orchestra.run.smithi017.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-18T05:01:07.734 INFO:teuthology.orchestra.run.smithi017.stdout:Sourcing file `/etc/default/grub' 2024-09-18T05:01:07.746 INFO:teuthology.orchestra.run.smithi017.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T05:01:07.759 INFO:teuthology.orchestra.run.smithi017.stdout:Generating grub configuration file ... 2024-09-18T05:01:07.832 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-18T05:01:07.933 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T05:01:08.012 INFO:teuthology.orchestra.run.smithi017.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-18T05:01:08.025 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-18T05:01:08.032 INFO:teuthology.orchestra.run.smithi017.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-18T05:01:08.098 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-18T05:01:08.360 INFO:teuthology.orchestra.run.smithi017.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-18T05:01:08.366 INFO:teuthology.orchestra.run.smithi017.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-18T05:01:08.442 INFO:teuthology.orchestra.run.smithi017.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-18T05:01:08.449 INFO:teuthology.orchestra.run.smithi017.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-18T05:01:08.600 INFO:teuthology.orchestra.run.smithi017.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-18T05:01:08.600 INFO:teuthology.orchestra.run.smithi017.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-18T05:01:08.600 INFO:teuthology.orchestra.run.smithi017.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-18T05:01:08.639 INFO:teuthology.orchestra.run.smithi017.stdout:done 2024-09-18T05:01:09.036 DEBUG:teuthology.orchestra.run.smithi017:> dpkg -s linux-image-generic 2024-09-18T05:01:09.055 INFO:teuthology.orchestra.run.smithi017.stdout:Package: linux-image-generic 2024-09-18T05:01:09.056 INFO:teuthology.orchestra.run.smithi017.stdout:Status: install ok installed 2024-09-18T05:01:09.056 INFO:teuthology.orchestra.run.smithi017.stdout:Priority: optional 2024-09-18T05:01:09.056 INFO:teuthology.orchestra.run.smithi017.stdout:Section: kernel 2024-09-18T05:01:09.056 INFO:teuthology.orchestra.run.smithi017.stdout:Installed-Size: 21 2024-09-18T05:01:09.056 INFO:teuthology.orchestra.run.smithi017.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T05:01:09.057 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: amd64 2024-09-18T05:01:09.057 INFO:teuthology.orchestra.run.smithi017.stdout:Source: linux-meta 2024-09-18T05:01:09.057 INFO:teuthology.orchestra.run.smithi017.stdout:Version: 5.15.0.122.122 2024-09-18T05:01:09.057 INFO:teuthology.orchestra.run.smithi017.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-18T05:01:09.057 INFO:teuthology.orchestra.run.smithi017.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T05:01:09.057 INFO:teuthology.orchestra.run.smithi017.stdout:Recommends: thermald 2024-09-18T05:01:09.058 INFO:teuthology.orchestra.run.smithi017.stdout:Description: Generic Linux kernel image 2024-09-18T05:01:09.058 INFO:teuthology.orchestra.run.smithi017.stdout: This package will always depend on the latest generic kernel image 2024-09-18T05:01:09.058 INFO:teuthology.orchestra.run.smithi017.stdout: available. 2024-09-18T05:01:09.058 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-18T05:01:09.058 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T05:01:09.059 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T05:01:09.059 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-18T05:01:09.059 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T05:01:09.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get clean 2024-09-18T05:01:09.234 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get update 2024-09-18T05:01:09.255 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-18T05:01:09.274 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T05:01:09.338 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-18T05:01:09.365 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T05:01:09.374 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-18T05:01:09.391 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-18T05:01:09.485 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-18T05:01:09.548 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-18T05:01:09.549 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-18T05:01:09.743 INFO:teuthology.orchestra.run.smithi086.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-18T05:01:09.743 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T05:01:09.743 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T05:01:09.743 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T05:01:09.743 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T05:01:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-18T05:01:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-18T05:01:09.744 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T05:01:09.786 INFO:teuthology.orchestra.run.smithi086.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-18T05:01:09.789 DEBUG:teuthology.orchestra.run.smithi086:> dpkg -s linux-image-generic 2024-09-18T05:01:09.801 INFO:teuthology.orchestra.run.smithi086.stdout:Package: linux-image-generic 2024-09-18T05:01:09.801 INFO:teuthology.orchestra.run.smithi086.stdout:Status: install ok installed 2024-09-18T05:01:09.801 INFO:teuthology.orchestra.run.smithi086.stdout:Priority: optional 2024-09-18T05:01:09.801 INFO:teuthology.orchestra.run.smithi086.stdout:Section: kernel 2024-09-18T05:01:09.801 INFO:teuthology.orchestra.run.smithi086.stdout:Installed-Size: 21 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: amd64 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout:Source: linux-meta 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout:Version: 5.15.0.122.122 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout:Recommends: thermald 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout:Description: Generic Linux kernel image 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: This package will always depend on the latest generic kernel image 2024-09-18T05:01:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: available. 2024-09-18T05:01:09.802 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-18T05:01:09.854 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.Npn2lcRvCF 2024-09-18T05:01:09.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Npn2lcRvCF 2024-09-18T05:01:09.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.Npn2lcRvCF 2024-09-18T05:01:10.049 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.Npn2lcRvCF is 10KB 2024-09-18T05:01:10.062 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.Npn2lcRvCF 2024-09-18T05:01:10.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-18T05:01:10.122 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:01:10.123 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-18T05:01:10.123 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-18T05:01:10.189 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-18T05:01:10.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo update-grub 2024-09-18T05:01:10.815 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-18T05:01:10.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T05:01:10.896 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-18T05:01:11.112 INFO:teuthology.orchestra.run.smithi017.stdout:Building dependency tree... 2024-09-18T05:01:11.112 INFO:teuthology.orchestra.run.smithi017.stdout:Reading state information... 2024-09-18T05:01:11.310 INFO:teuthology.orchestra.run.smithi017.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-18T05:01:11.310 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T05:01:11.310 INFO:teuthology.orchestra.run.smithi017.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T05:01:11.310 INFO:teuthology.orchestra.run.smithi017.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T05:01:11.310 INFO:teuthology.orchestra.run.smithi017.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T05:01:11.311 INFO:teuthology.orchestra.run.smithi017.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-18T05:01:11.311 INFO:teuthology.orchestra.run.smithi017.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-18T05:01:11.311 INFO:teuthology.orchestra.run.smithi017.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T05:01:11.354 INFO:teuthology.orchestra.run.smithi017.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-18T05:01:11.356 DEBUG:teuthology.orchestra.run.smithi017:> dpkg -s linux-image-generic 2024-09-18T05:01:11.372 INFO:teuthology.orchestra.run.smithi017.stdout:Package: linux-image-generic 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Status: install ok installed 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Priority: optional 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Section: kernel 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Installed-Size: 21 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: amd64 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Source: linux-meta 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Version: 5.15.0.122.122 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T05:01:11.373 INFO:teuthology.orchestra.run.smithi017.stdout:Recommends: thermald 2024-09-18T05:01:11.374 INFO:teuthology.orchestra.run.smithi017.stdout:Description: Generic Linux kernel image 2024-09-18T05:01:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: This package will always depend on the latest generic kernel image 2024-09-18T05:01:11.374 INFO:teuthology.orchestra.run.smithi017.stdout: available. 2024-09-18T05:01:11.374 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-18T05:01:11.408 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub' 2024-09-18T05:01:11.410 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T05:01:11.413 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-09-18T05:01:11.418 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.ZIafPgbG6Y 2024-09-18T05:01:11.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZIafPgbG6Y 2024-09-18T05:01:11.473 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.ZIafPgbG6Y 2024-09-18T05:01:11.579 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-18T05:01:11.585 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-18T05:01:11.597 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.ZIafPgbG6Y is 10KB 2024-09-18T05:01:11.609 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.ZIafPgbG6Y 2024-09-18T05:01:11.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-18T05:01:11.670 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:01:11.670 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-18T05:01:11.670 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-18T05:01:11.738 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-18T05:01:11.738 DEBUG:teuthology.orchestra.run.smithi017:> sudo update-grub 2024-09-18T05:01:11.806 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-18T05:01:11.811 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-18T05:01:11.851 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-18T05:01:11.856 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-18T05:01:11.972 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-18T05:01:11.972 INFO:teuthology.orchestra.run.smithi086.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-18T05:01:11.972 INFO:teuthology.orchestra.run.smithi086.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-18T05:01:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-09-18T05:01:12.001 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-09-18T05:01:12.880 INFO:teuthology.orchestra.run.smithi017.stderr:Sourcing file `/etc/default/grub' 2024-09-18T05:01:12.881 INFO:teuthology.orchestra.run.smithi017.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T05:01:12.883 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-18T05:01:13.051 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-18T05:01:13.056 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-18T05:01:13.280 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-18T05:01:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-18T05:01:13.330 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-18T05:01:13.336 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-18T05:01:13.451 INFO:teuthology.orchestra.run.smithi017.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-18T05:01:13.451 INFO:teuthology.orchestra.run.smithi017.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-18T05:01:13.451 INFO:teuthology.orchestra.run.smithi017.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-18T05:01:13.463 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-18T05:01:13.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-09-18T05:01:42.029 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-18T05:01:42.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-18T05:01:42.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:01:43.496 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-18T05:01:43.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-18T05:01:43.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:02:00.509 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-18T05:02:02.045 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-18T05:02:09.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-18T05:02:09.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:02:11.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-18T05:02:11.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:02:12.577 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-18T05:02:14.109 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-18T05:02:24.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-18T05:02:24.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:02:26.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-18T05:02:26.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:02:43.006 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-18T05:02:57.601 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-18T05:02:58.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-18T05:02:58.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:02:58.473 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-18T05:02:59.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-18T05:02:59.393 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-18T05:02:59.393 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-18T05:02:59.441 INFO:teuthology.orchestra.run.smithi086.stdout:5.15.0-122-generic 2024-09-18T05:02:59.442 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-18T05:02:59.442 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T05:02:59.442 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-18T05:03:00.443 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-18T05:03:00.443 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T05:03:00.614 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2024-09-18T05:03:00.643 DEBUG:teuthology.parallel:result is None 2024-09-18T05:03:12.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-18T05:03:12.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:03:12.871 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-18T05:03:13.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-18T05:03:13.421 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-18T05:03:13.421 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-18T05:03:13.466 INFO:teuthology.orchestra.run.smithi017.stdout:5.15.0-122-generic 2024-09-18T05:03:13.467 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-18T05:03:13.467 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T05:03:13.467 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-18T05:03:14.468 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-18T05:03:14.469 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T05:03:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-09-18T05:03:14.568 DEBUG:teuthology.parallel:result is None 2024-09-18T05:03:14.569 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T05:03:14.576 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T05:03:14.577 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T05:03:14.579 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T05:03:14.585 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T05:03:14.634 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T05:03:14.678 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T05:03:14.678 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T05:03:14.681 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T05:03:14.700 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T05:03:14.728 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T05:03:14.728 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T05:03:14.732 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T05:03:14.752 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T05:03:14.755 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T05:03:14.760 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T05:03:14.763 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T05:03:14.764 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T05:03:14.778 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T05:03:14.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T05:03:14.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T05:03:14.827 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T05:03:14.836 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T05:03:14.836 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T05:03:14.871 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T05:03:14.877 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T05:03:14.923 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T05:03:14.971 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:03:14.971 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T05:03:15.031 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T05:03:15.038 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T05:03:15.085 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:03:15.085 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T05:03:15.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-18T05:03:15.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-09-18T05:03:15.246 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T05:03:15.254 INFO:teuthology.task.internal:Starting timer... 2024-09-18T05:03:15.254 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T05:03:15.298 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T05:03:15.347 DEBUG:teuthology.task.selinux:Excluding smithi017: OS 'ubuntu' does not support SELinux 2024-09-18T05:03:15.347 DEBUG:teuthology.task.selinux:Excluding smithi086: OS 'ubuntu' does not support SELinux 2024-09-18T05:03:15.347 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T05:03:15.347 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-18T05:03:15.347 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T05:03:15.348 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T05:03:15.397 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T05:03:15.409 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T05:03:15.410 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T05:10:51.400 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com')] 2024-09-18T05:10:51.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-18T05:10:51.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:10:51.487 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-18T05:10:51.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-18T05:10:51.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-18T05:10:51.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T05:10:51.646 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-18T05:10:51.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-18T05:10:51.721 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T05:10:51.731 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T05:10:51.731 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T05:10:51.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T05:10:51.734 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T05:10:51.734 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T05:10:51.764 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-18T05:10:51.765 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: Command line: ntpd -gq 2024-09-18T05:10:51.765 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: ---------------------------------------------------- 2024-09-18T05:10:51.765 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: ntp-4 is maintained by Network Time Foundation, 2024-09-18T05:10:51.765 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-18T05:10:51.765 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: corporation. Support and training for ntp-4 are 2024-09-18T05:10:51.765 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: available at https://www.nwtime.org/support 2024-09-18T05:10:51.765 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: ---------------------------------------------------- 2024-09-18T05:10:51.766 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: proto: precision = 0.051 usec (-24) 2024-09-18T05:10:51.766 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: basedate set to 2022-02-04 2024-09-18T05:10:51.766 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: gps base set to 2022-02-06 (week 2196) 2024-09-18T05:10:51.766 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T05:10:51.766 INFO:teuthology.orchestra.run.smithi017.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T05:10:51.766 INFO:teuthology.orchestra.run.smithi017.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-18T05:10:51.767 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: restrict ::: KOD does nothing without LIMITED. 2024-09-18T05:10:51.767 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: Listen and drop on 0 v6wildcard [::]:123 2024-09-18T05:10:51.767 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-18T05:10:51.767 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: Listen normally on 2 lo 127.0.0.1:123 2024-09-18T05:10:51.767 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: Listen normally on 3 ens1f0 172.21.15.17:123 2024-09-18T05:10:51.767 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: Listen normally on 4 lo [::1]:123 2024-09-18T05:10:51.767 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:fe59:d992%4]:123 2024-09-18T05:10:51.768 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:51 ntpd[18387]: Listening on routing socket on fd #22 for interface updates 2024-09-18T05:10:51.786 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-18T05:10:51.787 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: Command line: ntpd -gq 2024-09-18T05:10:51.787 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: ---------------------------------------------------- 2024-09-18T05:10:51.787 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: ntp-4 is maintained by Network Time Foundation, 2024-09-18T05:10:51.787 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-18T05:10:51.787 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: corporation. Support and training for ntp-4 are 2024-09-18T05:10:51.787 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: available at https://www.nwtime.org/support 2024-09-18T05:10:51.787 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: ---------------------------------------------------- 2024-09-18T05:10:51.788 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: proto: precision = 0.061 usec (-24) 2024-09-18T05:10:51.788 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: basedate set to 2022-02-04 2024-09-18T05:10:51.788 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: gps base set to 2022-02-06 (week 2196) 2024-09-18T05:10:51.788 INFO:teuthology.orchestra.run.smithi086.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T05:10:51.788 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T05:10:51.789 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: restrict ::: KOD does nothing without LIMITED. 2024-09-18T05:10:51.789 INFO:teuthology.orchestra.run.smithi086.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-18T05:10:51.790 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: Listen and drop on 0 v6wildcard [::]:123 2024-09-18T05:10:51.790 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-18T05:10:51.790 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: Listen normally on 2 lo 127.0.0.1:123 2024-09-18T05:10:51.790 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: Listen normally on 3 enp3s0f1 172.21.15.86:123 2024-09-18T05:10:51.790 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: Listen normally on 4 lo [::1]:123 2024-09-18T05:10:51.790 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d809%5]:123 2024-09-18T05:10:51.790 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:51 ntpd[18492]: Listening on routing socket on fd #22 for interface updates 2024-09-18T05:10:52.765 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:52.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:52 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:52.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:52 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:52.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:52 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:52.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:52 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:52.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:52 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:52.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:52 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:52.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:52 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:54 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:54 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:55.765 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:55 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:55.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:55 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:55.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:55 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:55.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:55 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:55.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:55 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:55.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:55 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:55.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:55 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:55.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:55 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:55.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:55.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:55 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:55.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:55.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:55 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:55.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:55.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:55 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:56.767 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:56 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:56.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:56.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:56 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:57.765 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:57 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:57.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:57 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:57.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:57 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:57.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:57 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:57.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:57 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:57.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:57 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:57.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:57 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:57.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:57 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:57.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:57 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:57.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:57 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:57.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:57 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:57.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:57 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:58.765 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:58.766 INFO:teuthology.orchestra.run.smithi017.stdout:18 Sep 05:10:58 ntpd[18387]: ntpd: time slew -0.002689 s 2024-09-18T05:10:58.766 INFO:teuthology.orchestra.run.smithi017.stdout:ntpd: time slew -0.002689s 2024-09-18T05:10:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-18T05:10:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:18 Sep 05:10:58 ntpd[18387]: can't open /var/log/ntpstats/loopstats.20240918: Permission denied 2024-09-18T05:10:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T05:10:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T05:10:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T05:10:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T05:10:58.788 INFO:teuthology.orchestra.run.smithi086.stdout:18 Sep 05:10:58 ntpd[18492]: ntpd: time slew -0.002317 s 2024-09-18T05:10:58.788 INFO:teuthology.orchestra.run.smithi086.stdout:ntpd: time slew -0.002317s 2024-09-18T05:10:58.789 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-18T05:10:58.789 INFO:teuthology.orchestra.run.smithi086.stderr:18 Sep 05:10:58 ntpd[18492]: can't open /var/log/ntpstats/loopstats.20240918: Permission denied 2024-09-18T05:10:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T05:10:58.818 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================== 2024-09-18T05:10:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:10:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:10:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:10:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:10:58.848 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T05:10:58.848 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-09-18T05:10:58.848 INFO:teuthology.orchestra.run.smithi086.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:10:58.848 INFO:teuthology.orchestra.run.smithi086.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:10:58.848 INFO:teuthology.orchestra.run.smithi086.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:10:58.848 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:10:58.848 INFO:teuthology.run_tasks:Running task install... 2024-09-18T05:10:58.857 DEBUG:teuthology.task.install:project ceph 2024-09-18T05:10:58.857 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}} 2024-09-18T05:10:58.857 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'} 2024-09-18T05:10:58.857 INFO:teuthology.task.install:Using flavor: default 2024-09-18T05:10:58.863 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T05:10:58.863 INFO:teuthology.task.install:extra packages: [] 2024-09-18T05:10:58.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-key list | grep Ceph 2024-09-18T05:10:58.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-key list | grep Ceph 2024-09-18T05:10:58.918 INFO:teuthology.orchestra.run.smithi017.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-18T05:10:58.944 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-18T05:10:58.945 INFO:teuthology.orchestra.run.smithi017.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-18T05:10:58.945 INFO:teuthology.orchestra.run.smithi017.stdout:uid [ unknown] Ceph.com (release key) 2024-09-18T05:10:58.946 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-18T05:10:58.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-18T05:10:58.972 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-18T05:10:58.973 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph.com (release key) 2024-09-18T05:10:58.973 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-18T05:10:58.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-18T05:10:59.114 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default/ 2024-09-18T05:10:59.115 INFO:teuthology.task.install.deb:Package version is 18.2.4-855-g19e2a2be-1jammy 2024-09-18T05:10:59.123 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default/ 2024-09-18T05:10:59.123 INFO:teuthology.task.install.deb:Package version is 18.2.4-855-g19e2a2be-1jammy 2024-09-18T05:10:59.227 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:10:59.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-18T05:10:59.234 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:10:59.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-18T05:10:59.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-09-18T05:10:59.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get update 2024-09-18T05:10:59.411 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T05:10:59.411 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-18T05:10:59.414 INFO:teuthology.orchestra.run.smithi017.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-18T05:10:59.420 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-18T05:10:59.467 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy InRelease 2024-09-18T05:10:59.473 INFO:teuthology.orchestra.run.smithi017.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy InRelease 2024-09-18T05:10:59.488 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-18T05:10:59.494 INFO:teuthology.orchestra.run.smithi017.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-18T05:10:59.495 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-18T05:10:59.510 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-18T05:10:59.517 INFO:teuthology.orchestra.run.smithi017.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-18T05:10:59.530 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,437 B] 2024-09-18T05:10:59.538 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-18T05:10:59.545 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T05:10:59.558 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-18T05:10:59.566 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,437 B] 2024-09-18T05:10:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-18T05:10:59.769 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 286 kB in 0s (829 kB/s) 2024-09-18T05:10:59.979 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-18T05:11:00.154 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 286 kB in 1s (402 kB/s) 2024-09-18T05:11:00.773 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-18T05:11:00.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-855-g19e2a2be-1jammy cephadm=18.2.4-855-g19e2a2be-1jammy ceph-mds=18.2.4-855-g19e2a2be-1jammy ceph-mgr=18.2.4-855-g19e2a2be-1jammy ceph-common=18.2.4-855-g19e2a2be-1jammy ceph-fuse=18.2.4-855-g19e2a2be-1jammy ceph-test=18.2.4-855-g19e2a2be-1jammy ceph-volume=18.2.4-855-g19e2a2be-1jammy radosgw=18.2.4-855-g19e2a2be-1jammy python3-rados=18.2.4-855-g19e2a2be-1jammy python3-rgw=18.2.4-855-g19e2a2be-1jammy python3-cephfs=18.2.4-855-g19e2a2be-1jammy python3-rbd=18.2.4-855-g19e2a2be-1jammy libcephfs2=18.2.4-855-g19e2a2be-1jammy libcephfs-dev=18.2.4-855-g19e2a2be-1jammy librados2=18.2.4-855-g19e2a2be-1jammy librbd1=18.2.4-855-g19e2a2be-1jammy rbd-fuse=18.2.4-855-g19e2a2be-1jammy 2024-09-18T05:11:00.853 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-18T05:11:01.065 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-18T05:11:01.066 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-18T05:11:01.189 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-18T05:11:01.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-855-g19e2a2be-1jammy cephadm=18.2.4-855-g19e2a2be-1jammy ceph-mds=18.2.4-855-g19e2a2be-1jammy ceph-mgr=18.2.4-855-g19e2a2be-1jammy ceph-common=18.2.4-855-g19e2a2be-1jammy ceph-fuse=18.2.4-855-g19e2a2be-1jammy ceph-test=18.2.4-855-g19e2a2be-1jammy ceph-volume=18.2.4-855-g19e2a2be-1jammy radosgw=18.2.4-855-g19e2a2be-1jammy python3-rados=18.2.4-855-g19e2a2be-1jammy python3-rgw=18.2.4-855-g19e2a2be-1jammy python3-cephfs=18.2.4-855-g19e2a2be-1jammy python3-rbd=18.2.4-855-g19e2a2be-1jammy libcephfs2=18.2.4-855-g19e2a2be-1jammy libcephfs-dev=18.2.4-855-g19e2a2be-1jammy librados2=18.2.4-855-g19e2a2be-1jammy librbd1=18.2.4-855-g19e2a2be-1jammy rbd-fuse=18.2.4-855-g19e2a2be-1jammy 2024-09-18T05:11:01.258 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T05:11:01.258 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T05:11:01.258 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T05:11:01.258 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T05:11:01.259 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-18T05:11:01.259 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-18T05:11:01.259 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T05:11:01.260 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-09-18T05:11:01.260 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-18T05:11:01.260 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-18T05:11:01.260 INFO:teuthology.orchestra.run.smithi086.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-18T05:11:01.260 INFO:teuthology.orchestra.run.smithi086.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-18T05:11:01.261 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-18T05:11:01.261 INFO:teuthology.orchestra.run.smithi086.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-18T05:11:01.261 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-18T05:11:01.261 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-18T05:11:01.261 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-18T05:11:01.261 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-18T05:11:01.261 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-18T05:11:01.261 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-18T05:11:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout: python3-watchdog 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-09-18T05:11:01.263 INFO:teuthology.orchestra.run.smithi086.stdout: btrfs-tools 2024-09-18T05:11:01.265 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-18T05:11:01.363 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-09-18T05:11:01.363 INFO:teuthology.orchestra.run.smithi086.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-18T05:11:01.363 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-18T05:11:01.363 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-18T05:11:01.363 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-18T05:11:01.363 INFO:teuthology.orchestra.run.smithi086.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-18T05:11:01.364 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-18T05:11:01.364 INFO:teuthology.orchestra.run.smithi086.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-18T05:11:01.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-18T05:11:01.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-18T05:11:01.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-18T05:11:01.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-18T05:11:01.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-18T05:11:01.366 INFO:teuthology.orchestra.run.smithi086.stdout: socat xmlstarlet 2024-09-18T05:11:01.463 INFO:teuthology.orchestra.run.smithi017.stdout:Building dependency tree... 2024-09-18T05:11:01.463 INFO:teuthology.orchestra.run.smithi017.stdout:Reading state information... 2024-09-18T05:11:01.506 INFO:teuthology.orchestra.run.smithi086.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-18T05:11:01.506 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 163 MB of archives. 2024-09-18T05:11:01.506 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-18T05:11:01.506 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-855-g19e2a2be-1jammy [3,452 kB] 2024-09-18T05:11:01.552 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-18T05:11:01.660 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T05:11:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T05:11:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T05:11:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T05:11:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-18T05:11:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-18T05:11:01.661 INFO:teuthology.orchestra.run.smithi017.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T05:11:01.662 INFO:teuthology.orchestra.run.smithi017.stdout:The following additional packages will be installed: 2024-09-18T05:11:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-18T05:11:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-18T05:11:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-18T05:11:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-18T05:11:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-18T05:11:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-18T05:11:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-18T05:11:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-18T05:11:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-18T05:11:01.665 INFO:teuthology.orchestra.run.smithi017.stdout:Suggested packages: 2024-09-18T05:11:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-18T05:11:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-18T05:11:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-18T05:11:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-18T05:11:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-18T05:11:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-18T05:11:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: python3-watchdog 2024-09-18T05:11:01.666 INFO:teuthology.orchestra.run.smithi017.stdout:Recommended packages: 2024-09-18T05:11:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: btrfs-tools 2024-09-18T05:11:01.688 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-855-g19e2a2be-1jammy [3,108 kB] 2024-09-18T05:11:01.734 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-855-g19e2a2be-1jammy [683 kB] 2024-09-18T05:11:01.742 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-855-g19e2a2be-1jammy [357 kB] 2024-09-18T05:11:01.747 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-855-g19e2a2be-1jammy [32.8 kB] 2024-09-18T05:11:01.748 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-855-g19e2a2be-1jammy [180 kB] 2024-09-18T05:11:01.750 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-855-g19e2a2be-1jammy [63.8 kB] 2024-09-18T05:11:01.751 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-855-g19e2a2be-1jammy [334 kB] 2024-09-18T05:11:01.757 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-855-g19e2a2be-1jammy [5,934 kB] 2024-09-18T05:11:01.769 INFO:teuthology.orchestra.run.smithi017.stdout:The following NEW packages will be installed: 2024-09-18T05:11:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-18T05:11:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-18T05:11:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-18T05:11:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-18T05:11:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-18T05:11:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-18T05:11:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-18T05:11:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-18T05:11:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-18T05:11:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-18T05:11:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-18T05:11:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-18T05:11:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: socat xmlstarlet 2024-09-18T05:11:01.831 INFO:teuthology.orchestra.run.smithi017.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-18T05:11:01.831 INFO:teuthology.orchestra.run.smithi017.stdout:Need to get 163 MB of archives. 2024-09-18T05:11:01.831 INFO:teuthology.orchestra.run.smithi017.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-18T05:11:01.832 INFO:teuthology.orchestra.run.smithi017.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-18T05:11:01.833 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-18T05:11:01.856 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-855-g19e2a2be-1jammy [112 kB] 2024-09-18T05:11:01.857 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-855-g19e2a2be-1jammy [445 kB] 2024-09-18T05:11:01.863 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-855-g19e2a2be-1jammy [22.0 MB] 2024-09-18T05:11:01.889 INFO:teuthology.orchestra.run.smithi017.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-18T05:11:01.925 INFO:teuthology.orchestra.run.smithi017.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-18T05:11:01.928 INFO:teuthology.orchestra.run.smithi017.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-18T05:11:01.943 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-18T05:11:01.995 INFO:teuthology.orchestra.run.smithi017.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-18T05:11:02.007 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-18T05:11:02.007 INFO:teuthology.orchestra.run.smithi017.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-855-g19e2a2be-1jammy [3,452 kB] 2024-09-18T05:11:02.007 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-18T05:11:02.012 INFO:teuthology.orchestra.run.smithi017.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-18T05:11:02.016 INFO:teuthology.orchestra.run.smithi017.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-18T05:11:02.017 INFO:teuthology.orchestra.run.smithi017.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-18T05:11:02.017 INFO:teuthology.orchestra.run.smithi017.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-18T05:11:02.021 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-18T05:11:02.026 INFO:teuthology.orchestra.run.smithi017.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-18T05:11:02.027 INFO:teuthology.orchestra.run.smithi017.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-18T05:11:02.027 INFO:teuthology.orchestra.run.smithi017.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-18T05:11:02.028 INFO:teuthology.orchestra.run.smithi017.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-18T05:11:02.033 INFO:teuthology.orchestra.run.smithi017.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-18T05:11:02.034 INFO:teuthology.orchestra.run.smithi017.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-18T05:11:02.050 INFO:teuthology.orchestra.run.smithi017.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-18T05:11:02.051 INFO:teuthology.orchestra.run.smithi017.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-18T05:11:02.095 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-18T05:11:02.141 INFO:teuthology.orchestra.run.smithi017.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-18T05:11:02.141 INFO:teuthology.orchestra.run.smithi017.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-18T05:11:02.146 INFO:teuthology.orchestra.run.smithi017.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-18T05:11:02.147 INFO:teuthology.orchestra.run.smithi017.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-18T05:11:02.148 INFO:teuthology.orchestra.run.smithi017.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-18T05:11:02.149 INFO:teuthology.orchestra.run.smithi017.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-18T05:11:02.150 INFO:teuthology.orchestra.run.smithi017.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-18T05:11:02.151 INFO:teuthology.orchestra.run.smithi017.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-18T05:11:02.151 INFO:teuthology.orchestra.run.smithi017.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-18T05:11:02.154 INFO:teuthology.orchestra.run.smithi017.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-18T05:11:02.163 INFO:teuthology.orchestra.run.smithi017.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-18T05:11:02.173 INFO:teuthology.orchestra.run.smithi017.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-18T05:11:02.182 INFO:teuthology.orchestra.run.smithi017.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-18T05:11:02.183 INFO:teuthology.orchestra.run.smithi017.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-18T05:11:02.184 INFO:teuthology.orchestra.run.smithi017.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-18T05:11:02.185 INFO:teuthology.orchestra.run.smithi017.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-18T05:11:02.187 INFO:teuthology.orchestra.run.smithi017.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-18T05:11:02.191 INFO:teuthology.orchestra.run.smithi017.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-18T05:11:02.192 INFO:teuthology.orchestra.run.smithi017.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-18T05:11:02.194 INFO:teuthology.orchestra.run.smithi017.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-18T05:11:02.197 INFO:teuthology.orchestra.run.smithi017.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-18T05:11:02.214 INFO:teuthology.orchestra.run.smithi017.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-18T05:11:02.215 INFO:teuthology.orchestra.run.smithi017.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-18T05:11:02.216 INFO:teuthology.orchestra.run.smithi017.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-18T05:11:02.220 INFO:teuthology.orchestra.run.smithi017.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-18T05:11:02.295 INFO:teuthology.orchestra.run.smithi017.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-18T05:11:02.295 INFO:teuthology.orchestra.run.smithi017.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-18T05:11:02.297 INFO:teuthology.orchestra.run.smithi017.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-18T05:11:02.297 INFO:teuthology.orchestra.run.smithi017.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-18T05:11:02.298 INFO:teuthology.orchestra.run.smithi017.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-18T05:11:02.298 INFO:teuthology.orchestra.run.smithi017.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-18T05:11:02.307 INFO:teuthology.orchestra.run.smithi017.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-18T05:11:02.310 INFO:teuthology.orchestra.run.smithi017.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-18T05:11:02.310 INFO:teuthology.orchestra.run.smithi017.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-18T05:11:02.312 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-18T05:11:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-18T05:11:02.333 INFO:teuthology.orchestra.run.smithi017.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-18T05:11:02.336 INFO:teuthology.orchestra.run.smithi017.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-18T05:11:02.336 INFO:teuthology.orchestra.run.smithi017.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-18T05:11:02.353 INFO:teuthology.orchestra.run.smithi017.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-18T05:11:02.353 INFO:teuthology.orchestra.run.smithi017.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-18T05:11:02.353 INFO:teuthology.orchestra.run.smithi017.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-18T05:11:02.354 INFO:teuthology.orchestra.run.smithi017.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-18T05:11:02.354 INFO:teuthology.orchestra.run.smithi017.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-18T05:11:02.355 INFO:teuthology.orchestra.run.smithi017.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-18T05:11:02.355 INFO:teuthology.orchestra.run.smithi017.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-18T05:11:02.364 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-18T05:11:02.364 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-855-g19e2a2be-1jammy [5,006 kB] 2024-09-18T05:11:02.369 INFO:teuthology.orchestra.run.smithi017.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-18T05:11:02.373 INFO:teuthology.orchestra.run.smithi017.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-18T05:11:02.381 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-18T05:11:02.386 INFO:teuthology.orchestra.run.smithi017.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-18T05:11:02.387 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-18T05:11:02.388 INFO:teuthology.orchestra.run.smithi017.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-18T05:11:02.388 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-18T05:11:02.389 INFO:teuthology.orchestra.run.smithi017.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-18T05:11:02.389 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-18T05:11:02.392 INFO:teuthology.orchestra.run.smithi017.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-18T05:11:02.394 INFO:teuthology.orchestra.run.smithi017.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-18T05:11:02.399 INFO:teuthology.orchestra.run.smithi017.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-18T05:11:02.402 INFO:teuthology.orchestra.run.smithi017.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-18T05:11:02.402 INFO:teuthology.orchestra.run.smithi017.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-18T05:11:02.404 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-18T05:11:02.404 INFO:teuthology.orchestra.run.smithi017.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-18T05:11:02.405 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-18T05:11:02.405 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-18T05:11:02.407 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-18T05:11:02.411 INFO:teuthology.orchestra.run.smithi017.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-18T05:11:02.421 INFO:teuthology.orchestra.run.smithi017.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-18T05:11:02.421 INFO:teuthology.orchestra.run.smithi017.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-18T05:11:02.429 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-855-g19e2a2be-1jammy [241 kB] 2024-09-18T05:11:02.432 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-855-g19e2a2be-1jammy [130 kB] 2024-09-18T05:11:02.433 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-855-g19e2a2be-1jammy [1,494 kB] 2024-09-18T05:11:02.446 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-855-g19e2a2be-1jammy [6,085 kB] 2024-09-18T05:11:02.481 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-18T05:11:02.481 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-18T05:11:02.482 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-18T05:11:02.483 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-18T05:11:02.483 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-18T05:11:02.541 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-855-g19e2a2be-1jammy [22.4 MB] 2024-09-18T05:11:02.562 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-18T05:11:02.567 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-18T05:11:02.569 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-18T05:11:02.570 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-18T05:11:02.570 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-18T05:11:02.643 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-18T05:11:02.644 INFO:teuthology.orchestra.run.smithi086.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-18T05:11:02.644 INFO:teuthology.orchestra.run.smithi086.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-18T05:11:02.647 INFO:teuthology.orchestra.run.smithi086.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-18T05:11:02.649 INFO:teuthology.orchestra.run.smithi086.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-18T05:11:02.724 INFO:teuthology.orchestra.run.smithi086.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-18T05:11:02.736 INFO:teuthology.orchestra.run.smithi086.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-18T05:11:02.736 INFO:teuthology.orchestra.run.smithi086.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-18T05:11:02.737 INFO:teuthology.orchestra.run.smithi086.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-18T05:11:02.738 INFO:teuthology.orchestra.run.smithi086.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-18T05:11:02.806 INFO:teuthology.orchestra.run.smithi086.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-18T05:11:02.809 INFO:teuthology.orchestra.run.smithi086.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-18T05:11:02.811 INFO:teuthology.orchestra.run.smithi086.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-18T05:11:02.814 INFO:teuthology.orchestra.run.smithi086.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-18T05:11:02.816 INFO:teuthology.orchestra.run.smithi086.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-18T05:11:02.887 INFO:teuthology.orchestra.run.smithi086.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-18T05:11:02.888 INFO:teuthology.orchestra.run.smithi086.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-18T05:11:02.890 INFO:teuthology.orchestra.run.smithi086.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-18T05:11:02.895 INFO:teuthology.orchestra.run.smithi086.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-18T05:11:02.999 INFO:teuthology.orchestra.run.smithi086.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-855-g19e2a2be-1jammy [14.2 kB] 2024-09-18T05:11:03.000 INFO:teuthology.orchestra.run.smithi086.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-855-g19e2a2be-1jammy [835 kB] 2024-09-18T05:11:03.009 INFO:teuthology.orchestra.run.smithi086.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-855-g19e2a2be-1jammy [2,159 kB] 2024-09-18T05:11:03.028 INFO:teuthology.orchestra.run.smithi017.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-855-g19e2a2be-1jammy [3,108 kB] 2024-09-18T05:11:03.034 INFO:teuthology.orchestra.run.smithi086.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-855-g19e2a2be-1jammy [240 kB] 2024-09-18T05:11:03.037 INFO:teuthology.orchestra.run.smithi086.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-855-g19e2a2be-1jammy [145 kB] 2024-09-18T05:11:03.039 INFO:teuthology.orchestra.run.smithi086.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-855-g19e2a2be-1jammy [2,233 kB] 2024-09-18T05:11:03.058 INFO:teuthology.orchestra.run.smithi086.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-18T05:11:03.060 INFO:teuthology.orchestra.run.smithi086.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-18T05:11:03.060 INFO:teuthology.orchestra.run.smithi086.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-855-g19e2a2be-1jammy [8,625 kB] 2024-09-18T05:11:03.063 INFO:teuthology.orchestra.run.smithi086.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-18T05:11:03.063 INFO:teuthology.orchestra.run.smithi086.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-18T05:11:03.065 INFO:teuthology.orchestra.run.smithi086.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-18T05:11:03.065 INFO:teuthology.orchestra.run.smithi086.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-18T05:11:03.085 INFO:teuthology.orchestra.run.smithi086.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-18T05:11:03.090 INFO:teuthology.orchestra.run.smithi086.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-18T05:11:03.091 INFO:teuthology.orchestra.run.smithi086.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-18T05:11:03.144 INFO:teuthology.orchestra.run.smithi086.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-18T05:11:03.191 INFO:teuthology.orchestra.run.smithi086.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-18T05:11:03.194 INFO:teuthology.orchestra.run.smithi086.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-18T05:11:03.195 INFO:teuthology.orchestra.run.smithi086.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-18T05:11:03.208 INFO:teuthology.orchestra.run.smithi086.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-855-g19e2a2be-1jammy [14.3 kB] 2024-09-18T05:11:03.208 INFO:teuthology.orchestra.run.smithi086.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-855-g19e2a2be-1jammy [42.8 MB] 2024-09-18T05:11:03.244 INFO:teuthology.orchestra.run.smithi086.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-18T05:11:03.244 INFO:teuthology.orchestra.run.smithi086.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-18T05:11:03.246 INFO:teuthology.orchestra.run.smithi086.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-18T05:11:03.246 INFO:teuthology.orchestra.run.smithi086.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-18T05:11:03.248 INFO:teuthology.orchestra.run.smithi086.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-18T05:11:03.274 INFO:teuthology.orchestra.run.smithi086.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-18T05:11:03.306 INFO:teuthology.orchestra.run.smithi086.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-18T05:11:03.307 INFO:teuthology.orchestra.run.smithi086.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-18T05:11:03.315 INFO:teuthology.orchestra.run.smithi086.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-18T05:11:03.387 INFO:teuthology.orchestra.run.smithi086.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-18T05:11:03.391 INFO:teuthology.orchestra.run.smithi086.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-18T05:11:03.392 INFO:teuthology.orchestra.run.smithi086.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-18T05:11:03.401 INFO:teuthology.orchestra.run.smithi086.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-18T05:11:03.408 INFO:teuthology.orchestra.run.smithi086.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-18T05:11:03.419 INFO:teuthology.orchestra.run.smithi086.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-18T05:11:03.426 INFO:teuthology.orchestra.run.smithi086.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-18T05:11:03.468 INFO:teuthology.orchestra.run.smithi086.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-18T05:11:03.472 INFO:teuthology.orchestra.run.smithi086.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-18T05:11:03.488 INFO:teuthology.orchestra.run.smithi086.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-18T05:11:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-855-g19e2a2be-1jammy [683 kB] 2024-09-18T05:11:03.550 INFO:teuthology.orchestra.run.smithi086.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-18T05:11:03.551 INFO:teuthology.orchestra.run.smithi086.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-18T05:11:03.590 INFO:teuthology.orchestra.run.smithi017.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-855-g19e2a2be-1jammy [357 kB] 2024-09-18T05:11:03.646 INFO:teuthology.orchestra.run.smithi017.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-855-g19e2a2be-1jammy [32.8 kB] 2024-09-18T05:11:03.647 INFO:teuthology.orchestra.run.smithi017.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-855-g19e2a2be-1jammy [180 kB] 2024-09-18T05:11:03.651 INFO:teuthology.orchestra.run.smithi017.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-855-g19e2a2be-1jammy [63.8 kB] 2024-09-18T05:11:03.700 INFO:teuthology.orchestra.run.smithi017.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-855-g19e2a2be-1jammy [334 kB] 2024-09-18T05:11:03.707 INFO:teuthology.orchestra.run.smithi017.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-855-g19e2a2be-1jammy [5,934 kB] 2024-09-18T05:11:04.152 INFO:teuthology.orchestra.run.smithi017.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-855-g19e2a2be-1jammy [112 kB] 2024-09-18T05:11:04.155 INFO:teuthology.orchestra.run.smithi017.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-855-g19e2a2be-1jammy [445 kB] 2024-09-18T05:11:04.156 INFO:teuthology.orchestra.run.smithi086.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-855-g19e2a2be-1jammy [122 kB] 2024-09-18T05:11:04.167 INFO:teuthology.orchestra.run.smithi017.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-855-g19e2a2be-1jammy [22.0 MB] 2024-09-18T05:11:04.225 INFO:teuthology.orchestra.run.smithi086.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-855-g19e2a2be-1jammy [38.3 kB] 2024-09-18T05:11:04.226 INFO:teuthology.orchestra.run.smithi086.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-855-g19e2a2be-1jammy [11.7 MB] 2024-09-18T05:11:04.503 INFO:teuthology.orchestra.run.smithi086.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-855-g19e2a2be-1jammy [93.1 kB] 2024-09-18T05:11:04.768 INFO:teuthology.orchestra.run.smithi017.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-855-g19e2a2be-1jammy [5,006 kB] 2024-09-18T05:11:04.836 INFO:teuthology.orchestra.run.smithi017.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-855-g19e2a2be-1jammy [241 kB] 2024-09-18T05:11:04.839 INFO:teuthology.orchestra.run.smithi017.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-855-g19e2a2be-1jammy [130 kB] 2024-09-18T05:11:04.841 INFO:teuthology.orchestra.run.smithi017.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-855-g19e2a2be-1jammy [1,494 kB] 2024-09-18T05:11:04.855 INFO:teuthology.orchestra.run.smithi017.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-855-g19e2a2be-1jammy [6,085 kB] 2024-09-18T05:11:04.938 INFO:teuthology.orchestra.run.smithi017.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-855-g19e2a2be-1jammy [22.4 MB] 2024-09-18T05:11:05.105 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 163 MB in 3s (51.5 MB/s) 2024-09-18T05:11:05.249 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-18T05:11:05.339 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-18T05:11:05.344 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-18T05:11:05.386 INFO:teuthology.orchestra.run.smithi017.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-855-g19e2a2be-1jammy [14.2 kB] 2024-09-18T05:11:05.386 INFO:teuthology.orchestra.run.smithi017.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-855-g19e2a2be-1jammy [835 kB] 2024-09-18T05:11:05.396 INFO:teuthology.orchestra.run.smithi017.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-855-g19e2a2be-1jammy [2,159 kB] 2024-09-18T05:11:05.422 INFO:teuthology.orchestra.run.smithi017.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-855-g19e2a2be-1jammy [240 kB] 2024-09-18T05:11:05.424 INFO:teuthology.orchestra.run.smithi017.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-855-g19e2a2be-1jammy [145 kB] 2024-09-18T05:11:05.426 INFO:teuthology.orchestra.run.smithi017.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-855-g19e2a2be-1jammy [2,233 kB] 2024-09-18T05:11:05.431 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-18T05:11:05.449 INFO:teuthology.orchestra.run.smithi017.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-855-g19e2a2be-1jammy [8,625 kB] 2024-09-18T05:11:05.572 INFO:teuthology.orchestra.run.smithi017.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-855-g19e2a2be-1jammy [14.3 kB] 2024-09-18T05:11:05.573 INFO:teuthology.orchestra.run.smithi017.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-855-g19e2a2be-1jammy [42.8 MB] 2024-09-18T05:11:05.775 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-18T05:11:05.802 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-18T05:11:05.842 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-18T05:11:06.145 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-18T05:11:06.161 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-18T05:11:06.195 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-18T05:11:06.454 INFO:teuthology.orchestra.run.smithi017.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-855-g19e2a2be-1jammy [122 kB] 2024-09-18T05:11:06.456 INFO:teuthology.orchestra.run.smithi017.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-855-g19e2a2be-1jammy [38.3 kB] 2024-09-18T05:11:06.457 INFO:teuthology.orchestra.run.smithi017.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-855-g19e2a2be-1jammy [11.7 MB] 2024-09-18T05:11:06.531 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-18T05:11:06.558 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-18T05:11:06.598 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-18T05:11:06.609 INFO:teuthology.orchestra.run.smithi017.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-855-g19e2a2be-1jammy [93.1 kB] 2024-09-18T05:11:07.051 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-18T05:11:07.078 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T05:11:07.126 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:11:07.220 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 163 MB in 5s (33.7 MB/s) 2024-09-18T05:11:07.328 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-18T05:11:07.409 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-18T05:11:07.414 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-18T05:11:07.485 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-18T05:11:07.504 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-18T05:11:07.531 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T05:11:07.562 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:11:07.805 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-18T05:11:07.832 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-18T05:11:07.872 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-18T05:11:07.915 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-18T05:11:07.942 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T05:11:07.982 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:11:08.208 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-18T05:11:08.235 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-18T05:11:08.275 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-18T05:11:08.335 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-18T05:11:08.361 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-18T05:11:08.401 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-18T05:11:08.536 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-18T05:11:08.559 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-18T05:11:08.594 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-18T05:11:08.729 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librados2. 2024-09-18T05:11:08.756 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../008-librados2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:08.795 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:09.056 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-18T05:11:09.083 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T05:11:09.132 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:11:09.206 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librbd1. 2024-09-18T05:11:09.233 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../009-librbd1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:09.273 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:09.542 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-18T05:11:09.569 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T05:11:09.609 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:11:09.701 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs2. 2024-09-18T05:11:09.727 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:09.767 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:09.911 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-18T05:11:09.938 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T05:11:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:11:10.103 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rados. 2024-09-18T05:11:10.119 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../011-python3-rados_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:10.161 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:10.323 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-18T05:11:10.350 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-18T05:11:10.389 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-18T05:11:10.456 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-18T05:11:10.482 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:10.522 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:10.717 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librados2. 2024-09-18T05:11:10.724 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cephfs. 2024-09-18T05:11:10.740 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:10.744 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../008-librados2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:10.782 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:10.783 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:11.102 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-18T05:11:11.129 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:11.169 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:11.236 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librbd1. 2024-09-18T05:11:11.263 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../009-librbd1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:11.303 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:11.496 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-18T05:11:11.523 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-18T05:11:11.563 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-18T05:11:11.734 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libcephfs2. 2024-09-18T05:11:11.759 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:11.799 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:11.891 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-prettytable. 2024-09-18T05:11:11.917 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-18T05:11:11.957 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-18T05:11:12.076 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rados. 2024-09-18T05:11:12.092 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../011-python3-rados_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:12.135 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:12.218 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rbd. 2024-09-18T05:11:12.234 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:12.268 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:12.462 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-18T05:11:12.489 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:12.529 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:12.613 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-18T05:11:12.640 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-18T05:11:12.679 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-18T05:11:12.765 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cephfs. 2024-09-18T05:11:12.781 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:12.814 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:13.007 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librgw2. 2024-09-18T05:11:13.033 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../019-librgw2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:13.073 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:13.134 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-18T05:11:13.161 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:13.201 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:13.529 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-18T05:11:13.555 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-18T05:11:13.575 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rgw. 2024-09-18T05:11:13.595 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-18T05:11:13.601 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:13.650 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:13.939 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-prettytable. 2024-09-18T05:11:13.953 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-18T05:11:13.966 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-18T05:11:13.979 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-18T05:11:14.006 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-18T05:11:14.011 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-18T05:11:14.250 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rbd. 2024-09-18T05:11:14.266 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:14.300 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:14.314 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libradosstriper1. 2024-09-18T05:11:14.340 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:14.381 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:14.620 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-18T05:11:14.646 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-18T05:11:14.686 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-18T05:11:14.809 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-common. 2024-09-18T05:11:14.835 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../023-ceph-common_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:14.875 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:15.014 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librgw2. 2024-09-18T05:11:15.041 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../019-librgw2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:15.080 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:15.600 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rgw. 2024-09-18T05:11:15.626 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:15.977 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-18T05:11:16.004 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-18T05:11:16.044 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-18T05:11:16.131 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-base. 2024-09-18T05:11:16.157 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../024-ceph-base_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:16.206 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:16.355 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libradosstriper1. 2024-09-18T05:11:16.381 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:16.421 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:16.785 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-18T05:11:16.812 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-18T05:11:16.843 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-18T05:11:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-common. 2024-09-18T05:11:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../023-ceph-common_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:16.916 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:17.137 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cheroot. 2024-09-18T05:11:17.164 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-18T05:11:17.204 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-18T05:11:17.540 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-18T05:11:17.567 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-18T05:11:17.606 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-18T05:11:17.909 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-18T05:11:17.936 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-18T05:11:17.976 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-18T05:11:18.171 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-base. 2024-09-18T05:11:18.198 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../024-ceph-base_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:18.245 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-18T05:11:18.247 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:18.272 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-18T05:11:18.303 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-18T05:11:18.589 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempora. 2024-09-18T05:11:18.616 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-18T05:11:18.656 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-18T05:11:18.817 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-18T05:11:18.844 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-18T05:11:18.884 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-18T05:11:18.959 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-portend. 2024-09-18T05:11:18.985 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-18T05:11:19.025 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-18T05:11:19.203 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cheroot. 2024-09-18T05:11:19.230 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-18T05:11:19.269 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-18T05:11:19.328 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-18T05:11:19.355 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-18T05:11:19.394 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-18T05:11:19.597 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-18T05:11:19.624 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-18T05:11:19.655 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-18T05:11:19.664 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-18T05:11:19.671 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-18T05:11:19.705 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-18T05:11:19.975 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-18T05:11:20.002 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-18T05:11:20.051 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-18T05:11:20.359 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-natsort. 2024-09-18T05:11:20.385 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-18T05:11:20.420 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-18T05:11:20.425 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-18T05:11:20.446 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-18T05:11:20.494 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-18T05:11:20.712 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-logutils. 2024-09-18T05:11:20.738 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-18T05:11:20.778 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-18T05:11:20.822 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-tempora. 2024-09-18T05:11:20.849 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-18T05:11:20.889 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-18T05:11:21.039 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-18T05:11:21.066 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-18T05:11:21.106 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-18T05:11:21.208 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-portend. 2024-09-18T05:11:21.236 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-18T05:11:21.275 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-18T05:11:21.408 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-mako. 2024-09-18T05:11:21.435 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-18T05:11:21.475 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-18T05:11:21.603 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-18T05:11:21.630 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-18T05:11:21.677 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-18T05:11:21.812 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-18T05:11:21.838 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-18T05:11:21.878 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-18T05:11:22.080 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-18T05:11:22.107 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-18T05:11:22.155 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-18T05:11:22.181 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-18T05:11:22.207 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-18T05:11:22.247 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-18T05:11:22.500 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webob. 2024-09-18T05:11:22.526 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-18T05:11:22.542 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-natsort. 2024-09-18T05:11:22.558 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-18T05:11:22.569 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-18T05:11:22.617 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-18T05:11:22.894 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-waitress. 2024-09-18T05:11:22.920 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-18T05:11:22.964 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-18T05:11:22.995 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-logutils. 2024-09-18T05:11:23.022 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-18T05:11:23.070 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-18T05:11:23.272 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempita. 2024-09-18T05:11:23.298 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-18T05:11:23.338 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-18T05:11:23.389 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-18T05:11:23.416 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-18T05:11:23.456 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-18T05:11:23.641 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-paste. 2024-09-18T05:11:23.667 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-18T05:11:23.707 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-18T05:11:23.717 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-mako. 2024-09-18T05:11:23.733 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-18T05:11:23.767 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-18T05:11:24.045 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-18T05:11:24.052 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-18T05:11:24.068 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-18T05:11:24.071 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-18T05:11:24.103 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-18T05:11:24.111 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-18T05:11:24.406 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-18T05:11:24.413 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-18T05:11:24.433 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-18T05:11:24.439 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-18T05:11:24.472 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-18T05:11:24.479 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-18T05:11:24.741 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webtest. 2024-09-18T05:11:24.767 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-18T05:11:24.799 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-18T05:11:24.800 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-webob. 2024-09-18T05:11:24.827 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-18T05:11:24.866 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-18T05:11:25.102 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pecan. 2024-09-18T05:11:25.128 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-18T05:11:25.219 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-waitress. 2024-09-18T05:11:25.247 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-18T05:11:25.289 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-18T05:11:25.327 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-18T05:11:25.580 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-tempita. 2024-09-18T05:11:25.596 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-18T05:11:25.630 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-18T05:11:25.690 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-certifi. 2024-09-18T05:11:25.716 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-18T05:11:25.756 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-18T05:11:25.866 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-paste. 2024-09-18T05:11:25.894 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-18T05:11:25.941 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-18T05:11:26.092 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-idna. 2024-09-18T05:11:26.119 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-18T05:11:26.158 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-18T05:11:26.261 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-18T05:11:26.277 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-18T05:11:26.311 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-18T05:11:26.428 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-urllib3. 2024-09-18T05:11:26.443 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-18T05:11:26.478 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-18T05:11:26.589 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-18T05:11:26.615 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-18T05:11:26.655 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-18T05:11:26.731 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests. 2024-09-18T05:11:26.757 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-18T05:11:26.789 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-18T05:11:26.958 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-webtest. 2024-09-18T05:11:26.985 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-18T05:11:27.033 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-18T05:11:27.084 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-18T05:11:27.111 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-18T05:11:27.142 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-18T05:11:27.344 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pecan. 2024-09-18T05:11:27.371 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-18T05:11:27.411 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-18T05:11:27.419 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-18T05:11:27.435 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:27.470 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:27.765 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-certifi. 2024-09-18T05:11:27.850 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-18T05:11:27.850 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-18T05:11:27.866 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-18T05:11:27.893 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:27.932 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:28.151 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-idna. 2024-09-18T05:11:28.168 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-18T05:11:28.226 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-18T05:11:28.235 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-18T05:11:28.262 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-18T05:11:28.310 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-18T05:11:28.513 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-urllib3. 2024-09-18T05:11:28.536 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-18T05:11:28.571 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-openssl. 2024-09-18T05:11:28.579 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-18T05:11:28.598 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-18T05:11:28.637 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-18T05:11:28.873 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-requests. 2024-09-18T05:11:28.901 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-18T05:11:28.940 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-18T05:11:28.996 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr. 2024-09-18T05:11:29.023 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:29.065 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-18T05:11:29.278 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-18T05:11:29.318 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-18T05:11:29.452 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mon. 2024-09-18T05:11:29.478 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:29.518 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:29.579 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-18T05:11:29.595 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:29.637 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:30.050 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-18T05:11:30.072 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-osd. 2024-09-18T05:11:30.077 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:30.098 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:30.116 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:30.130 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:30.711 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-18T05:11:30.738 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-18T05:11:30.777 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-18T05:11:31.055 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-openssl. 2024-09-18T05:11:31.071 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-18T05:11:31.105 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-18T05:11:31.141 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph. 2024-09-18T05:11:31.164 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../060-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:31.207 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:31.392 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr. 2024-09-18T05:11:31.418 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:31.458 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:31.535 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-fuse. 2024-09-18T05:11:31.562 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:31.602 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:31.878 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mon. 2024-09-18T05:11:31.905 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:31.944 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:31.955 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mds. 2024-09-18T05:11:31.982 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:32.022 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:32.383 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephadm. 2024-09-18T05:11:32.402 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../063-cephadm_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:32.441 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:32.514 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-osd. 2024-09-18T05:11:32.541 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:32.572 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:32.760 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-18T05:11:32.787 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-18T05:11:32.852 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-18T05:11:33.188 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-18T05:11:33.215 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-18T05:11:33.254 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-18T05:11:33.693 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph. 2024-09-18T05:11:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../060-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:34.070 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-fuse. 2024-09-18T05:11:34.097 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:34.136 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:34.268 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-babel. 2024-09-18T05:11:34.295 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-18T05:11:34.334 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-18T05:11:34.465 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mds. 2024-09-18T05:11:34.492 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:34.523 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:35.416 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jinja2. 2024-09-18T05:11:35.443 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-18T05:11:35.487 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-18T05:11:35.693 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package cephadm. 2024-09-18T05:11:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../063-cephadm_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:36.041 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-18T05:11:36.067 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:36.079 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-18T05:11:36.098 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:36.106 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-18T05:11:36.145 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-18T05:11:36.419 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pluggy. 2024-09-18T05:11:36.445 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-18T05:11:36.465 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-18T05:11:36.485 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-18T05:11:36.492 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-18T05:11:36.531 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-18T05:11:36.780 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-py. 2024-09-18T05:11:36.807 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-18T05:11:36.846 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-18T05:11:37.166 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-18T05:11:37.193 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-18T05:11:37.233 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-18T05:11:37.544 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-toml. 2024-09-18T05:11:37.570 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-18T05:11:37.578 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-babel. 2024-09-18T05:11:37.606 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-18T05:11:37.619 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-18T05:11:37.644 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-18T05:11:37.863 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pytest. 2024-09-18T05:11:37.890 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-18T05:11:37.921 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-18T05:11:37.973 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jinja2. 2024-09-18T05:11:38.000 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-18T05:11:38.039 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-18T05:11:38.266 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-18T05:11:38.293 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-18T05:11:38.333 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-18T05:11:38.401 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-18T05:11:38.428 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:38.467 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:38.602 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-routes. 2024-09-18T05:11:38.629 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-18T05:11:38.669 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-18T05:11:38.804 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pluggy. 2024-09-18T05:11:38.831 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-18T05:11:38.870 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-18T05:11:38.949 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-18T05:11:38.976 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:39.007 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:39.223 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-py. 2024-09-18T05:11:39.250 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-18T05:11:39.290 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-18T05:11:39.627 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-18T05:11:39.654 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-18T05:11:39.693 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-18T05:11:39.946 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-toml. 2024-09-18T05:11:39.973 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-18T05:11:40.004 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-18T05:11:40.220 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-18T05:11:40.233 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-18T05:11:40.248 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pytest. 2024-09-18T05:11:40.264 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-18T05:11:40.270 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-18T05:11:40.298 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-18T05:11:40.635 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-18T05:11:40.662 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-18T05:11:40.693 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-18T05:11:40.782 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-joblib. 2024-09-18T05:11:40.795 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-18T05:11:40.840 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-18T05:11:41.013 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-routes. 2024-09-18T05:11:41.040 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-18T05:11:41.079 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-18T05:11:41.210 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-18T05:11:41.237 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-18T05:11:41.301 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-18T05:11:41.391 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-18T05:11:41.418 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:41.457 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:41.604 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn. 2024-09-18T05:11:41.631 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-18T05:11:41.679 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-18T05:11:42.378 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-18T05:11:42.394 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:42.428 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:42.704 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-18T05:11:42.721 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-18T05:11:42.754 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-18T05:11:43.258 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-joblib. 2024-09-18T05:11:43.285 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-18T05:11:43.324 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-18T05:11:43.373 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cachetools. 2024-09-18T05:11:43.400 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-18T05:11:43.439 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-18T05:11:43.678 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-18T05:11:43.705 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-18T05:11:43.744 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-18T05:11:43.810 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-18T05:11:43.837 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-18T05:11:43.877 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-18T05:11:44.055 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-sklearn. 2024-09-18T05:11:44.083 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-18T05:11:44.121 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-18T05:11:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-18T05:11:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-18T05:11:44.305 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-18T05:11:44.616 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rsa. 2024-09-18T05:11:44.643 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-18T05:11:44.683 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-18T05:11:44.772 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-18T05:11:44.800 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:44.829 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:45.003 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-google-auth. 2024-09-18T05:11:45.030 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-18T05:11:45.069 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-18T05:11:45.416 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-18T05:11:45.441 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-18T05:11:45.481 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-18T05:11:45.774 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cachetools. 2024-09-18T05:11:45.792 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-websocket. 2024-09-18T05:11:45.802 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-18T05:11:45.819 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-18T05:11:45.840 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-18T05:11:45.858 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-18T05:11:46.220 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-18T05:11:46.234 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-18T05:11:46.248 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-18T05:11:46.250 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-18T05:11:46.286 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-18T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-18T05:11:46.565 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-18T05:11:46.592 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-18T05:11:46.623 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-18T05:11:46.884 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rsa. 2024-09-18T05:11:46.906 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-18T05:11:46.950 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-18T05:11:47.017 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-18T05:11:47.044 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:47.083 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:47.271 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-google-auth. 2024-09-18T05:11:47.299 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-18T05:11:47.337 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-18T05:11:47.377 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-18T05:11:47.404 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-18T05:11:47.443 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-18T05:11:47.607 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-18T05:11:47.635 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-18T05:11:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-18T05:11:47.730 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-18T05:11:47.757 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-18T05:11:47.796 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-18T05:11:47.977 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-websocket. 2024-09-18T05:11:48.005 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-18T05:11:48.043 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-18T05:11:48.049 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package jq. 2024-09-18T05:11:48.065 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-18T05:11:48.107 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-18T05:11:48.355 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-18T05:11:48.359 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package socat. 2024-09-18T05:11:48.382 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-18T05:11:48.387 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-18T05:11:48.421 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-18T05:11:48.426 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-18T05:11:48.737 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package xmlstarlet. 2024-09-18T05:11:48.753 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-18T05:11:48.795 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-18T05:11:49.097 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-18T05:11:49.122 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:49.149 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-test. 2024-09-18T05:11:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:49.166 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../096-ceph-test_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:49.208 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:49.431 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-18T05:11:49.459 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-18T05:11:49.489 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-18T05:11:49.850 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-18T05:11:49.878 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-18T05:11:49.917 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-18T05:11:50.169 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package jq. 2024-09-18T05:11:50.197 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-18T05:11:50.235 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-18T05:11:50.480 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package socat. 2024-09-18T05:11:50.496 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-18T05:11:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-18T05:11:50.825 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package xmlstarlet. 2024-09-18T05:11:50.841 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-18T05:11:50.874 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-18T05:11:51.103 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-volume. 2024-09-18T05:11:51.119 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:51.161 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:51.465 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-18T05:11:51.493 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:51.520 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-test. 2024-09-18T05:11:51.532 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:51.536 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../096-ceph-test_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:51.579 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:51.826 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package nvme-cli. 2024-09-18T05:11:51.842 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-18T05:11:51.885 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-18T05:11:52.239 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-18T05:11:52.255 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-18T05:11:52.298 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-18T05:11:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastescript. 2024-09-18T05:11:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-18T05:11:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-18T05:11:53.137 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-psutil. 2024-09-18T05:11:53.165 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-18T05:11:53.203 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-18T05:11:53.548 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pygments. 2024-09-18T05:11:53.549 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-volume. 2024-09-18T05:11:53.564 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-18T05:11:53.577 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-18T05:11:53.606 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-18T05:11:53.615 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:53.911 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-18T05:11:53.939 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:53.977 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:54.085 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-18T05:11:54.113 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-18T05:11:54.151 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-18T05:11:54.339 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package nvme-cli. 2024-09-18T05:11:54.367 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-18T05:11:54.405 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-18T05:11:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplejson. 2024-09-18T05:11:54.448 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-18T05:11:54.479 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-18T05:11:54.706 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-18T05:11:54.722 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-18T05:11:54.735 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-18T05:11:54.751 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-18T05:11:54.756 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-18T05:11:54.793 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-18T05:11:55.230 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pastescript. 2024-09-18T05:11:55.258 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-18T05:11:55.296 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-18T05:11:55.468 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package radosgw. 2024-09-18T05:11:55.496 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../107-radosgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:55.534 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:55.616 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-psutil. 2024-09-18T05:11:55.644 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-18T05:11:55.683 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-18T05:11:56.036 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pygments. 2024-09-18T05:11:56.064 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-18T05:11:56.102 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-18T05:11:56.329 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package rbd-fuse. 2024-09-18T05:11:56.357 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:56.554 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:56.598 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-18T05:11:56.626 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-18T05:11:56.664 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-18T05:11:56.933 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-18T05:11:56.950 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-simplejson. 2024-09-18T05:11:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-18T05:11:57.000 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-18T05:11:57.192 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-18T05:11:57.236 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-18T05:11:57.265 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-18T05:11:57.302 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-18T05:11:57.318 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-18T05:11:57.574 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-18T05:11:57.883 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-18T05:11:58.023 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package radosgw. 2024-09-18T05:11:58.051 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../107-radosgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:58.089 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-18T05:11:58.370 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:58.825 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package rbd-fuse. 2024-09-18T05:11:58.842 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-18T05:11:58.860 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user cephadm....done 2024-09-18T05:11:58.883 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:11:59.017 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-18T05:11:59.180 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-18T05:11:59.276 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-18T05:11:59.438 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-18T05:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-18T05:11:59.564 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-18T05:11:59.628 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-18T05:11:59.808 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-18T05:11:59.879 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-18T05:12:00.146 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-18T05:12:00.155 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-18T05:12:00.282 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-18T05:12:00.577 INFO:teuthology.orchestra.run.smithi017.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-18T05:12:00.600 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-18T05:12:00.641 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:00.977 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-18T05:12:01.237 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-18T05:12:01.497 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-18T05:12:01.678 INFO:teuthology.orchestra.run.smithi017.stdout:Adding system user cephadm....done 2024-09-18T05:12:01.765 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-18T05:12:01.923 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-18T05:12:02.039 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-18T05:12:02.191 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-18T05:12:02.274 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:02.450 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-18T05:12:02.533 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-18T05:12:02.576 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-18T05:12:02.642 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-18T05:12:02.844 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-18T05:12:02.893 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-18T05:12:03.002 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-18T05:12:03.086 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-18T05:12:03.213 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-18T05:12:03.345 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-18T05:12:03.463 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-18T05:12:03.523 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-18T05:12:03.747 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-18T05:12:03.883 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-18T05:12:04.006 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-18T05:12:04.134 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-18T05:12:04.316 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-18T05:12:04.402 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-18T05:12:04.652 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-18T05:12:04.904 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-18T05:12:04.993 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-18T05:12:05.163 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:05.285 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-18T05:12:05.411 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-18T05:12:05.431 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-18T05:12:05.532 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-18T05:12:05.537 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-18T05:12:05.774 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-18T05:12:05.866 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-18T05:12:05.900 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-18T05:12:06.248 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-18T05:12:06.285 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-18T05:12:06.419 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-18T05:12:06.499 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-18T05:12:06.686 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-18T05:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-18T05:12:06.963 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-18T05:12:07.168 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-18T05:12:07.272 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-18T05:12:07.511 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-18T05:12:07.754 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-18T05:12:07.871 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:07.991 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-18T05:12:08.173 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-18T05:12:08.258 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-18T05:12:08.376 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-18T05:12:08.482 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-18T05:12:08.502 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-18T05:12:08.803 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-18T05:12:09.204 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-18T05:12:09.455 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-18T05:12:09.662 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:12:09.796 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-18T05:12:09.848 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-18T05:12:10.073 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-18T05:12:10.124 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-18T05:12:10.199 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-18T05:12:10.324 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-18T05:12:10.476 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-18T05:12:10.626 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-18T05:12:10.735 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-18T05:12:10.836 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:10.885 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-18T05:12:11.120 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:12:11.129 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-18T05:12:11.245 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-18T05:12:11.371 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-18T05:12:11.472 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-18T05:12:11.681 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-18T05:12:11.932 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-18T05:12:12.333 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-18T05:12:12.601 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-18T05:12:12.644 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:12:12.761 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-18T05:12:12.852 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-18T05:12:13.038 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-18T05:12:13.111 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-18T05:12:13.163 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-18T05:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-18T05:12:13.289 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-18T05:12:13.505 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-18T05:12:13.591 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-18T05:12:13.631 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-18T05:12:13.850 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-18T05:12:13.915 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-18T05:12:14.151 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:12:14.225 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-18T05:12:14.252 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-18T05:12:14.353 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-18T05:12:14.484 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-18T05:12:14.679 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-18T05:12:14.880 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-18T05:12:14.939 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-18T05:12:15.120 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-18T05:12:15.206 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-18T05:12:15.229 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-18T05:12:15.466 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-18T05:12:15.639 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-18T05:12:15.717 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-18T05:12:15.899 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-18T05:12:15.959 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-18T05:12:16.060 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-18T05:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:12:16.276 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-18T05:12:16.319 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-18T05:12:16.454 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-18T05:12:16.593 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-18T05:12:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-18T05:12:16.894 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-18T05:12:17.073 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-18T05:12:17.162 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-18T05:12:17.263 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-18T05:12:17.523 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-18T05:12:17.541 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-18T05:12:17.791 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-18T05:12:17.904 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-18T05:12:18.050 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-18T05:12:18.151 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-18T05:12:18.277 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-18T05:12:18.451 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-18T05:12:18.704 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-18T05:12:18.736 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-18T05:12:18.963 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-18T05:12:19.071 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-18T05:12:19.189 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T05:12:19.315 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:19.332 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-18T05:12:19.466 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:19.592 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:19.649 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-18T05:12:19.718 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:19.929 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-18T05:12:19.951 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-18T05:12:20.214 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:20.227 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-18T05:12:20.327 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-18T05:12:20.340 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:20.466 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:20.612 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-18T05:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T05:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T05:12:20.888 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-18T05:12:21.117 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:21.164 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-18T05:12:21.243 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:21.369 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-18T05:12:21.557 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-18T05:12:21.834 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-18T05:12:22.177 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-18T05:12:22.303 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:22.438 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:22.540 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:22.564 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:22.666 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:22.690 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:22.792 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:22.799 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:22.918 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:23.002 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-18T05:12:23.044 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:23.286 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:23.421 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:23.547 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:23.561 INFO:teuthology.orchestra.run.smithi086.stdout:Adding group ceph....done 2024-09-18T05:12:23.765 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T05:12:23.765 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T05:12:23.912 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user ceph....done 2024-09-18T05:12:24.081 INFO:teuthology.orchestra.run.smithi086.stdout:Setting system user ceph properties....done 2024-09-18T05:12:24.099 INFO:teuthology.orchestra.run.smithi086.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-18T05:12:24.231 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:24.237 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-18T05:12:24.332 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:24.433 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-18T05:12:24.563 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-18T05:12:25.036 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:25.162 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:25.637 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T05:12:25.638 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T05:12:25.679 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:25.805 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:25.931 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:26.032 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:26.114 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:26.141 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:26.462 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-18T05:12:26.718 INFO:teuthology.orchestra.run.smithi017.stdout:Adding group ceph....done 2024-09-18T05:12:26.924 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:27.028 INFO:teuthology.orchestra.run.smithi017.stdout:Adding system user ceph....done 2024-09-18T05:12:27.171 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T05:12:27.172 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T05:12:27.197 INFO:teuthology.orchestra.run.smithi017.stdout:Setting system user ceph properties....done 2024-09-18T05:12:27.212 INFO:teuthology.orchestra.run.smithi017.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-18T05:12:27.355 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-18T05:12:27.716 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-18T05:12:27.905 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:28.168 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:28.269 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:28.269 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T05:12:28.269 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T05:12:28.744 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T05:12:28.745 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T05:12:28.745 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:29.083 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T05:12:29.083 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T05:12:29.203 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:29.581 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:29.604 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-18T05:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:29.867 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:30.089 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:30.092 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T05:12:30.092 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T05:12:30.352 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T05:12:30.352 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T05:12:30.569 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:30.720 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:30.838 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:30.874 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:31.022 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:31.103 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T05:12:31.103 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T05:12:31.359 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-18T05:12:31.592 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:31.860 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T05:12:31.860 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T05:12:32.175 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-18T05:12:32.352 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:32.469 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:32.620 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:32.640 INFO:teuthology.orchestra.run.smithi086.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-18T05:12:32.647 DEBUG:teuthology.parallel:result is None 2024-09-18T05:12:32.898 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T05:12:32.899 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T05:12:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:33.564 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:33.841 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-18T05:12:34.186 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-18T05:12:35.269 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-18T05:12:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-18T05:12:35.756 DEBUG:teuthology.parallel:result is None 2024-09-18T05:12:35.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-18T05:12:35.904 DEBUG:teuthology.orchestra.run.smithi017:> dpkg-query -W -f '${Version}' ceph 2024-09-18T05:12:35.924 INFO:teuthology.orchestra.run.smithi017.stdout:18.2.4-855-g19e2a2be-1jammy 2024-09-18T05:12:35.925 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855-g19e2a2be-1jammy 2024-09-18T05:12:35.925 INFO:teuthology.task.install:The correct ceph version 18.2.4-855-g19e2a2be-1jammy is installed. 2024-09-18T05:12:35.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-18T05:12:36.076 DEBUG:teuthology.orchestra.run.smithi086:> dpkg-query -W -f '${Version}' ceph 2024-09-18T05:12:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:18.2.4-855-g19e2a2be-1jammy 2024-09-18T05:12:36.096 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855-g19e2a2be-1jammy 2024-09-18T05:12:36.096 INFO:teuthology.task.install:The correct ceph version 18.2.4-855-g19e2a2be-1jammy is installed. 2024-09-18T05:12:36.098 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T05:12:36.099 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:36.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T05:12:36.114 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:12:36.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T05:12:36.157 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T05:12:36.157 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:36.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T05:12:36.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T05:12:36.227 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:12:36.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T05:12:36.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T05:12:36.295 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T05:12:36.295 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:36.295 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T05:12:36.309 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T05:12:36.364 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:12:36.364 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T05:12:36.377 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T05:12:36.431 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T05:12:36.431 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:36.432 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T05:12:36.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T05:12:36.500 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:12:36.500 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T05:12:36.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T05:12:36.567 INFO:teuthology.run_tasks:Running task ceph... 2024-09-18T05:12:36.652 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-18T05:12:36.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2024-09-18T05:12:36.655 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2024-09-18T05:12:36.667 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-18T05:12:36.668 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T05:12:36.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T05:12:36.722 INFO:tasks.ceph:Creating extra log directories... 2024-09-18T05:12:36.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T05:12:36.765 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T05:12:36.800 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-18T05:12:36.800 INFO:tasks.ceph:config {'conf': {'client': {'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-18T05:12:36.801 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813', 'branch': 'reef', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7909813', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4623, 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', 'sleep_before_teardown': 0, 'subset': '80/128', 'suite': 'rbd', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7', 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN+wzZQhyAmHg8/DyYx5k0UkAM2f0MMg+p23w5iMCXsFf/eeETrjjgMDVIs+mP4e6tTWDDBgx7ce4TXmsVpx5DQ=', 'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBr3pn31Viimag/Viz9frM8mkQzg2Cl8euAoS/aNvpANd1JGApCOmyzSzKB/tECRemtFjRxeaCkwhGcLVm8FiQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_22:16:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-18T05:12:36.802 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T05:12:36.821 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T05:12:36.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T05:12:36.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T05:12:36.884 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:36.884 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T05:12:36.930 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T05:12:36.930 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-18T05:12:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T05:12:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T05:12:36.977 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-09-18T05:12:36.977 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T05:12:36.977 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-18 05:07:17.188072493 +0000 2024-09-18T05:12:36.978 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-18 05:07:16.908074994 +0000 2024-09-18T05:12:36.978 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-18 05:07:16.908074994 +0000 2024-09-18T05:12:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-18T05:12:36.978 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T05:12:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-18T05:12:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-18T05:12:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000311345 s, 1.6 MB/s 2024-09-18T05:12:37.032 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T05:12:37.082 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-18T05:12:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T05:12:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T05:12:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-18T05:12:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T05:12:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-18 05:07:17.696067955 +0000 2024-09-18T05:12:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-18 05:07:17.420070421 +0000 2024-09-18T05:12:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-18 05:07:17.420070421 +0000 2024-09-18T05:12:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-18T05:12:37.133 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T05:12:37.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-18T05:12:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-18T05:12:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000317505 s, 1.6 MB/s 2024-09-18T05:12:37.188 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T05:12:37.241 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-18T05:12:37.287 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T05:12:37.288 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T05:12:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-09-18T05:12:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T05:12:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-18 05:07:18.176063668 +0000 2024-09-18T05:12:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-18 05:07:17.916065990 +0000 2024-09-18T05:12:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-18 05:07:17.916065990 +0000 2024-09-18T05:12:37.288 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-18T05:12:37.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T05:12:37.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-18T05:12:37.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-18T05:12:37.342 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.00030657 s, 1.7 MB/s 2024-09-18T05:12:37.344 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T05:12:37.393 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-18T05:12:37.439 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T05:12:37.440 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T05:12:37.440 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-18T05:12:37.440 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T05:12:37.440 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-18 05:07:18.668059273 +0000 2024-09-18T05:12:37.440 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-18 05:07:18.400061667 +0000 2024-09-18T05:12:37.440 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-18 05:07:18.400061667 +0000 2024-09-18T05:12:37.440 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-18T05:12:37.440 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T05:12:37.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-18T05:12:37.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-18T05:12:37.494 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000250363 s, 2.0 MB/s 2024-09-18T05:12:37.495 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T05:12:37.545 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:37.545 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:12:37.545 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T05:12:37.552 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T05:12:37.552 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-09-18T05:12:37.601 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T05:12:37.601 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T05:12:37.601 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-18T05:12:37.601 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T05:12:37.601 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-18 05:07:17.149041832 +0000 2024-09-18T05:12:37.601 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-18 05:07:16.901044047 +0000 2024-09-18T05:12:37.602 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-18 05:07:16.901044047 +0000 2024-09-18T05:12:37.602 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-18T05:12:37.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T05:12:37.661 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-18T05:12:37.661 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-18T05:12:37.661 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.00043237 s, 1.2 MB/s 2024-09-18T05:12:37.662 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T05:12:37.709 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-09-18T05:12:37.756 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T05:12:37.757 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T05:12:37.757 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-18T05:12:37.757 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T05:12:37.757 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-18 05:07:17.361039940 +0000 2024-09-18T05:12:37.757 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-18 05:07:17.357039974 +0000 2024-09-18T05:12:37.757 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-18 05:07:17.357039974 +0000 2024-09-18T05:12:37.757 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-18T05:12:37.757 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T05:12:37.814 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-18T05:12:37.814 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-18T05:12:37.814 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000438897 s, 1.2 MB/s 2024-09-18T05:12:37.815 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T05:12:37.865 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-09-18T05:12:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T05:12:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T05:12:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-18T05:12:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T05:12:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-18 05:07:18.089033436 +0000 2024-09-18T05:12:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-18 05:07:17.861035473 +0000 2024-09-18T05:12:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-18 05:07:17.861035473 +0000 2024-09-18T05:12:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-18T05:12:37.913 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T05:12:37.966 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-18T05:12:37.966 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-18T05:12:37.967 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.00034362 s, 1.5 MB/s 2024-09-18T05:12:37.968 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T05:12:38.023 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-09-18T05:12:38.073 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T05:12:38.074 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T05:12:38.074 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-18T05:12:38.074 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T05:12:38.074 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-18 05:07:18.545029364 +0000 2024-09-18T05:12:38.074 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-18 05:07:18.321031363 +0000 2024-09-18T05:12:38.075 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-18 05:07:18.321031363 +0000 2024-09-18T05:12:38.075 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-18T05:12:38.075 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T05:12:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-18T05:12:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-18T05:12:38.128 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000359727 s, 1.4 MB/s 2024-09-18T05:12:38.129 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T05:12:38.178 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:38.178 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-18T05:12:38.178 INFO:tasks.ceph:Generating config... 2024-09-18T05:12:38.180 INFO:tasks.ceph:[client] rbd qos iops burst = 100 2024-09-18T05:12:38.180 INFO:tasks.ceph:[client] rbd qos iops limit = 50 2024-09-18T05:12:38.180 INFO:tasks.ceph:[client] rbd qos schedule tick min = 100 2024-09-18T05:12:38.180 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-18T05:12:38.180 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-18T05:12:38.180 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-18T05:12:38.180 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-18T05:12:38.180 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-18T05:12:38.180 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-18T05:12:38.180 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-18T05:12:38.180 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-18T05:12:38.181 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-18T05:12:38.182 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-18T05:12:38.182 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-18T05:12:38.182 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-18T05:12:38.182 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-18T05:12:38.182 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-18T05:12:38.182 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-18T05:12:38.182 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-18T05:12:38.182 INFO:tasks.ceph:Setting up mon.a... 2024-09-18T05:12:38.183 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-18T05:12:38.219 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2024-09-18T05:12:38.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-18T05:12:38.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T05:12:38.358 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.c', '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]'), ('mon.b', '172.21.15.86')] 2024-09-18T05:12:38.358 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.86', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-18T05:12:38.359 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:38.359 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T05:12:38.405 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --addv c '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]' --add b 172.21.15.86 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:38.492 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:38.492 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid 04ac0d2c-34bd-46ad-a307-a4eb23236eb4 2024-09-18T05:12:38.492 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = pacific 2024-09-18T05:12:38.492 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2024-09-18T05:12:38.492 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 04ac0d2c-34bd-46ad-a307-a4eb23236eb4 2024-09-18T05:12:38.492 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2024-09-18T05:12:38.489160+0000 2024-09-18T05:12:38.493 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-18T05:12:38.489160+0000 2024-09-18T05:12:38.493 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 16 (pacific) 2024-09-18T05:12:38.493 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2024-09-18T05:12:38.493 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-18T05:12:38.493 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-18T05:12:38.493 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] mon.c 2024-09-18T05:12:38.493 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-18T05:12:38.495 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T05:12:38.500 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 04ac0d2c-34bd-46ad-a307-a4eb23236eb4... 2024-09-18T05:12:38.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T05:12:38.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T05:12:38.573 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-18T05:12:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-18T05:12:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-18T05:12:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-18T05:12:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-18T05:12:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T05:12:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T05:12:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-18T05:12:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T05:12:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-18T05:12:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.86" 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: mon client directed command retry = 5 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on pool no app = False 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: ms inject socket failures = 5000 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 04ac0d2c-34bd-46ad-a307-a4eb23236eb4 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-18T05:12:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-18T05:12:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-18T05:12:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore compression algorithm = snappy 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore compression mode = aggressive 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 1/20 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 1/20 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 4/10 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: osd blocked scrub grace period = 3600 2024-09-18T05:12:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: osd max markdown count = 1000 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: osd shutdown pgref assert = True 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.581 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T05:12:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T05:12:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T05:12:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: rbd qos iops burst = 100 2024-09-18T05:12:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: rbd qos iops limit = 50 2024-09-18T05:12:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: rbd qos schedule tick min = 100 2024-09-18T05:12:38.584 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-18T05:12:38.584 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-09-18T05:12:38.584 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-09-18T05:12:38.585 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-18T05:12:38.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-18T05:12:38.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-18T05:12:38.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-18T05:12:38.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-18T05:12:38.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-18T05:12:38.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T05:12:38.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T05:12:38.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-18T05:12:38.588 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.588 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T05:12:38.588 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.86" 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on pool no app = False 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 5000 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 04ac0d2c-34bd-46ad-a307-a4eb23236eb4 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.589 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-18T05:12:38.591 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore compression algorithm = snappy 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore compression mode = aggressive 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 1/20 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 1/20 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 4/10 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: osd blocked scrub grace period = 3600 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: osd max markdown count = 1000 2024-09-18T05:12:38.592 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: osd shutdown pgref assert = True 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.593 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T05:12:38.594 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-18T05:12:38.595 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T05:12:38.596 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T05:12:38.596 INFO:teuthology.orchestra.run.smithi086.stdout: rbd qos iops burst = 100 2024-09-18T05:12:38.596 INFO:teuthology.orchestra.run.smithi086.stdout: rbd qos iops limit = 50 2024-09-18T05:12:38.596 INFO:teuthology.orchestra.run.smithi086.stdout: rbd qos schedule tick min = 100 2024-09-18T05:12:38.596 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-18T05:12:38.596 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-18T05:12:38.596 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-18T05:12:38.597 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-18T05:12:38.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-18T05:12:38.683 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-18T05:12:38.683 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:38.683 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-18T05:12:38.688 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:38.688 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-18T05:12:38.736 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:12:38.736 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:38.736 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T05:12:38.736 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T05:12:38.800 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:12:38.800 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:38.848 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:12:38.848 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:12:38.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T05:12:38.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T05:12:38.871 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:12:38.872 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:38.925 INFO:tasks.ceph:Setting up mon nodes... 2024-09-18T05:12:38.925 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-18T05:12:38.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-18T05:12:38.969 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-18T05:12:38.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T05:12:39.015 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T05:12:39.024 INFO:tasks.ceph:Setting up mds nodes... 2024-09-18T05:12:39.024 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-18T05:12:39.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T05:12:39.058 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-18T05:12:39.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-18T05:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-18T05:12:39.116 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-18T05:12:39.116 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-18T05:12:39.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-18T05:12:39.128 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:39.129 INFO:tasks.ceph:role: osd.0 2024-09-18T05:12:39.129 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:12:39.129 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T05:12:39.183 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T05:12:39.207 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-18T05:12:39.209 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-18T05:12:39.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-18T05:12:39.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-18T05:12:39.321 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T05:12:39.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:12:39.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-18T05:12:39.376 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:39.376 INFO:tasks.ceph:role: osd.1 2024-09-18T05:12:39.376 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:12:39.376 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T05:12:39.432 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T05:12:39.432 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T05:12:39.432 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T05:12:39.432 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T05:12:39.433 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T05:12:39.433 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-18T05:12:39.433 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T05:12:39.433 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T05:12:39.433 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T05:12:39.433 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T05:12:39.456 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-18T05:12:39.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-18T05:12:39.458 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-18T05:12:39.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-18T05:12:39.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:12:39.569 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T05:12:39.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-18T05:12:39.624 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:39.624 INFO:tasks.ceph:role: osd.2 2024-09-18T05:12:39.624 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:12:39.624 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T05:12:39.680 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T05:12:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T05:12:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T05:12:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T05:12:39.681 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T05:12:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-18T05:12:39.681 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T05:12:39.681 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T05:12:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T05:12:39.681 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T05:12:39.704 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-18T05:12:39.705 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-18T05:12:39.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-18T05:12:39.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-18T05:12:39.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:12:39.821 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T05:12:39.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-18T05:12:39.878 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:39.878 INFO:tasks.ceph:role: osd.3 2024-09-18T05:12:39.878 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:12:39.878 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-18T05:12:39.931 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T05:12:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T05:12:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T05:12:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T05:12:39.931 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T05:12:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-18T05:12:39.931 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T05:12:39.931 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T05:12:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T05:12:39.932 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T05:12:39.955 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-18T05:12:39.957 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-18T05:12:39.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-18T05:12:40.018 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-18T05:12:40.069 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T05:12:40.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:12:40.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:40.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:40.191+0000 7f00b30f57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-18T05:12:40.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:40.191+0000 7f00b30f57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-18T05:12:40.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:40.191+0000 7f00b30f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-18T05:12:40.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:40.191+0000 7f00b30f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-18T05:12:40.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:40.191+0000 7f00b30f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-18T05:12:40.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:40.191+0000 7f00b30f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-18T05:12:43.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T05:12:43.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:43.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:43.255+0000 7fd9e06247c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-18T05:12:43.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:43.255+0000 7fd9e06247c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-18T05:12:43.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:43.255+0000 7fd9e06247c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-18T05:12:43.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:43.255+0000 7fd9e06247c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-18T05:12:43.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:43.255+0000 7fd9e06247c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-18T05:12:43.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:43.259+0000 7fd9e06247c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-18T05:12:46.230 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T05:12:46.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:46.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:46.367+0000 7f7e1ba917c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-18T05:12:46.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:46.367+0000 7f7e1ba917c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-18T05:12:46.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:46.367+0000 7f7e1ba917c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-18T05:12:46.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:46.367+0000 7f7e1ba917c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-18T05:12:46.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:46.367+0000 7f7e1ba917c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-18T05:12:46.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:46.367+0000 7f7e1ba917c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-18T05:12:49.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T05:12:49.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:49.475+0000 7f63bbf2e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-18T05:12:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:49.475+0000 7f63bbf2e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-18T05:12:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:49.475+0000 7f63bbf2e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-18T05:12:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:49.475+0000 7f63bbf2e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-18T05:12:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:49.475+0000 7f63bbf2e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-18T05:12:49.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-18T05:12:49.475+0000 7f63bbf2e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-18T05:12:52.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T05:12:52.493 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-18T05:12:52.508 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:52.508 INFO:tasks.ceph:role: osd.4 2024-09-18T05:12:52.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:12:52.508 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T05:12:52.571 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T05:12:52.572 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T05:12:52.572 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T05:12:52.572 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T05:12:52.572 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T05:12:52.572 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-18T05:12:52.572 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T05:12:52.572 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T05:12:52.572 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T05:12:52.572 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T05:12:53.024 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-18T05:12:53.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-18T05:12:53.026 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-18T05:12:53.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-18T05:12:53.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:12:53.131 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T05:12:53.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-18T05:12:53.189 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:53.190 INFO:tasks.ceph:role: osd.5 2024-09-18T05:12:53.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:12:53.190 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T05:12:53.253 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T05:12:53.711 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-18T05:12:53.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-18T05:12:53.713 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-18T05:12:53.865 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-18T05:12:53.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:12:53.877 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T05:12:53.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-18T05:12:53.931 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:53.931 INFO:tasks.ceph:role: osd.6 2024-09-18T05:12:53.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:12:53.931 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T05:12:53.996 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T05:12:53.997 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T05:12:53.997 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T05:12:53.997 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T05:12:53.997 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T05:12:53.997 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-18T05:12:53.997 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T05:12:53.997 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T05:12:53.997 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T05:12:53.997 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T05:12:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-18T05:12:54.471 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-18T05:12:54.472 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-18T05:12:54.604 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-18T05:12:54.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:12:54.616 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T05:12:54.617 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-18T05:12:54.671 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T05:12:54.671 INFO:tasks.ceph:role: osd.7 2024-09-18T05:12:54.671 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:12:54.671 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-18T05:12:54.738 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T05:12:54.739 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T05:12:54.739 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T05:12:54.739 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T05:12:54.739 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T05:12:54.739 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-18T05:12:54.739 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T05:12:54.740 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T05:12:54.740 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T05:12:54.740 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T05:12:55.162 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-18T05:12:55.163 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-18T05:12:55.164 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-18T05:12:55.253 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-18T05:12:55.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:12:55.265 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T05:12:55.266 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:55.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:55.363+0000 7fa9f94ca7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-18T05:12:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:55.367+0000 7fa9f94ca7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-18T05:12:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:55.367+0000 7fa9f94ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-18T05:12:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:55.367+0000 7fa9f94ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-18T05:12:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:55.367+0000 7fa9f94ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-18T05:12:55.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:55.367+0000 7fa9f94ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-18T05:12:58.352 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T05:12:58.365 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:12:58.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:58.443+0000 7f74aad4b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-18T05:12:58.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:58.443+0000 7f74aad4b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-18T05:12:58.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:58.443+0000 7f74aad4b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-18T05:12:58.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:58.443+0000 7f74aad4b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-18T05:12:58.450 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:58.443+0000 7f74aad4b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-18T05:12:58.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:12:58.443+0000 7f74aad4b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-18T05:13:01.419 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T05:13:01.477 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:13:01.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:01.551+0000 7f62dd1887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-18T05:13:01.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:01.551+0000 7f62dd1887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-18T05:13:01.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:01.551+0000 7f62dd1887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-18T05:13:01.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:01.551+0000 7f62dd1887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-18T05:13:01.557 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:01.551+0000 7f62dd1887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-18T05:13:01.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:01.551+0000 7f62dd1887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-18T05:13:04.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-18T05:13:04.576 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:13:04.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:04.651+0000 7fee138347c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-18T05:13:04.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:04.651+0000 7fee138347c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-18T05:13:04.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:04.651+0000 7fee138347c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-18T05:13:04.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:04.651+0000 7fee138347c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-18T05:13:04.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:04.651+0000 7fee138347c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-18T05:13:04.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-18T05:13:04.655+0000 7fee138347c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-18T05:13:07.626 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-18T05:13:07.680 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-18T05:13:07.680 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:07.681 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-18T05:13:07.695 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:07.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-18T05:13:07.751 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:07.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-18T05:13:07.807 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:07.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-18T05:13:07.863 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:07.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-18T05:13:07.919 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:07.920 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-18T05:13:07.934 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:07.934 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-18T05:13:07.987 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:07.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-18T05:13:08.043 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:08.043 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-18T05:13:08.098 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:08.098 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-18T05:13:08.150 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:08.150 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-18T05:13:08.157 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:08.157 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-18T05:13:08.196 INFO:tasks.ceph:Adding keys to all mons... 2024-09-18T05:13:08.196 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T05:13:08.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T05:13:08.242 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2024-09-18T05:13:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBGYepmrOOfORAAKP7SUQlqhNU3tjQmEDsUiw== 2024-09-18T05:13:08.242 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2024-09-18T05:13:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBIYepmgsSOCxAAjuagx8cNSWRCMlhtmqBWBw== 2024-09-18T05:13:08.242 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2024-09-18T05:13:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBLYepm+LB8DxAAnN9wVxf2qA+4rGwPoM9V5g== 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBOYepmnz8KFhAAxDyQTnPdelWOOss9WuPYdA== 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBRYepmiJGQHBAAEnERSItQZFDhywSJU/Jl+A== 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBHYepmgezqABAAm7/t2UHKikrciejk8QnQBA== 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.4] 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBXYepmgmAdFhAAlWoSXxJ4R5JIW1FdGp6t0g== 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.5] 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBaYepmUSDJGhAAw7cjSZbZQGPCjGyJYtSnqQ== 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.6] 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBdYepmaVYvIRAAzQlU1tv/2JazkZertXNOLA== 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.7] 2024-09-18T05:13:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBgYepmLlc6JxAAijKW2CMWPNJDw1HsUXZAmA== 2024-09-18T05:13:08.244 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-18T05:13:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBHYepmQr1UAxAAWp+/mGpLFx7ebmvvl3+rzw== 2024-09-18T05:13:08.244 INFO:teuthology.orchestra.run.smithi017.stdout:[client.1] 2024-09-18T05:13:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBHYepmm7k6BhAAn+8hcDha/y21D6MUgC2gcg== 2024-09-18T05:13:08.249 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2024-09-18T05:13:08.249 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBGYepmrOOfORAAKP7SUQlqhNU3tjQmEDsUiw== 2024-09-18T05:13:08.250 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2024-09-18T05:13:08.250 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBIYepmgsSOCxAAjuagx8cNSWRCMlhtmqBWBw== 2024-09-18T05:13:08.250 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2024-09-18T05:13:08.250 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBLYepm+LB8DxAAnN9wVxf2qA+4rGwPoM9V5g== 2024-09-18T05:13:08.250 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2024-09-18T05:13:08.250 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBOYepmnz8KFhAAxDyQTnPdelWOOss9WuPYdA== 2024-09-18T05:13:08.251 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2024-09-18T05:13:08.251 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBRYepmiJGQHBAAEnERSItQZFDhywSJU/Jl+A== 2024-09-18T05:13:08.251 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBHYepmgezqABAAm7/t2UHKikrciejk8QnQBA== 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBXYepmgmAdFhAAlWoSXxJ4R5JIW1FdGp6t0g== 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBaYepmUSDJGhAAw7cjSZbZQGPCjGyJYtSnqQ== 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBdYepmaVYvIRAAzQlU1tv/2JazkZertXNOLA== 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBgYepmLlc6JxAAijKW2CMWPNJDw1HsUXZAmA== 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBHYepmQr1UAxAAWp+/mGpLFx7ebmvvl3+rzw== 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout:[client.1] 2024-09-18T05:13:08.252 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBHYepmm7k6BhAAn+8hcDha/y21D6MUgC2gcg== 2024-09-18T05:13:08.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T05:13:08.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T05:13:08.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.377 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.544 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T05:13:08.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T05:13:08.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.893 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.971 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:08.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:09.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:09.064 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T05:13:09.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T05:13:09.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T05:13:09.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T05:13:09.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T05:13:09.285 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-18T05:13:09.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-18T05:13:09.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T05:13:09.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-18T05:13:09.405 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-18T05:13:09.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T05:13:09.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-18T05:13:09.567 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-18T05:13:09.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T05:13:09.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-18T05:13:09.697 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:13:09.706 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T05:13:09.761 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-18T05:13:09.761 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-18T05:13:09.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-18T05:13:09.769 INFO:tasks.ceph.mon.a:Started 2024-09-18T05:13:09.769 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-18T05:13:09.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-18T05:13:09.790 INFO:tasks.ceph.mon.c:Started 2024-09-18T05:13:09.791 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-18T05:13:09.791 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-18T05:13:09.814 INFO:tasks.ceph.mon.b:Started 2024-09-18T05:13:09.814 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-18T05:13:09.814 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-18T05:13:09.814 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-18T05:13:09.827 INFO:tasks.ceph.mgr.y:Started 2024-09-18T05:13:09.828 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-18T05:13:09.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-18T05:13:09.836 INFO:tasks.ceph.mgr.x:Started 2024-09-18T05:13:09.837 INFO:tasks.ceph:Setting crush tunables to default 2024-09-18T05:13:09.837 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2024-09-18T05:13:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-18T05:13:16.071 INFO:tasks.ceph:check_enable_crimson: False 2024-09-18T05:13:16.071 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-18T05:13:16.071 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:16.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-18T05:13:16.083 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:16.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-18T05:13:16.134 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:16.127+0000 7fc87d431180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T05:13:16.142 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:16.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-18T05:13:16.165 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:16.159+0000 7f9febf6d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T05:13:16.176 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-18T05:13:16.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-18T05:13:16.236 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:16.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-18T05:13:16.249 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:16.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-18T05:13:16.302 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:16.302 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-18T05:13:16.355 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-18T05:13:16.355 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-18T05:13:16.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new a2a580f7-2bbc-46c3-b6b5-5a9e93539d27 0 2024-09-18T05:13:16.626 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:16.619+0000 7fc87d431180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T05:13:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:0 2024-09-18T05:13:16.717 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:16.711+0000 7f9febf6d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T05:13:16.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 260da429-e6eb-446b-95a0-dcf4581bb584 1 2024-09-18T05:13:16.811 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:16.807+0000 7fc87d431180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T05:13:16.925 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-18T05:13:16.928 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:16.923+0000 7f9febf6d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T05:13:16.941 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 0cf5d53a-552d-4775-8437-86af3465b1bc 2 2024-09-18T05:13:17.143 INFO:teuthology.orchestra.run.smithi086.stdout:2 2024-09-18T05:13:17.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 73bc18b6-4972-4164-a294-b6372bcf9f9d 3 2024-09-18T05:13:17.353 INFO:teuthology.orchestra.run.smithi086.stdout:3 2024-09-18T05:13:17.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 536c8ef2-eca6-44b4-a70c-06f191eb5ff1 4 2024-09-18T05:13:17.375 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:17.367+0000 7fc87d431180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T05:13:17.430 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:17.423+0000 7fc87d431180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T05:13:17.484 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:17.479+0000 7fc87d431180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T05:13:17.518 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:17.511+0000 7f9febf6d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T05:13:17.564 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:17.559+0000 7fc87d431180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T05:13:17.571 INFO:teuthology.orchestra.run.smithi086.stdout:4 2024-09-18T05:13:17.573 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:17.567+0000 7f9febf6d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T05:13:17.587 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 4341bba4-2913-4352-89d4-36fa18ee39cb 5 2024-09-18T05:13:17.619 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:17.611+0000 7fc87d431180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T05:13:17.629 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:17.623+0000 7f9febf6d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T05:13:17.697 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:17.691+0000 7fc87d431180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T05:13:17.709 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:17.703+0000 7f9febf6d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T05:13:17.751 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:17.743+0000 7fc87d431180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T05:13:17.763 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:17.759+0000 7f9febf6d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T05:13:17.812 INFO:teuthology.orchestra.run.smithi086.stdout:5 2024-09-18T05:13:17.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new e47d4aad-9c4b-43a9-9b32-2db463ec2a20 6 2024-09-18T05:13:17.845 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:17.839+0000 7f9febf6d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T05:13:17.898 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:17.891+0000 7f9febf6d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T05:13:17.905 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:17.899+0000 7fc87d431180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T05:13:17.967 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:17.959+0000 7fc87d431180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T05:13:18.022 INFO:teuthology.orchestra.run.smithi086.stdout:6 2024-09-18T05:13:18.038 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 686d275c-e592-44c1-87f9-ac9718f3a112 7 2024-09-18T05:13:18.056 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:18.051+0000 7f9febf6d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T05:13:18.118 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:18.111+0000 7f9febf6d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T05:13:18.229 INFO:teuthology.orchestra.run.smithi086.stdout:7 2024-09-18T05:13:18.249 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-18T05:13:18.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-18T05:13:18.252 INFO:tasks.ceph.osd.0:Started 2024-09-18T05:13:18.252 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-18T05:13:18.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-18T05:13:18.255 INFO:tasks.ceph.osd.1:Started 2024-09-18T05:13:18.255 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T05:13:18.255 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-18T05:13:18.258 INFO:tasks.ceph.osd.2:Started 2024-09-18T05:13:18.258 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-18T05:13:18.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-18T05:13:18.260 INFO:tasks.ceph.osd.3:Started 2024-09-18T05:13:18.261 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-18T05:13:18.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-18T05:13:18.262 INFO:tasks.ceph.osd.4:Started 2024-09-18T05:13:18.263 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-18T05:13:18.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-18T05:13:18.265 INFO:tasks.ceph.osd.5:Started 2024-09-18T05:13:18.265 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-18T05:13:18.265 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-18T05:13:18.267 INFO:tasks.ceph.osd.6:Started 2024-09-18T05:13:18.267 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-18T05:13:18.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-18T05:13:18.269 INFO:tasks.ceph.osd.7:Started 2024-09-18T05:13:18.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T05:13:18.516 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:18.516 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"fsid":"04ac0d2c-34bd-46ad-a307-a4eb23236eb4","created":"2024-09-18T05:13:15.193498+0000","modified":"2024-09-18T05:13:18.221936+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T05:13:18.221936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2a580f7-2bbc-46c3-b6b5-5a9e93539d27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"260da429-e6eb-446b-95a0-dcf4581bb584","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0cf5d53a-552d-4775-8437-86af3465b1bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"73bc18b6-4972-4164-a294-b6372bcf9f9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"536c8ef2-eca6-44b4-a70c-06f191eb5ff1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4341bba4-2913-4352-89d4-36fa18ee39cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e47d4aad-9c4b-43a9-9b32-2db463ec2a20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"686d275c-e592-44c1-87f9-ac9718f3a112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T05:13:18.530 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-18T05:13:18.531 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-18T05:13:18.618 INFO:tasks.ceph.mgr.x.smithi086.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-18T05:13:18.618 INFO:tasks.ceph.mgr.x.smithi086.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-18T05:13:18.618 INFO:tasks.ceph.mgr.x.smithi086.stderr: from numpy import show_config as show_numpy_config 2024-09-18T05:13:18.672 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:18.667+0000 7fc87d431180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-18T05:13:18.726 INFO:tasks.ceph.mgr.y.smithi017.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-18T05:13:18.726 INFO:tasks.ceph.mgr.y.smithi017.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-18T05:13:18.726 INFO:tasks.ceph.mgr.y.smithi017.stderr: from numpy import show_config as show_numpy_config 2024-09-18T05:13:18.794 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:18.787+0000 7f9febf6d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-18T05:13:18.839 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:18.831+0000 7fc87d431180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T05:13:18.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:18.863+0000 7f4a8b7f77c0 -1 Falling back to public interface 2024-09-18T05:13:18.884 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:18.879+0000 7f7581ec97c0 -1 Falling back to public interface 2024-09-18T05:13:18.892 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:18.887+0000 7fee377bf7c0 -1 Falling back to public interface 2024-09-18T05:13:18.900 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:18.895+0000 7f9381dbd7c0 -1 Falling back to public interface 2024-09-18T05:13:18.924 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:18.919+0000 7faabc2a27c0 -1 Falling back to public interface 2024-09-18T05:13:18.925 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:18.919+0000 7ff5367497c0 -1 Falling back to public interface 2024-09-18T05:13:18.925 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:18.919+0000 7fa104ce47c0 -1 Falling back to public interface 2024-09-18T05:13:18.925 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:18.919+0000 7ff53570a640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6806/0: (98) Address already in use 2024-09-18T05:13:18.940 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:18.935+0000 7f378d40b7c0 -1 Falling back to public interface 2024-09-18T05:13:18.982 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:18.975+0000 7f9febf6d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T05:13:19.009 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:19.003+0000 7fc87d431180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T05:13:19.077 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:19.071+0000 7fc87d431180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T05:13:19.141 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:19.135+0000 7f9febf6d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T05:13:19.206 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:19.199+0000 7f9febf6d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T05:13:19.225 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:19.219+0000 7fc87d431180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T05:13:19.337 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T05:13:19.346 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:19.339+0000 7f9febf6d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T05:13:19.519 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-18T05:13:19.520 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":10,"fsid":"04ac0d2c-34bd-46ad-a307-a4eb23236eb4","created":"2024-09-18T05:13:15.193498+0000","modified":"2024-09-18T05:13:18.221936+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T05:13:18.221936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2a580f7-2bbc-46c3-b6b5-5a9e93539d27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"260da429-e6eb-446b-95a0-dcf4581bb584","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0cf5d53a-552d-4775-8437-86af3465b1bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"73bc18b6-4972-4164-a294-b6372bcf9f9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"536c8ef2-eca6-44b4-a70c-06f191eb5ff1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4341bba4-2913-4352-89d4-36fa18ee39cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e47d4aad-9c4b-43a9-9b32-2db463ec2a20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"686d275c-e592-44c1-87f9-ac9718f3a112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T05:13:19.534 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-18T05:13:19.843 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:19.835+0000 7fc87d431180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T05:13:19.918 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:19.911+0000 7fc87d431180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T05:13:19.985 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:19.979+0000 7f9febf6d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T05:13:20.063 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:20.059+0000 7f9febf6d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T05:13:20.097 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:20.091+0000 7fc87d431180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T05:13:20.170 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:20.163+0000 7fc87d431180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T05:13:20.252 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:20.247+0000 7f9febf6d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T05:13:20.328 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:20.323+0000 7f9febf6d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T05:13:20.457 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:20.451+0000 7fc87d431180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T05:13:20.519 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:20.511+0000 7fc87d431180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T05:13:20.635 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:20.631+0000 7f9febf6d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T05:13:20.700 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-18T05:13:20.695+0000 7f9febf6d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T05:13:21.568 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:21.563+0000 7fc8249e2640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-18T05:13:21.568 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-18T05:13:21.563+0000 7fc8249e2640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-18T05:13:22.728 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:22.723+0000 7fa104ce47c0 -1 osd.5 0 log_to_monitors true 2024-09-18T05:13:22.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:22.723+0000 7f4a8b7f77c0 -1 osd.0 0 log_to_monitors true 2024-09-18T05:13:22.752 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:22.747+0000 7f7581ec97c0 -1 osd.1 0 log_to_monitors true 2024-09-18T05:13:22.766 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:22.759+0000 7f9381dbd7c0 -1 osd.3 0 log_to_monitors true 2024-09-18T05:13:22.772 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:22.767+0000 7fee377bf7c0 -1 osd.2 0 log_to_monitors true 2024-09-18T05:13:22.864 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:22.859+0000 7faabc2a27c0 -1 osd.4 0 log_to_monitors true 2024-09-18T05:13:22.877 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:22.871+0000 7ff5367497c0 -1 osd.6 0 log_to_monitors true 2024-09-18T05:13:22.877 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:22.871+0000 7f378d40b7c0 -1 osd.7 0 log_to_monitors true 2024-09-18T05:13:25.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:25.786+0000 7f4a8779c640 -1 osd.0 0 waiting for initial osdmap 2024-09-18T05:13:25.805 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:25.798+0000 7fee33764640 -1 osd.2 0 waiting for initial osdmap 2024-09-18T05:13:25.811 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:25.807+0000 7ff5326ee640 -1 osd.6 0 waiting for initial osdmap 2024-09-18T05:13:25.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:25.810+0000 7f4a7f5cf640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:13:25.836 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:25.830+0000 7fee2b597640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:13:25.837 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:25.830+0000 7f937dd62640 -1 osd.3 0 waiting for initial osdmap 2024-09-18T05:13:25.842 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:25.835+0000 7ff52a521640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:13:25.845 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:25.839+0000 7f37893b0640 -1 osd.7 0 waiting for initial osdmap 2024-09-18T05:13:25.869 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:25.863+0000 7fa100c89640 -1 osd.5 0 waiting for initial osdmap 2024-09-18T05:13:25.870 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:25.862+0000 7f9375b95640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:13:25.876 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:25.871+0000 7faab8247640 -1 osd.4 0 waiting for initial osdmap 2024-09-18T05:13:25.883 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:25.879+0000 7f37811e3640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:13:25.894 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:25.886+0000 7f757de6e640 -1 osd.1 0 waiting for initial osdmap 2024-09-18T05:13:25.903 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:25.899+0000 7fa0f8abc640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:13:25.907 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:25.903+0000 7faab007a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:13:25.916 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:25.910+0000 7f7575ca1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:13:26.342 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T05:13:26.637 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-18T05:13:26.637 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":12,"fsid":"04ac0d2c-34bd-46ad-a307-a4eb23236eb4","created":"2024-09-18T05:13:15.193498+0000","modified":"2024-09-18T05:13:24.562605+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T05:13:18.221936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2a580f7-2bbc-46c3-b6b5-5a9e93539d27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"260da429-e6eb-446b-95a0-dcf4581bb584","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0cf5d53a-552d-4775-8437-86af3465b1bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"73bc18b6-4972-4164-a294-b6372bcf9f9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"536c8ef2-eca6-44b4-a70c-06f191eb5ff1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4341bba4-2913-4352-89d4-36fa18ee39cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e47d4aad-9c4b-43a9-9b32-2db463ec2a20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"686d275c-e592-44c1-87f9-ac9718f3a112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T05:13:26.654 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-18T05:13:33.462 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T05:13:33.762 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-18T05:13:33.762 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":17,"fsid":"04ac0d2c-34bd-46ad-a307-a4eb23236eb4","created":"2024-09-18T05:13:15.193498+0000","modified":"2024-09-18T05:13:30.833630+0000","last_up_change":"2024-09-18T05:13:26.810974+0000","last_in_change":"2024-09-18T05:13:18.221936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T05:13:28.629114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2a580f7-2bbc-46c3-b6b5-5a9e93539d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6801","nonce":1558450642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6803","nonce":1558450642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6807","nonce":1558450642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6805","nonce":1558450642}]},"public_addr":"172.21.15.17:6801/1558450642","cluster_addr":"172.21.15.17:6803/1558450642","heartbeat_back_addr":"172.21.15.17:6807/1558450642","heartbeat_front_addr":"172.21.15.17:6805/1558450642","state":["exists","up"]},{"osd":1,"uuid":"260da429-e6eb-446b-95a0-dcf4581bb584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6809","nonce":3444575073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6811","nonce":3444575073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6815","nonce":3444575073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6813","nonce":3444575073}]},"public_addr":"172.21.15.17:6809/3444575073","cluster_addr":"172.21.15.17:6811/3444575073","heartbeat_back_addr":"172.21.15.17:6815/3444575073","heartbeat_front_addr":"172.21.15.17:6813/3444575073","state":["exists","up"]},{"osd":2,"uuid":"0cf5d53a-552d-4775-8437-86af3465b1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6817","nonce":467806624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6819","nonce":467806624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6823","nonce":467806624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6821","nonce":467806624}]},"public_addr":"172.21.15.17:6817/467806624","cluster_addr":"172.21.15.17:6819/467806624","heartbeat_back_addr":"172.21.15.17:6823/467806624","heartbeat_front_addr":"172.21.15.17:6821/467806624","state":["exists","up"]},{"osd":3,"uuid":"73bc18b6-4972-4164-a294-b6372bcf9f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6825","nonce":3763834627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6827","nonce":3763834627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6831","nonce":3763834627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6829","nonce":3763834627}]},"public_addr":"172.21.15.17:6825/3763834627","cluster_addr":"172.21.15.17:6827/3763834627","heartbeat_back_addr":"172.21.15.17:6831/3763834627","heartbeat_front_addr":"172.21.15.17:6829/3763834627","state":["exists","up"]},{"osd":4,"uuid":"536c8ef2-eca6-44b4-a70c-06f191eb5ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6802","nonce":1703780253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6806","nonce":1703780253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6819","nonce":1703780253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6812","nonce":1703780253}]},"public_addr":"172.21.15.86:6802/1703780253","cluster_addr":"172.21.15.86:6806/1703780253","heartbeat_back_addr":"172.21.15.86:6819/1703780253","heartbeat_front_addr":"172.21.15.86:6812/1703780253","state":["exists","up"]},{"osd":5,"uuid":"4341bba4-2913-4352-89d4-36fa18ee39cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6811","nonce":3348904742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6816","nonce":3348904742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6823","nonce":3348904742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6820","nonce":3348904742}]},"public_addr":"172.21.15.86:6811/3348904742","cluster_addr":"172.21.15.86:6816/3348904742","heartbeat_back_addr":"172.21.15.86:6823/3348904742","heartbeat_front_addr":"172.21.15.86:6820/3348904742","state":["exists","up"]},{"osd":6,"uuid":"e47d4aad-9c4b-43a9-9b32-2db463ec2a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6801","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6803","nonce":74856761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6807","nonce":74856761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6821","nonce":74856761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6814","nonce":74856761}]},"public_addr":"172.21.15.86:6803/74856761","cluster_addr":"172.21.15.86:6807/74856761","heartbeat_back_addr":"172.21.15.86:6821/74856761","heartbeat_front_addr":"172.21.15.86:6814/74856761","state":["exists","up"]},{"osd":7,"uuid":"686d275c-e592-44c1-87f9-ac9718f3a112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6825","nonce":1345159853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6827","nonce":1345159853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6831","nonce":1345159853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6829","nonce":1345159853}]},"public_addr":"172.21.15.86:6825/1345159853","cluster_addr":"172.21.15.86:6827/1345159853","heartbeat_back_addr":"172.21.15.86:6831/1345159853","heartbeat_front_addr":"172.21.15.86:6829/1345159853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.758535+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.800715+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.783374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.779519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.893837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.776852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.919808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.883599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T05:13:33.778 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-18T05:13:33.778 INFO:tasks.ceph:Creating RBD pool 2024-09-18T05:13:33.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-18T05:13:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'rbd' created 2024-09-18T05:13:34.891 DEBUG:teuthology.orchestra.run.smithi017:> rbd --cluster ceph pool init rbd 2024-09-18T05:13:37.918 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-18T05:13:37.918 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T05:13:37.919 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-18T05:13:37.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-18T05:13:37.919 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-18T05:13:38.271 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:38.289 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":65784938},{"type":"v1","addr":"172.21.15.86:6833","nonce":65784938}]},"active_addr":"172.21.15.86:6833/65784938","active_change":"2024-09-18T05:13:20.539162+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3708175512}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":1704763959}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":681300677}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":4101832114}]}]} 2024-09-18T05:13:38.293 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-18T05:13:38.294 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T05:13:38.294 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T05:13:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:38.590 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"04ac0d2c-34bd-46ad-a307-a4eb23236eb4","created":"2024-09-18T05:13:15.193498+0000","modified":"2024-09-18T05:13:37.875328+0000","last_up_change":"2024-09-18T05:13:26.810974+0000","last_in_change":"2024-09-18T05:13:18.221936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T05:13:28.629114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T05:13:34.103981+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2a580f7-2bbc-46c3-b6b5-5a9e93539d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6801","nonce":1558450642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6803","nonce":1558450642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6807","nonce":1558450642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6805","nonce":1558450642}]},"public_addr":"172.21.15.17:6801/1558450642","cluster_addr":"172.21.15.17:6803/1558450642","heartbeat_back_addr":"172.21.15.17:6807/1558450642","heartbeat_front_addr":"172.21.15.17:6805/1558450642","state":["exists","up"]},{"osd":1,"uuid":"260da429-e6eb-446b-95a0-dcf4581bb584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6809","nonce":3444575073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6811","nonce":3444575073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6815","nonce":3444575073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6813","nonce":3444575073}]},"public_addr":"172.21.15.17:6809/3444575073","cluster_addr":"172.21.15.17:6811/3444575073","heartbeat_back_addr":"172.21.15.17:6815/3444575073","heartbeat_front_addr":"172.21.15.17:6813/3444575073","state":["exists","up"]},{"osd":2,"uuid":"0cf5d53a-552d-4775-8437-86af3465b1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6817","nonce":467806624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6819","nonce":467806624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6823","nonce":467806624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6821","nonce":467806624}]},"public_addr":"172.21.15.17:6817/467806624","cluster_addr":"172.21.15.17:6819/467806624","heartbeat_back_addr":"172.21.15.17:6823/467806624","heartbeat_front_addr":"172.21.15.17:6821/467806624","state":["exists","up"]},{"osd":3,"uuid":"73bc18b6-4972-4164-a294-b6372bcf9f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6825","nonce":3763834627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6827","nonce":3763834627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6831","nonce":3763834627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6829","nonce":3763834627}]},"public_addr":"172.21.15.17:6825/3763834627","cluster_addr":"172.21.15.17:6827/3763834627","heartbeat_back_addr":"172.21.15.17:6831/3763834627","heartbeat_front_addr":"172.21.15.17:6829/3763834627","state":["exists","up"]},{"osd":4,"uuid":"536c8ef2-eca6-44b4-a70c-06f191eb5ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6802","nonce":1703780253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6806","nonce":1703780253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6819","nonce":1703780253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6812","nonce":1703780253}]},"public_addr":"172.21.15.86:6802/1703780253","cluster_addr":"172.21.15.86:6806/1703780253","heartbeat_back_addr":"172.21.15.86:6819/1703780253","heartbeat_front_addr":"172.21.15.86:6812/1703780253","state":["exists","up"]},{"osd":5,"uuid":"4341bba4-2913-4352-89d4-36fa18ee39cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6811","nonce":3348904742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6816","nonce":3348904742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6823","nonce":3348904742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6820","nonce":3348904742}]},"public_addr":"172.21.15.86:6811/3348904742","cluster_addr":"172.21.15.86:6816/3348904742","heartbeat_back_addr":"172.21.15.86:6823/3348904742","heartbeat_front_addr":"172.21.15.86:6820/3348904742","state":["exists","up"]},{"osd":6,"uuid":"e47d4aad-9c4b-43a9-9b32-2db463ec2a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6801","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6803","nonce":74856761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6807","nonce":74856761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6821","nonce":74856761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6814","nonce":74856761}]},"public_addr":"172.21.15.86:6803/74856761","cluster_addr":"172.21.15.86:6807/74856761","heartbeat_back_addr":"172.21.15.86:6821/74856761","heartbeat_front_addr":"172.21.15.86:6814/74856761","state":["exists","up"]},{"osd":7,"uuid":"686d275c-e592-44c1-87f9-ac9718f3a112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6825","nonce":1345159853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6827","nonce":1345159853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6831","nonce":1345159853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6829","nonce":1345159853}]},"public_addr":"172.21.15.86:6825/1345159853","cluster_addr":"172.21.15.86:6827/1345159853","heartbeat_back_addr":"172.21.15.86:6831/1345159853","heartbeat_front_addr":"172.21.15.86:6829/1345159853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.758535+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.800715+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.783374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.779519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.893837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.776852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.919808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.883599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T05:13:38.607 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T05:13:38.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T05:13:38.886 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:38.886 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"04ac0d2c-34bd-46ad-a307-a4eb23236eb4","created":"2024-09-18T05:13:15.193498+0000","modified":"2024-09-18T05:13:37.875328+0000","last_up_change":"2024-09-18T05:13:26.810974+0000","last_in_change":"2024-09-18T05:13:18.221936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T05:13:28.629114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T05:13:34.103981+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2a580f7-2bbc-46c3-b6b5-5a9e93539d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6801","nonce":1558450642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6803","nonce":1558450642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6807","nonce":1558450642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6805","nonce":1558450642}]},"public_addr":"172.21.15.17:6801/1558450642","cluster_addr":"172.21.15.17:6803/1558450642","heartbeat_back_addr":"172.21.15.17:6807/1558450642","heartbeat_front_addr":"172.21.15.17:6805/1558450642","state":["exists","up"]},{"osd":1,"uuid":"260da429-e6eb-446b-95a0-dcf4581bb584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6809","nonce":3444575073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6811","nonce":3444575073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6815","nonce":3444575073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6813","nonce":3444575073}]},"public_addr":"172.21.15.17:6809/3444575073","cluster_addr":"172.21.15.17:6811/3444575073","heartbeat_back_addr":"172.21.15.17:6815/3444575073","heartbeat_front_addr":"172.21.15.17:6813/3444575073","state":["exists","up"]},{"osd":2,"uuid":"0cf5d53a-552d-4775-8437-86af3465b1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6817","nonce":467806624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6819","nonce":467806624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6823","nonce":467806624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":467806624},{"type":"v1","addr":"172.21.15.17:6821","nonce":467806624}]},"public_addr":"172.21.15.17:6817/467806624","cluster_addr":"172.21.15.17:6819/467806624","heartbeat_back_addr":"172.21.15.17:6823/467806624","heartbeat_front_addr":"172.21.15.17:6821/467806624","state":["exists","up"]},{"osd":3,"uuid":"73bc18b6-4972-4164-a294-b6372bcf9f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6825","nonce":3763834627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6827","nonce":3763834627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6831","nonce":3763834627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6829","nonce":3763834627}]},"public_addr":"172.21.15.17:6825/3763834627","cluster_addr":"172.21.15.17:6827/3763834627","heartbeat_back_addr":"172.21.15.17:6831/3763834627","heartbeat_front_addr":"172.21.15.17:6829/3763834627","state":["exists","up"]},{"osd":4,"uuid":"536c8ef2-eca6-44b4-a70c-06f191eb5ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6802","nonce":1703780253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6806","nonce":1703780253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6819","nonce":1703780253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6812","nonce":1703780253}]},"public_addr":"172.21.15.86:6802/1703780253","cluster_addr":"172.21.15.86:6806/1703780253","heartbeat_back_addr":"172.21.15.86:6819/1703780253","heartbeat_front_addr":"172.21.15.86:6812/1703780253","state":["exists","up"]},{"osd":5,"uuid":"4341bba4-2913-4352-89d4-36fa18ee39cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6811","nonce":3348904742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6816","nonce":3348904742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6823","nonce":3348904742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6820","nonce":3348904742}]},"public_addr":"172.21.15.86:6811/3348904742","cluster_addr":"172.21.15.86:6816/3348904742","heartbeat_back_addr":"172.21.15.86:6823/3348904742","heartbeat_front_addr":"172.21.15.86:6820/3348904742","state":["exists","up"]},{"osd":6,"uuid":"e47d4aad-9c4b-43a9-9b32-2db463ec2a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6801","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6803","nonce":74856761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6807","nonce":74856761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6821","nonce":74856761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":74856761},{"type":"v1","addr":"172.21.15.86:6814","nonce":74856761}]},"public_addr":"172.21.15.86:6803/74856761","cluster_addr":"172.21.15.86:6807/74856761","heartbeat_back_addr":"172.21.15.86:6821/74856761","heartbeat_front_addr":"172.21.15.86:6814/74856761","state":["exists","up"]},{"osd":7,"uuid":"686d275c-e592-44c1-87f9-ac9718f3a112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6825","nonce":1345159853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6827","nonce":1345159853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6831","nonce":1345159853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6829","nonce":1345159853}]},"public_addr":"172.21.15.86:6825/1345159853","cluster_addr":"172.21.15.86:6827/1345159853","heartbeat_back_addr":"172.21.15.86:6831/1345159853","heartbeat_front_addr":"172.21.15.86:6829/1345159853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.758535+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.800715+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.783374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.779519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.893837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.776852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.919808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.883599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T05:13:38.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T05:13:38.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T05:13:38.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T05:13:38.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T05:13:38.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-18T05:13:38.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-18T05:13:38.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-18T05:13:38.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-18T05:13:39.162 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2024-09-18T05:13:39.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T05:13:39.173 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:39.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T05:13:39.177 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2024-09-18T05:13:39.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T05:13:39.178 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-09-18T05:13:39.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T05:13:39.183 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:39.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T05:13:39.185 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:39.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T05:13:39.187 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:39.187 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T05:13:39.192 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2024-09-18T05:13:39.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T05:13:39.662 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-09-18T05:13:39.675 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:39.682 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:39.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-18T05:13:39.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-09-18T05:13:39.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-09-18T05:13:39.723 INFO:teuthology.orchestra.run.smithi017.stdout:55834574851 2024-09-18T05:13:39.724 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:39.736 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-09-18T05:13:39.742 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-09-18T05:13:39.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-09-18T05:13:39.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-09-18T05:13:39.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-09-18T05:13:39.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-09-18T05:13:39.770 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-09-18T05:13:39.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-18T05:13:40.690 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T05:13:40.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T05:13:40.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T05:13:40.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T05:13:40.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T05:13:40.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T05:13:40.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T05:13:40.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T05:13:41.174 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:41.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-18T05:13:41.198 DEBUG:teuthology.parallel:result is None 2024-09-18T05:13:41.232 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2024-09-18T05:13:41.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-18T05:13:41.250 DEBUG:teuthology.parallel:result is None 2024-09-18T05:13:41.269 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2024-09-18T05:13:41.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-18T05:13:41.293 DEBUG:teuthology.parallel:result is None 2024-09-18T05:13:41.308 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2024-09-18T05:13:41.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-09-18T05:13:41.325 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:41.325 DEBUG:teuthology.parallel:result is None 2024-09-18T05:13:41.326 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:41.338 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-09-18T05:13:41.339 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-09-18T05:13:41.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-18T05:13:41.346 DEBUG:teuthology.parallel:result is None 2024-09-18T05:13:41.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-09-18T05:13:41.355 DEBUG:teuthology.parallel:result is None 2024-09-18T05:13:41.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-09-18T05:13:41.360 DEBUG:teuthology.parallel:result is None 2024-09-18T05:13:41.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-09-18T05:13:41.363 DEBUG:teuthology.parallel:result is None 2024-09-18T05:13:41.363 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T05:13:41.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:13:41.683 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:13:41.701 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-18T05:13:40.553877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234400,"kb_used_data":1832,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754740320,"statfs":{"total":773094113280,"available":772854087680,"internally_reserved":0,"allocated":1875968,"data_stored":1769022,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.692816"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.890828+0000","last_change":"2024-09-18T05:13:37.891260+0000","last_active":"2024-09-18T05:13:37.890828+0000","last_peered":"2024-09-18T05:13:37.890828+0000","last_clean":"2024-09-18T05:13:37.890828+0000","last_became_active":"2024-09-18T05:13:35.878930+0000","last_became_peered":"2024-09-18T05:13:35.878930+0000","last_unstale":"2024-09-18T05:13:37.890828+0000","last_undegraded":"2024-09-18T05:13:37.890828+0000","last_fullsized":"2024-09-18T05:13:37.890828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:44.904896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070920800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.896373+0000","last_change":"2024-09-18T05:13:37.896976+0000","last_active":"2024-09-18T05:13:37.896373+0000","last_peered":"2024-09-18T05:13:37.896373+0000","last_clean":"2024-09-18T05:13:37.896373+0000","last_became_active":"2024-09-18T05:13:35.879278+0000","last_became_peered":"2024-09-18T05:13:35.879278+0000","last_unstale":"2024-09-18T05:13:37.896373+0000","last_undegraded":"2024-09-18T05:13:37.896373+0000","last_fullsized":"2024-09-18T05:13:37.896373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:47.035613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.986010+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:13:37.986010+0000","last_peered":"2024-09-18T05:13:37.986010+0000","last_clean":"2024-09-18T05:13:37.986010+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:13:37.986010+0000","last_undegraded":"2024-09-18T05:13:37.986010+0000","last_fullsized":"2024-09-18T05:13:37.986010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.896239+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:13:37.896239+0000","last_peered":"2024-09-18T05:13:37.896239+0000","last_clean":"2024-09-18T05:13:37.896239+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:13:37.896239+0000","last_undegraded":"2024-09-18T05:13:37.896239+0000","last_fullsized":"2024-09-18T05:13:37.896239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.897308+0000","last_change":"2024-09-18T05:13:37.897308+0000","last_active":"2024-09-18T05:13:37.897308+0000","last_peered":"2024-09-18T05:13:37.897308+0000","last_clean":"2024-09-18T05:13:37.897308+0000","last_became_active":"2024-09-18T05:13:35.880281+0000","last_became_peered":"2024-09-18T05:13:35.880281+0000","last_unstale":"2024-09-18T05:13:37.897308+0000","last_undegraded":"2024-09-18T05:13:37.897308+0000","last_fullsized":"2024-09-18T05:13:37.897308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.887003+0000","last_change":"2024-09-18T05:13:37.887642+0000","last_active":"2024-09-18T05:13:37.887003+0000","last_peered":"2024-09-18T05:13:37.887003+0000","last_clean":"2024-09-18T05:13:37.887003+0000","last_became_active":"2024-09-18T05:13:36.135298+0000","last_became_peered":"2024-09-18T05:13:36.135298+0000","last_unstale":"2024-09-18T05:13:37.887003+0000","last_undegraded":"2024-09-18T05:13:37.887003+0000","last_fullsized":"2024-09-18T05:13:37.887003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.310834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088184600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.985830+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:13:37.985830+0000","last_peered":"2024-09-18T05:13:37.985830+0000","last_clean":"2024-09-18T05:13:37.985830+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:13:37.985830+0000","last_undegraded":"2024-09-18T05:13:37.985830+0000","last_fullsized":"2024-09-18T05:13:37.985830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.895598+0000","last_change":"2024-09-18T05:13:37.896005+0000","last_active":"2024-09-18T05:13:37.895598+0000","last_peered":"2024-09-18T05:13:37.895598+0000","last_clean":"2024-09-18T05:13:37.895598+0000","last_became_active":"2024-09-18T05:13:35.878921+0000","last_became_peered":"2024-09-18T05:13:35.878921+0000","last_unstale":"2024-09-18T05:13:37.895598+0000","last_undegraded":"2024-09-18T05:13:37.895598+0000","last_fullsized":"2024-09-18T05:13:37.895598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:03.020943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.485149+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:13:37.485149+0000","last_peered":"2024-09-18T05:13:37.485149+0000","last_clean":"2024-09-18T05:13:37.485149+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:13:37.485149+0000","last_undegraded":"2024-09-18T05:13:37.485149+0000","last_fullsized":"2024-09-18T05:13:37.485149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":663899,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":282624,"data_stored":663899,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:13:41.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:13:41.985 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:13:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-18T05:13:40.553877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234400,"kb_used_data":1832,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754740320,"statfs":{"total":773094113280,"available":772854087680,"internally_reserved":0,"allocated":1875968,"data_stored":1769022,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.692816"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.890828+0000","last_change":"2024-09-18T05:13:37.891260+0000","last_active":"2024-09-18T05:13:37.890828+0000","last_peered":"2024-09-18T05:13:37.890828+0000","last_clean":"2024-09-18T05:13:37.890828+0000","last_became_active":"2024-09-18T05:13:35.878930+0000","last_became_peered":"2024-09-18T05:13:35.878930+0000","last_unstale":"2024-09-18T05:13:37.890828+0000","last_undegraded":"2024-09-18T05:13:37.890828+0000","last_fullsized":"2024-09-18T05:13:37.890828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:44.904896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070920800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.896373+0000","last_change":"2024-09-18T05:13:37.896976+0000","last_active":"2024-09-18T05:13:37.896373+0000","last_peered":"2024-09-18T05:13:37.896373+0000","last_clean":"2024-09-18T05:13:37.896373+0000","last_became_active":"2024-09-18T05:13:35.879278+0000","last_became_peered":"2024-09-18T05:13:35.879278+0000","last_unstale":"2024-09-18T05:13:37.896373+0000","last_undegraded":"2024-09-18T05:13:37.896373+0000","last_fullsized":"2024-09-18T05:13:37.896373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:47.035613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.986010+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:13:37.986010+0000","last_peered":"2024-09-18T05:13:37.986010+0000","last_clean":"2024-09-18T05:13:37.986010+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:13:37.986010+0000","last_undegraded":"2024-09-18T05:13:37.986010+0000","last_fullsized":"2024-09-18T05:13:37.986010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.896239+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:13:37.896239+0000","last_peered":"2024-09-18T05:13:37.896239+0000","last_clean":"2024-09-18T05:13:37.896239+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:13:37.896239+0000","last_undegraded":"2024-09-18T05:13:37.896239+0000","last_fullsized":"2024-09-18T05:13:37.896239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.897308+0000","last_change":"2024-09-18T05:13:37.897308+0000","last_active":"2024-09-18T05:13:37.897308+0000","last_peered":"2024-09-18T05:13:37.897308+0000","last_clean":"2024-09-18T05:13:37.897308+0000","last_became_active":"2024-09-18T05:13:35.880281+0000","last_became_peered":"2024-09-18T05:13:35.880281+0000","last_unstale":"2024-09-18T05:13:37.897308+0000","last_undegraded":"2024-09-18T05:13:37.897308+0000","last_fullsized":"2024-09-18T05:13:37.897308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.887003+0000","last_change":"2024-09-18T05:13:37.887642+0000","last_active":"2024-09-18T05:13:37.887003+0000","last_peered":"2024-09-18T05:13:37.887003+0000","last_clean":"2024-09-18T05:13:37.887003+0000","last_became_active":"2024-09-18T05:13:36.135298+0000","last_became_peered":"2024-09-18T05:13:36.135298+0000","last_unstale":"2024-09-18T05:13:37.887003+0000","last_undegraded":"2024-09-18T05:13:37.887003+0000","last_fullsized":"2024-09-18T05:13:37.887003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.310834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088184600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.985830+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:13:37.985830+0000","last_peered":"2024-09-18T05:13:37.985830+0000","last_clean":"2024-09-18T05:13:37.985830+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:13:37.985830+0000","last_undegraded":"2024-09-18T05:13:37.985830+0000","last_fullsized":"2024-09-18T05:13:37.985830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.895598+0000","last_change":"2024-09-18T05:13:37.896005+0000","last_active":"2024-09-18T05:13:37.895598+0000","last_peered":"2024-09-18T05:13:37.895598+0000","last_clean":"2024-09-18T05:13:37.895598+0000","last_became_active":"2024-09-18T05:13:35.878921+0000","last_became_peered":"2024-09-18T05:13:35.878921+0000","last_unstale":"2024-09-18T05:13:37.895598+0000","last_undegraded":"2024-09-18T05:13:37.895598+0000","last_fullsized":"2024-09-18T05:13:37.895598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:03.020943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.485149+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:13:37.485149+0000","last_peered":"2024-09-18T05:13:37.485149+0000","last_clean":"2024-09-18T05:13:37.485149+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:13:37.485149+0000","last_undegraded":"2024-09-18T05:13:37.485149+0000","last_fullsized":"2024-09-18T05:13:37.485149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":663899,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":282624,"data_stored":663899,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:13:42.003 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T05:13:42.003 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T05:13:42.003 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-18T05:13:42.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-18T05:13:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:42.312 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T05:13:42.330 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-18T05:13:42.330 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-18T05:13:42.343 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-18T05:13:42.343 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7'}} 2024-09-18T05:13:42.343 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-18T05:13:42.344 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-18T05:13:42.655 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-18T05:13:42.655 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T05:13:42.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:13:42.940 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:42.941 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:13:42.957 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-18T05:13:42.554484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234400,"kb_used_data":1832,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754740320,"statfs":{"total":773094113280,"available":772854087680,"internally_reserved":0,"allocated":1875968,"data_stored":1769022,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.691032"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.890828+0000","last_change":"2024-09-18T05:13:37.891260+0000","last_active":"2024-09-18T05:13:37.890828+0000","last_peered":"2024-09-18T05:13:37.890828+0000","last_clean":"2024-09-18T05:13:37.890828+0000","last_became_active":"2024-09-18T05:13:35.878930+0000","last_became_peered":"2024-09-18T05:13:35.878930+0000","last_unstale":"2024-09-18T05:13:37.890828+0000","last_undegraded":"2024-09-18T05:13:37.890828+0000","last_fullsized":"2024-09-18T05:13:37.890828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:44.904896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070920800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.896373+0000","last_change":"2024-09-18T05:13:37.896976+0000","last_active":"2024-09-18T05:13:37.896373+0000","last_peered":"2024-09-18T05:13:37.896373+0000","last_clean":"2024-09-18T05:13:37.896373+0000","last_became_active":"2024-09-18T05:13:35.879278+0000","last_became_peered":"2024-09-18T05:13:35.879278+0000","last_unstale":"2024-09-18T05:13:37.896373+0000","last_undegraded":"2024-09-18T05:13:37.896373+0000","last_fullsized":"2024-09-18T05:13:37.896373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:47.035613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.986010+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:13:37.986010+0000","last_peered":"2024-09-18T05:13:37.986010+0000","last_clean":"2024-09-18T05:13:37.986010+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:13:37.986010+0000","last_undegraded":"2024-09-18T05:13:37.986010+0000","last_fullsized":"2024-09-18T05:13:37.986010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.896239+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:13:37.896239+0000","last_peered":"2024-09-18T05:13:37.896239+0000","last_clean":"2024-09-18T05:13:37.896239+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:13:37.896239+0000","last_undegraded":"2024-09-18T05:13:37.896239+0000","last_fullsized":"2024-09-18T05:13:37.896239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.897308+0000","last_change":"2024-09-18T05:13:37.897308+0000","last_active":"2024-09-18T05:13:37.897308+0000","last_peered":"2024-09-18T05:13:37.897308+0000","last_clean":"2024-09-18T05:13:37.897308+0000","last_became_active":"2024-09-18T05:13:35.880281+0000","last_became_peered":"2024-09-18T05:13:35.880281+0000","last_unstale":"2024-09-18T05:13:37.897308+0000","last_undegraded":"2024-09-18T05:13:37.897308+0000","last_fullsized":"2024-09-18T05:13:37.897308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.887003+0000","last_change":"2024-09-18T05:13:37.887642+0000","last_active":"2024-09-18T05:13:37.887003+0000","last_peered":"2024-09-18T05:13:37.887003+0000","last_clean":"2024-09-18T05:13:37.887003+0000","last_became_active":"2024-09-18T05:13:36.135298+0000","last_became_peered":"2024-09-18T05:13:36.135298+0000","last_unstale":"2024-09-18T05:13:37.887003+0000","last_undegraded":"2024-09-18T05:13:37.887003+0000","last_fullsized":"2024-09-18T05:13:37.887003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.310834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088184600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.985830+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:13:37.985830+0000","last_peered":"2024-09-18T05:13:37.985830+0000","last_clean":"2024-09-18T05:13:37.985830+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:13:37.985830+0000","last_undegraded":"2024-09-18T05:13:37.985830+0000","last_fullsized":"2024-09-18T05:13:37.985830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.895598+0000","last_change":"2024-09-18T05:13:37.896005+0000","last_active":"2024-09-18T05:13:37.895598+0000","last_peered":"2024-09-18T05:13:37.895598+0000","last_clean":"2024-09-18T05:13:37.895598+0000","last_became_active":"2024-09-18T05:13:35.878921+0000","last_became_peered":"2024-09-18T05:13:35.878921+0000","last_unstale":"2024-09-18T05:13:37.895598+0000","last_undegraded":"2024-09-18T05:13:37.895598+0000","last_fullsized":"2024-09-18T05:13:37.895598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:03.020943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.485149+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:13:37.485149+0000","last_peered":"2024-09-18T05:13:37.485149+0000","last_clean":"2024-09-18T05:13:37.485149+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:13:37.485149+0000","last_undegraded":"2024-09-18T05:13:37.485149+0000","last_fullsized":"2024-09-18T05:13:37.485149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":663899,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":282624,"data_stored":663899,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:13:42.958 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:13:43.236 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:43.237 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:13:43.253 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-18T05:13:42.554484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234400,"kb_used_data":1832,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754740320,"statfs":{"total":773094113280,"available":772854087680,"internally_reserved":0,"allocated":1875968,"data_stored":1769022,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.691032"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.890828+0000","last_change":"2024-09-18T05:13:37.891260+0000","last_active":"2024-09-18T05:13:37.890828+0000","last_peered":"2024-09-18T05:13:37.890828+0000","last_clean":"2024-09-18T05:13:37.890828+0000","last_became_active":"2024-09-18T05:13:35.878930+0000","last_became_peered":"2024-09-18T05:13:35.878930+0000","last_unstale":"2024-09-18T05:13:37.890828+0000","last_undegraded":"2024-09-18T05:13:37.890828+0000","last_fullsized":"2024-09-18T05:13:37.890828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:44.904896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070920800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.896373+0000","last_change":"2024-09-18T05:13:37.896976+0000","last_active":"2024-09-18T05:13:37.896373+0000","last_peered":"2024-09-18T05:13:37.896373+0000","last_clean":"2024-09-18T05:13:37.896373+0000","last_became_active":"2024-09-18T05:13:35.879278+0000","last_became_peered":"2024-09-18T05:13:35.879278+0000","last_unstale":"2024-09-18T05:13:37.896373+0000","last_undegraded":"2024-09-18T05:13:37.896373+0000","last_fullsized":"2024-09-18T05:13:37.896373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:47.035613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.986010+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:13:37.986010+0000","last_peered":"2024-09-18T05:13:37.986010+0000","last_clean":"2024-09-18T05:13:37.986010+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:13:37.986010+0000","last_undegraded":"2024-09-18T05:13:37.986010+0000","last_fullsized":"2024-09-18T05:13:37.986010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.896239+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:13:37.896239+0000","last_peered":"2024-09-18T05:13:37.896239+0000","last_clean":"2024-09-18T05:13:37.896239+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:13:37.896239+0000","last_undegraded":"2024-09-18T05:13:37.896239+0000","last_fullsized":"2024-09-18T05:13:37.896239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.897308+0000","last_change":"2024-09-18T05:13:37.897308+0000","last_active":"2024-09-18T05:13:37.897308+0000","last_peered":"2024-09-18T05:13:37.897308+0000","last_clean":"2024-09-18T05:13:37.897308+0000","last_became_active":"2024-09-18T05:13:35.880281+0000","last_became_peered":"2024-09-18T05:13:35.880281+0000","last_unstale":"2024-09-18T05:13:37.897308+0000","last_undegraded":"2024-09-18T05:13:37.897308+0000","last_fullsized":"2024-09-18T05:13:37.897308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.887003+0000","last_change":"2024-09-18T05:13:37.887642+0000","last_active":"2024-09-18T05:13:37.887003+0000","last_peered":"2024-09-18T05:13:37.887003+0000","last_clean":"2024-09-18T05:13:37.887003+0000","last_became_active":"2024-09-18T05:13:36.135298+0000","last_became_peered":"2024-09-18T05:13:36.135298+0000","last_unstale":"2024-09-18T05:13:37.887003+0000","last_undegraded":"2024-09-18T05:13:37.887003+0000","last_fullsized":"2024-09-18T05:13:37.887003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.310834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088184600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.985830+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:13:37.985830+0000","last_peered":"2024-09-18T05:13:37.985830+0000","last_clean":"2024-09-18T05:13:37.985830+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:13:37.985830+0000","last_undegraded":"2024-09-18T05:13:37.985830+0000","last_fullsized":"2024-09-18T05:13:37.985830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.895598+0000","last_change":"2024-09-18T05:13:37.896005+0000","last_active":"2024-09-18T05:13:37.895598+0000","last_peered":"2024-09-18T05:13:37.895598+0000","last_clean":"2024-09-18T05:13:37.895598+0000","last_became_active":"2024-09-18T05:13:35.878921+0000","last_became_peered":"2024-09-18T05:13:35.878921+0000","last_unstale":"2024-09-18T05:13:37.895598+0000","last_undegraded":"2024-09-18T05:13:37.895598+0000","last_fullsized":"2024-09-18T05:13:37.895598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:03.020943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-18T05:13:37.485149+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:13:37.485149+0000","last_peered":"2024-09-18T05:13:37.485149+0000","last_clean":"2024-09-18T05:13:37.485149+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:13:37.485149+0000","last_undegraded":"2024-09-18T05:13:37.485149+0000","last_fullsized":"2024-09-18T05:13:37.485149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":663899,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":282624,"data_stored":663899,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:13:43.254 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T05:13:43.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-18T05:13:43.543 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-09-18T05:13:43.543 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 04ac0d2c-34bd-46ad-a307-a4eb23236eb4 2024-09-18T05:13:43.543 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-18T05:13:15.193498+0000 2024-09-18T05:13:43.543 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-18T05:13:37.875328+0000 2024-09-18T05:13:43.543 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 4 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client jewel 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release reef 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: removed_snaps_queue [2~1] 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 8 2024-09-18T05:13:43.544 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6800/1558450642,v1:172.21.15.17:6801/1558450642] [v2:172.21.15.17:6802/1558450642,v1:172.21.15.17:6803/1558450642] exists,up a2a580f7-2bbc-46c3-b6b5-5a9e93539d27 2024-09-18T05:13:43.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6808/3444575073,v1:172.21.15.17:6809/3444575073] [v2:172.21.15.17:6810/3444575073,v1:172.21.15.17:6811/3444575073] exists,up 260da429-e6eb-446b-95a0-dcf4581bb584 2024-09-18T05:13:43.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6816/467806624,v1:172.21.15.17:6817/467806624] [v2:172.21.15.17:6818/467806624,v1:172.21.15.17:6819/467806624] exists,up 0cf5d53a-552d-4775-8437-86af3465b1bc 2024-09-18T05:13:43.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6824/3763834627,v1:172.21.15.17:6825/3763834627] [v2:172.21.15.17:6826/3763834627,v1:172.21.15.17:6827/3763834627] exists,up 73bc18b6-4972-4164-a294-b6372bcf9f9d 2024-09-18T05:13:43.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/1703780253,v1:172.21.15.86:6802/1703780253] [v2:172.21.15.86:6804/1703780253,v1:172.21.15.86:6806/1703780253] exists,up 536c8ef2-eca6-44b4-a70c-06f191eb5ff1 2024-09-18T05:13:43.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6808/3348904742,v1:172.21.15.86:6811/3348904742] [v2:172.21.15.86:6813/3348904742,v1:172.21.15.86:6816/3348904742] exists,up 4341bba4-2913-4352-89d4-36fa18ee39cb 2024-09-18T05:13:43.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6801/74856761,v1:172.21.15.86:6803/74856761] [v2:172.21.15.86:6805/74856761,v1:172.21.15.86:6807/74856761] exists,up e47d4aad-9c4b-43a9-9b32-2db463ec2a20 2024-09-18T05:13:43.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6824/1345159853,v1:172.21.15.86:6825/1345159853] [v2:172.21.15.86:6826/1345159853,v1:172.21.15.86:6827/1345159853] exists,up 686d275c-e592-44c1-87f9-ac9718f3a112 2024-09-18T05:13:43.562 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6800/1558450642,v1:172.21.15.17:6801/1558450642] [v2:172.21.15.17:6802/1558450642,v1:172.21.15.17:6803/1558450642] exists,up a2a580f7-2bbc-46c3-b6b5-5a9e93539d27', 'osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6808/3444575073,v1:172.21.15.17:6809/3444575073] [v2:172.21.15.17:6810/3444575073,v1:172.21.15.17:6811/3444575073] exists,up 260da429-e6eb-446b-95a0-dcf4581bb584', 'osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6816/467806624,v1:172.21.15.17:6817/467806624] [v2:172.21.15.17:6818/467806624,v1:172.21.15.17:6819/467806624] exists,up 0cf5d53a-552d-4775-8437-86af3465b1bc', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6824/3763834627,v1:172.21.15.17:6825/3763834627] [v2:172.21.15.17:6826/3763834627,v1:172.21.15.17:6827/3763834627] exists,up 73bc18b6-4972-4164-a294-b6372bcf9f9d', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/1703780253,v1:172.21.15.86:6802/1703780253] [v2:172.21.15.86:6804/1703780253,v1:172.21.15.86:6806/1703780253] exists,up 536c8ef2-eca6-44b4-a70c-06f191eb5ff1', 'osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6808/3348904742,v1:172.21.15.86:6811/3348904742] [v2:172.21.15.86:6813/3348904742,v1:172.21.15.86:6816/3348904742] exists,up 4341bba4-2913-4352-89d4-36fa18ee39cb', 'osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6801/74856761,v1:172.21.15.86:6803/74856761] [v2:172.21.15.86:6805/74856761,v1:172.21.15.86:6807/74856761] exists,up e47d4aad-9c4b-43a9-9b32-2db463ec2a20', 'osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6824/1345159853,v1:172.21.15.86:6825/1345159853] [v2:172.21.15.86:6826/1345159853,v1:172.21.15.86:6827/1345159853] exists,up 686d275c-e592-44c1-87f9-ac9718f3a112'] 2024-09-18T05:13:43.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-18T05:13:43.668 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mon.a", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster": "ceph", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "admin_socket_mode": "", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_client_required": "cephx, none", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_cluster_required": "cephx", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_debug": "true", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_service_required": "cephx", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-18T05:13:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_supported": "cephx", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio": "true", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_poll_ms": "250", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_reap_max": "16", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_async_discard": "false", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_block_size": "4096", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio": "false", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_inflight_ios": "false", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_enable_discard": "false", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_flock_retry": "3", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-18T05:13:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_inject_crash": "0", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring": "false", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring_hipri": "false", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_type": "", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_alloc_size": "1048576", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_allocator": "hybrid", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_buffered_io": "true", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_for_zeros": "false", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-18T05:13:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-18T05:13:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_compact_log_sync": "false", 2024-09-18T05:13:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-18T05:13:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-18T05:13:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-18T05:13:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-18T05:13:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_max_log_runway": "4194304", 2024-09-18T05:13:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_max_prefetch": "1048576", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_min_flush_size": "524288", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_min_log_runway": "1048576", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_replay_recovery": "false", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_sync_write": "false", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_allocation_from_file": "true", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_allocator": "hybrid", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-18T05:13:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-18T05:13:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-18T05:13:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-18T05:13:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-18T05:13:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-18T05:13:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_create": "true", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_create": "false", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_path": "", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_size": "0", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_path": "", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_preallocate_file": "false", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_size": "107374182400", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_create": "false", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_path": "", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_size": "100663296", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs": "true", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-18T05:13:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-18T05:13:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-18T05:13:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-18T05:13:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-18T05:13:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-18T05:13:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_autotune": "true", 2024-09-18T05:13:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-18T05:13:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-18T05:13:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-18T05:13:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-18T05:13:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size": "0", 2024-09-18T05:13:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-18T05:13:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-18T05:13:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_type": "2q", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_clone_cow": "true", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-18T05:13:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_mode": "none", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_csum_type": "crc32c", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_freelist": "false", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_bug21040": "false", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-18T05:13:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_prefill": "0.000000", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_small_allocations": "0", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-18T05:13:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_default_buffered_read": "true", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_default_buffered_write": "false", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-18T05:13:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fail_eio": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mount": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_umount": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-18T05:13:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_ignore_data_csum": "false", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_op_age": "5.000000", 2024-09-18T05:13:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_alloc_size": "0", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size": "0", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_deferred_txc": "32", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size": "0", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_nid_prealloc": "1024", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-18T05:13:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_retry_disk_reads": "3", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_cf": "true", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_mem": "512", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-18T05:13:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_tracing": "false", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-18T05:13:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_zero_block_detection": "false", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-18T05:13:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_cluster_require_signatures": "false", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_cluster_require_version": "2", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_require_signatures": "false", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_require_version": "2", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_service_require_signatures": "false", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_service_require_version": "2", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_sign_messages": "true", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "chdir": "", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_acl_type": "", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_asio_thread_count": "2", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_cache_mid": "0.750000", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_cache_size": "16384", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_caps_release_delay": "5", 2024-09-18T05:13:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_check_pool_perm": "true", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_force_sync_read": "false", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_getattr_caps": "false", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_inject_features": "", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_inject_tick_delay": "0", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_die_on_failed_remount": "false", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_dirsize_rbytes": "true", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_force_lazyio": "false", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_fs": "", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_inject_release_failure": "false", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_max_inline_size": "4096", 2024-09-18T05:13:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mds_namespace": "", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_metadata": "", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_gid": "-1", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_timeout": "300", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_uid": "-1", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mountpoint": "/", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_notify_timeout": "10", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc": "true", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_dirty": "104857600", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_objects": "1000", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_size": "209715200", 2024-09-18T05:13:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_target_dirty": "8388608", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_permissions": "true", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_quota": "true", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_quota_df": "true", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_max_bytes": "0", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_max_periods": "4", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_min": "131072", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_reconnect_stale": "false", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_shutdown_timeout": "30", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_snapdir": ".snap", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_tick_interval": "1", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_trace": "", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_try_dentry_invalidate": "false", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_use_faked_inos": "false", 2024-09-18T05:13:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_use_random_mds": "false", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog": "false", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog_port": "12201", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_monitors": "default=true", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog": "false", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog_level": "info", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "-", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_network": "", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_network_interface": "", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_isal": "false", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_level": "5", 2024-09-18T05:13:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_winsize": "-15", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zstd_level": "1", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_alien_op_num_threads": "6", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_obc_lru_size": "10", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_seastar_smp": "1", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location": "", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location_hook": "", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location_hook_timeout": "10", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "daemonize": "false", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "daos_pool": "tank", 2024-09-18T05:13:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_alienstore": "0/5", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_allow_any_pool_priority": "false", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asok": "1/5", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asok_assert_abort": "false", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asserts_on_shutdown": "true", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_auth": "20/20", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bdev": "1/3", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bluefs": "1/5", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bluestore": "1/5", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_buffer": "0/1", 2024-09-18T05:13:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ceph_exporter": "1/5", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cephfs_mirror": "0/5", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cephsqlite": "0/5", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_client": "0/5", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_compressor": "1/5", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_context": "0/1", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crush": "1/1", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crypto": "1/5", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cyanstore": "0/5", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_deliberately_leak_memory": "false", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_disable_randomized_ping": "false", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_dpdk": "1/5", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_eventtrace": "1/5", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_filer": "0/1", 2024-09-18T05:13:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_filestore": "1/3", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_finisher": "1/1", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_fuse": "1/5", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_heartbeat_testing_span": "0", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_heartbeatmap": "1/5", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_javaclient": "1/5", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_journal": "1/3", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_journaler": "0/5", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_kstore": "1/5", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_leveldb": "4/5", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_lockdep": "0/1", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mclock": "1/5", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds": "1/5", 2024-09-18T05:13:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_balancer": "1/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_locker": "1/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_log": "1/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_log_expire": "1/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_migrator": "1/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_memstore": "1/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mgr": "2/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mgrc": "1/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mon": "20/20", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_monc": "0/10", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ms": "1/1", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_none": "0/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objclass": "0/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objectcacher": "0/5", 2024-09-18T05:13:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objecter": "0/1", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_optracker": "0/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_osd": "1/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_paxos": "20/20", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_perfcounter": "1/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_prioritycache": "1/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rados": "0/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd": "0/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_mirror": "0/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_pwl": "0/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_replay": "0/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_refs": "0/0", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_reserver": "1/1", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw": "1/5", 2024-09-18T05:13:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_access": "1/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_datacache": "1/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_dbstore": "1/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_flight": "1/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_sync": "1/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rocksdb": "4/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore": "0/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_backref": "0/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_cache": "0/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_cleaner": "0/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_device": "0/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_epm": "0/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_journal": "0/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_lba": "0/5", 2024-09-18T05:13:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_odata": "0/5", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_omap": "0/5", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_onode": "0/5", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_t": "0/5", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_tm": "0/5", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_striper": "0/1", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_test": "0/5", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_throttle": "1/1", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_timer": "0/1", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_tp": "0/5", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "device_failure_prediction_mode": "none", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-18T05:13:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_graylog": "false", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_journald": "false", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_stderr": "true", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_syslog": "false", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event_tracing": "false", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_addr": "0.0.0.0", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_http_port": "9926", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_prio_limit": "5", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_sort_metrics": "true", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_stats_period": "5", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "fake_statfs_for_testing": "0", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "fatal_signal_handlers": "true", 2024-09-18T05:13:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "filer_max_purge_ops": "10", 2024-09-18T05:13:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "filer_max_truncate_ops": "128", 2024-09-18T05:13:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_apply_finisher_threads": "1", 2024-09-18T05:13:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_blackhole": "false", 2024-09-18T05:13:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_btrfs_clone_range": "true", 2024-09-18T05:13:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_btrfs_snap": "true", 2024-09-18T05:13:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_caller_concurrency": "10", 2024-09-18T05:13:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_collect_device_partition_information": "true", 2024-09-18T05:13:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_commit_timeout": "600.000000", 2024-09-18T05:13:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_inject_read_err": "false", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_omap_check": "false", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_verify_split": "false", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_dump_file": "", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fadvise": "true", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fail_eio": "true", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fd_cache_shards": "16", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fd_cache_size": "128", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fiemap": "false", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fiemap_threshold": "4096", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-18T05:13:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_inject_stall": "0", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_parallel": "false", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_trailing": "false", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_writeahead": "false", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_kill_at": "0", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs": "0", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-18T05:13:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size": "0", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_merge_threshold": "-10", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_odsync_write": "false", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_backend": "rocksdb", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_backend_path": "", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-18T05:13:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_thread_timeout": "60", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_threads": "2", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_punch_hole": "false", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_ops": "50", 2024-09-18T05:13:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_seek_data_hole": "false", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_sloppy_crc": "false", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_splice": "false", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_split_multiple": "2", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_split_rand_factor": "20", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_update_to": "1000", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-18T05:13:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_enable": "true", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_xfs_extsize": "false", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_zfs_snap": "false", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "fio_dir": "/tmp/fio", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "04ac0d2c-34bd-46ad-a307-a4eb23236eb4", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_allow_other": "true", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_atomic_o_trunc": "true", 2024-09-18T05:13:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_big_writes": "true", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_debug": "false", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_default_permissions": "false", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_disable_pagecache": "false", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_max_write": "0", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_multithreaded": "true", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_require_active_mds": "true", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_set_user_groups": "true", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_move": "true", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_read": "true", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_write": "true", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_use_invalidate_cb": "true", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "gss_target_name": "ceph", 2024-09-18T05:13:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_file": "", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_inject_failure": "0", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_interval": "5", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "host": "smithi017", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-18T05:13:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "inject_early_sigterm": "false", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "jaeger_agent_port": "6799", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "jaeger_tracing_enable": "false", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_aio": "true", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_align_min_size": "65536", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_block_align": "true", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_block_size": "4096", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_dio": "true", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_discard": "false", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_force_aio": "false", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_ignore_corruption": "false", 2024-09-18T05:13:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_max_write_bytes": "10485760", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_max_write_entries": "100", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_replay_from": "0", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_write_header_frequency": "0", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_zero_on_create": "false", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_prefetch_periods": "10", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_prezero_periods": "5", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_write_head_interval": "15", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "keyfile": "", 2024-09-18T05:13:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_backend": "rocksdb", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_default_stripe_size": "65536", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_fsck_on_mount": "false", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_max_bytes": "67108864", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_max_ops": "512", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_nid_prealloc": "1024", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_onode_map_size": "1024", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_sync_submit_transaction": "false", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_sync_transaction": "false", 2024-09-18T05:13:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_block_size": "65536", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_bloom_size": "0", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_cache_size": "536870912", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_compact_on_mount": "false", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_compression": "false", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_log": "", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_log_to_ceph_log": "true", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_max_open_files": "0", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_paranoid": "false", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "leveldb_write_buffer_size": "33554432", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "librados_thread_count": "2", 2024-09-18T05:13:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "lockdep": "false", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "lockdep_force_backtrace": "false", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_coarse_timestamps": "true", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_flush_on_exit": "false", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_graylog_host": "127.0.0.1", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_graylog_port": "12201", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_max_new": "1000", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_max_recent": "10000", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_stderr_prefix": "", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_stop_at_utilization": "0.970000", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": "true", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_graylog": "false", 2024-09-18T05:13:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_journald": "false", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_stderr": "false", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_syslog": "false", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max_rotating_auth_attempts": "10", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_action_on_write_error": "1", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_alternate_name_max": "8192", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_asio_thread_count": "2", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_export_pin": "true", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_dirs": "true", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_interval": "5", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-18T05:13:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_interval": "10", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_max": "-1", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_max_until": "-1", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_merge_size": "50", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_midchunk": "0.300000", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_min_start": "0.200000", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_minchunk": "0.001000", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_mode": "0", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_need_max": "1.200000", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_need_min": "0.800000", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-18T05:13:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_bits": "3", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_size": "10000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_target_decay": "10.000000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_grace": "15.000000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_interval": "4.000000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_mid": "0.700000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_release_free_interval": "10", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_reservation": "0.050000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_interval": "1", 2024-09-18T05:13:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_threshold": "262144", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_prealloc_inos": "1000", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_connect_bootstrapping": "false", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_damage_table_max_entries": "10000", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_auth_pins": "false", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_frag": "false", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_scatterstat": "false", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_subtrees": "false", 2024-09-18T05:13:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_decay_halflife": "5.000000", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_default_dir_hash": "2", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_defer_session_stale": "true", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_deny_all_reconnect": "false", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_keys_per_op": "16384", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_max_commit_size": "10", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_max_entries": "0", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_prefetch": "true", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_on_map": "false", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_early_reply": "true", 2024-09-18T05:13:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_enable_op_tracker": "true", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_enforce_unique_name": "true", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_random": "true", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_health_summarize_threshold": "10", 2024-09-18T05:13:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_health_dummy": "false", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_migrator_session_race": "false", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_join_fs": "", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_journal_format": "1", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_create_at": "0", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_export_at": "0", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_import_at": "0", 2024-09-18T05:13:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_at": "0", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_expire_at": "0", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_replay_at": "0", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_link_at": "0", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_mdstable_at": "0", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_openc_at": "0", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_rename_at": "0", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_events_per_segment": "1024", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_max_events": "-1", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_max_segments": "128", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_pause": "false", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_segment_size": "0", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_warn_factor": "2.000000", 2024-09-18T05:13:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_caps_per_client": "1048576", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_completed_flushes": "100000", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_completed_requests": "100000", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_export_size": "20971520", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_file_recover": "32", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_files": "64", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_ops": "8192", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_snaps_per_dir": "100", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_metrics_update_interval": "2", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_min_caps_per_client": "100", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_min_caps_working_set": "10000", 2024-09-18T05:13:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_numa_node": "-1", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_complaint_time": "30.000000", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_duration": "600", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_size": "20", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_slow_op_size": "20", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_log_threshold": "5", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_ping_grace": "15", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_ping_interval": "5", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-18T05:13:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_caps": "30000", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_warning_threshold": "262144", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_replay_interval": "1.000000", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_root_ino_gid": "0", 2024-09-18T05:13:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_root_ino_uid": "0", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-18T05:13:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_shutdown_check": "0", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_skip_ino": "0", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_max_uid": "4294967294", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_min_uid": "0", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_rstat": "false", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_standby_replay_damaged": "false", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_symlink_recovery": "true", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_thrash_exports": "0", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_thrash_fragments": "0", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_tick_interval": "5.000000", 2024-09-18T05:13:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_valgrind_exit": "false", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_verify_backtrace": "1", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_verify_scatter": "false", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_wipe_sessions": "false", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool_debug": "false", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_device_bytes": "1073741824", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_page_set": "false", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_page_size": "65536", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_bytes": "134217728", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_messages": "512", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-18T05:13:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_disabled_modules": "", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_max_pg_num_change": "128", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mds_bytes": "134217728", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mds_messages": "128", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mon_bytes": "134217728", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mon_messages": "128", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_osd_bytes": "536870912", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_osd_messages": "8192", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_pool": "true", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-18T05:13:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_standby_modules": "true", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_stats_period": "5", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_stats_threshold": "5", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_tick_period": "2", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_allow_pool_delete": "true", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_allow_pool_size_one": "true", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_auth_validate_all_caps": "true", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_bytes": "104857600", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_directed_command_retry": "5", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-18T05:13:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_parallel": "3", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_log_interval": "1.000000", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_ping_interval": "10.000000", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_file_level": "debug", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_file": "true", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-18T05:13:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_journald": "false", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_bootstrap": "false", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_start": "false", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_trim": "true", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-18T05:13:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cpu_threads": "4", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_crush_min_required_version": "hammer", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_daemon_bytes": "419430400", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_avail_crit": "5", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_avail_warn": "5", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_size_warn": "16106127360", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_json": "false", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_transactions": "false", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_extra_checks": "false", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-18T05:13:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_quincy": "false", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_reef": "false", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_down_mkfs_grace": "120", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_election_default_strategy": "1", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_election_timeout": "5.000000", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ping_divisor": "2", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_enable_op_tracker": "true", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_fake_pool_delete": "false", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_force_quorum_join": "false", 2024-09-18T05:13:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_globalid_prealloc": "10000", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_detail_to_clog": "false", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_log_update_period": "5", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_max_detail": "50", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog": "true", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog_interval": "600", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_host": "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.86", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_host_override": "", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_initial_members": "", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-18T05:13:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease": "5.000000", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_full_interval": "50", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_max": "10000", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_max_summary": "50", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_log_epochs": "500", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_osd": "10000", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_pg_per_osd": "10000", 2024-09-18T05:13:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_pool_pg_num": "65536", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_force_trim_to": "0", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_skip_sanity": "false", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_memory_autotune": "true", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_memory_target": "2147483648", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_beacon_grace": "30", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_digest_period": "5", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_inactive_grace": "60", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_min_osdmap_epochs": "500", 2024-09-18T05:13:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_complaint_time": "30", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_duration": "600", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_size": "20", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_slow_op_size": "20", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_log_threshold": "5", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_in": "false", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_cache_size": "500", 2024-09-18T05:13:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-18T05:13:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-18T05:13:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-18T05:13:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_down_out_interval": "600", 2024-09-18T05:13:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-18T05:13:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_force_trim_to": "0", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_down_reporters": "2", 2024-09-18T05:13:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-18T05:13:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-18T05:13:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-18T05:13:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-18T05:13:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-18T05:13:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-18T05:13:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_report_timeout": "900", 2024-09-18T05:13:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-18T05:13:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-18T05:13:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_stuck_threshold": "60", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-18T05:13:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_probe_timeout": "2.000000", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_max_change": "0.050000", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_max_osds": "4", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_interval": "86400", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_max_keys": "100", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_timeout": "300", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_session_timeout": "300", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_smart_report_timeout": "5", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stat_smooth_intervals": "6", 2024-09-18T05:13:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_pool_min_size": "2", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_pool_size": "4", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_debug": "false", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_provider_kill_at": "0", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_requester_kill_at": "0", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_timeout": "60.000000", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_target_pg_per_osd": "100", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_tick_interval": "5", 2024-09-18T05:13:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_timecheck_interval": "300.000000", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_use_min_delay_socket": "false", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_older_version_delay": "604800", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_misplaced": "false", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_older_version": "true", 2024-09-18T05:13:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "monmap": "", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-18T05:13:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_tracing_enabled": "false", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_op_threads": "3", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_cm": "false", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_device_name": "", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_dscp": "96", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_local_gid": "", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_port_num": "1", 2024-09-18T05:13:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_sl": "3", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_support_srq": "true", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_type": "ib", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_reap_threshold": "5", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_before_connect": "false", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_ipv4": "true", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_ipv6": "false", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_msgr1": "true", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_msgr2": "true", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_port_max": "7568", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_port_min": "6800", 2024-09-18T05:13:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_retry_count": "3", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_retry_delay": "5", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_client": "false", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mds": "false", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mgr": "false", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mon": "false", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_osd": "false", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_client_mode": "crc secure", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_cluster_mode": "crc secure", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_cluster_type": "", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_compress_secure": "false", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_connection_idle_timeout": "900", 2024-09-18T05:13:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_connection_ready_timeout": "10", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_crc_data": "true", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_crc_header": "true", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_bad_msg": "false", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_bug": "true", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_old_message": "true", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_skipped_message": "false", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_coremask": "0xF", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_enable_tso": "true", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-18T05:13:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hugepages": "", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_lro": "true", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_memory_channel": "4", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_pmd": "", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_port_id": "0", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dump_on_send": "false", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_initial_backoff": "0.200000", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_max": "1.000000", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-18T05:13:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_type": "", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_network_congestion": "0", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_socket_failures": "5000", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_learn_addr_from_peer": "true", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_max_accept_failures": "4", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_max_backoff": "15.000000", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_client_mode": "secure crc", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_service_mode": "secure crc", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compress_min_size": "1024", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compress_mode": "none", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-18T05:13:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_pq_min_cost": "65536", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_public_type": "", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_service_mode": "crc secure", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_listen_backlog": "512", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_nodelay": "true", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_rcvbuf": "0", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_type": "async+posix", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "no_config_file": "false", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_completion_locks_per_session": "32", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inflight_ops": "1024", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-18T05:13:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_tick_interval": "5.000000", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_timeout": "10.000000", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "objectstore_blackhole": "false", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "openssl_engine_opts": "", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_delay_time": "5.000000", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_hist_halflife": "1000", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_max_low_ops": "2", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_max_ops": "4", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-18T05:13:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_slop": "0.020000", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_asio_thread_count": "2", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_async_recovery_min_cost": "100", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_scan_max": "512", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_scan_min": "64", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_degraded": "false", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_peering": "false", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_unfound": "true", 2024-09-18T05:13:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_beacon_report_interval": "300", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_duration": "30", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_max_block_size": "67108864", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_blkin_trace_all": "false", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_check_for_log_corruption": "false", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-18T05:13:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_update_on_start": "true", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_message_cap": "256", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_message_size_cap": "524288000", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_op_priority": "63", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_watch_timeout": "30", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_command_max_records": "256", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_compact_on_start": "false", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_update_on_start": "true", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_update_weight_set": "true", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-18T05:13:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_feed_pullee": "-1", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_misdirected_ops": "false", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_no_acting_change": "false", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_no_purge_strays": "false", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_op_order": "false", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-18T05:13:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_shutdown": "false", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_snaps": "false", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_keys": "1024", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-18T05:13:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_stride": "524288", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_default_notify_timeout": "30", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep": "0.000000", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_discard_disconnected_ops": "true", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_enable_op_tracker": "true", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-18T05:13:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_info": "true", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown": "true", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_function_tracing": "false", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_grace": "20", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_interval": "6", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_peers": "10", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_size": "2000", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_stale": "600", 2024-09-18T05:13:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_max_size": "100000", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_min_size": "1000", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal_size": "5120", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_kill_backfill_at": "0", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_cache_size": "50", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_dedup": "true", 2024-09-18T05:13:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_message_max": "40", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_share_max_epochs": "40", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_attr_name_len": "100", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_attr_size": "0", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_backfills": "1", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_markdown_count": "5", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_markdown_period": "600", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_name_len": "2048", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_namespace_len": "256", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_size": "134217728", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_blocked_by": "16", 2024-09-18T05:13:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_log_entries": "10000", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pgls": "1024", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_push_cost": "8388608", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_push_objects": "10", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_scrubs": "3", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_trimming_pgs": "2", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_write_op_reply_len": "64", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_write_size": "90", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-18T05:13:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_profile": "balanced", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-18T05:13:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_base": "805306368", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_cache_min": "134217728", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target": "4294967296", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target_autotune": "false", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_min_pg_log_entries": "250", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_min_recovery_priority": "0", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_report_interval": "5", 2024-09-18T05:13:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_num_cache_shards": "32", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_num_op_tracker_shard": "32", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_auto_affinity": "true", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_node": "-1", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_prefer_iface": "true", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objecter_finishers": "1", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore": "bluestore", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_fuse": "false", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_tracing": "false", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_complaint_time": "30.000000", 2024-09-18T05:13:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_duration": "600", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_size": "20", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_slow_op_size": "20", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_log_threshold": "5", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards": "0", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards_hdd": "5", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards_ssd": "8", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_pq_min_cost": "65536", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-18T05:13:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_queue_cut_off": "high", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_thread_timeout": "15", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_open_classes_on_start": "true", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_os_flags": "0", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_peering_op_priority": "255", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_delete_cost": "1048576", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_delete_priority": "5", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_trim_max": "10000", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_trim_min": "100", 2024-09-18T05:13:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_stat_report_interval_max": "500", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_crimson": "false", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-18T05:13:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flags": "0", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_min_size": "0", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pg_num": "32", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pgp_num": "0", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_size": "2", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_type": "replicated", 2024-09-18T05:13:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_push_per_object_cost": "1000", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recover_clone_overlap": "true", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_cost": "20971520", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active": "0", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-18T05:13:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_single_start": "1", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_op_priority": "3", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_priority": "5", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep": "0.000000", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_repair_during_recovery": "false", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_requested_scrub_priority": "120", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-18T05:13:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_auto_repair": "false", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_begin_hour": "0", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_begin_week_day": "0", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_chunk_max": "25", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_chunk_min": "5", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_cost": "52428800", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_during_recovery": "false", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_end_hour": "0", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_end_week_day": "0", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_event_cost": "4096", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-18T05:13:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_invalid_stats": "true", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_max_preemptions": "5", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_priority": "5", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_reservation_timeout": "5000", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_sleep": "0.000000", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-18T05:13:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_skip_data_digest": "false", 2024-09-18T05:13:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_smart_report_timeout": "5", 2024-09-18T05:13:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_cost": "1048576", 2024-09-18T05:13:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_priority": "5", 2024-09-18T05:13:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-18T05:13:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-18T05:13:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_target_transaction_size": "30", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-18T05:13:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tracing": "false", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_use_stale_snap": "false", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "osdc_blkin_trace_all": "false", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_kill_at": "0", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_max_join_drift": "10", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_min": "500", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_min_wait": "0.050000", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_propose_interval": "1.000000", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_max": "500", 2024-09-18T05:13:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_min": "250", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_stash_full_interval": "25", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_trim_max": "500", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_trim_min": "250", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "perf": "true", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "-", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrv": "", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "public_bind_addr": "-", 2024-09-18T05:13:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "public_network": "", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "public_network_interface": "", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_enabled": "false", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_session_max_number": "256", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_mon_op_timeout": "0", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_osd_op_timeout": "0", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_tracing": "false", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_atime_update_interval": "60", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_balance_parent_reads": "false", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_balance_snap_reads": "false", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blkin_trace_all": "false", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-18T05:13:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache": "true", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_policy": "writearound", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_size": "33554432", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_clone_copy_on_read": "false", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_compression_hint": "none", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_concurrent_management_ops": "10", 2024-09-18T05:13:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_clone_format": "auto", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_data_pool": "", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_features": "61", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_format": "2", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_map_options": "", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_order": "22", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_pool": "rbd", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_stripe_count": "0", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_stripe_unit": "0", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-18T05:13:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_enable_alloc_hint": "true", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_io_scheduler": "simple", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_order": "24", 2024-09-18T05:13:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_pool": "", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_splay_width": "4", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_localize_parent_reads": "false", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_localize_snap_reads": "false", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-18T05:13:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-18T05:13:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mtime_update_interval": "60", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_non_blocking_aio": "true", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_op_thread_timeout": "60", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_op_threads": "1", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_parent_cache_enabled": "false", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-18T05:13:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_plugins": "", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_burst": "0", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_limit": "0", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_exclude_ops": "0", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_burst": "0", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_limit": "0", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-18T05:13:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_read_from_replica_policy": "default", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_skip_partial_discard": "true", 2024-09-18T05:13:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_tracing": "false", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_validate_names": "true", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_validate_pool": "true", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "restapi_base_url": "", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "restapi_log_level": "", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_acl_grants_max_num": "100", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_admin_entry": "admin", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_backend_store": "rados", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_barbican_url": "", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_beast_enable_async": "true", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-18T05:13:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_enabled": "true", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_expiry_interval": "900", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_lru_size": "10000", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_config_store": "rados", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_content_length_compat": "false", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_copy_obj_progress": "true", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cors_rules_max_num": "100", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cross_domain_policy": "", 2024-09-18T05:13:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_addr": "", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_password": "", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_username": "", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_require_ssl": "true", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-18T05:13:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_addr": "", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_auth": "token", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_namespace": "", 2024-09-18T05:13:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_prefix": "", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_token_file": "", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_buffersize": "524288", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_low_speed_time": "300", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-18T05:13:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_changes_size": "1000", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_num_shards": "128", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_window": "30", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-18T05:13:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-18T05:13:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dns_name": "", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dns_s3website_name": "", 2024-09-18T05:13:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dynamic_resharding": "true", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_gc_threads": "true", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_lc_threads": "true", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_ops_log": "false", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_quota_threads": "true", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_static_website": "false", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_usage_log": "false", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enforce_swift_acls": "true", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_exit_timeout_secs": "120", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_expose_bucket": "false", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_extended_http_attrs": "", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_filter": "none", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-18T05:13:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_frontends": "beast port=7480", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_deferred": "50", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_objs": "32", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_processor_period": "3600", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-18T05:13:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_init_timeout": "300", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_domain": "", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_password": "", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_password_path": "", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_project": "", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_tenant": "", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_token": "", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_token_path": "", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_user": "", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_api_version": "2", 2024-09-18T05:13:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_domain": "", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_password": "", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_project": "", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_user": "", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_url": "", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_debug_interval": "-1", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_lock_max_time": "90", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_objs": "32", 2024-09-18T05:13:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_rules": "1000", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_worker": "3", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_thread_delay": "0", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_dnattr": "uid", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_searchfilter": "", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_uri": "ldaps://", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_http_headers": "", 2024-09-18T05:13:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_object_name_utc": "false", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attr_name_len": "0", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attr_size": "0", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_chunk_size": "4194304", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_listing_results": "1000", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_notify_retries": "10", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-18T05:13:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_put_param_size": "1048576", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_put_size": "5368709120", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_slo_entries": "1000", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_md_log_max_shards": "64", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_mp_lock_max_time": "600", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-18T05:13:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_max_gc": "300", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_num_async_rados_threads": "32", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_num_control_oids": "8", 2024-09-18T05:13:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_numa_node": "-1", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_chunk_size": "100", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_gc_interval": "600", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_thread_timeout": "600", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_tracing": "false", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_token": "", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_url": "", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_verify_ssl": "true", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-18T05:13:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_rados": "false", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_socket_path": "", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_push_interval": "2.000000", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_print_continue": "true", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-18T05:13:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_tracing": "false", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm": "", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm_id": "", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_region": "", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_request_uri": "", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_batch_size": "64", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-18T05:13:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_max_aio": "128", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_num_logs": "16", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_thread_interval": "600", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_resolve_cname": "false", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_run_sync_thread": "true", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-18T05:13:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_scheduler_type": "throttler", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_script_uri": "", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_service_provider_name": "", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_client_id": "", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_client_secret": "", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_entry": "sts", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_key": "sts", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_min_session_duration": "900", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_token_introspection_url": "", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_account_in_url": "false", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_auth_entry": "auth", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_auth_url": "", 2024-09-18T05:13:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_custom_header": "", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_need_stats": "true", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_tenant_name": "", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_token_expiration": "86400", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_url": "", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_url_prefix": "swift", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_lease_period": "120", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-18T05:13:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_thread_pool_size": "512", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_comment": "", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_createby": "", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_encoding": "", 2024-09-18T05:13:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_flag": "false", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_origin": "", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_tracker": "", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_trust_forwarded_https": "false", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_max_shards": "32", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_max_user_shards": "1", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_use_opa_authz": "false", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_max_buckets": "1000", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_policies_max_num": "100", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-18T05:13:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_unique_email": "true", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_verify_ssl": "true", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone": "", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone_id": "", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup": "", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup_id": "", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgwlc_auto_session_clear": "true", 2024-09-18T05:13:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_block_size": "4096", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_size": "536870912", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-18T05:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_index_type": "binary_search", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_partition_filters": "false", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_perf": "false", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "run_dir": "/var/run/ceph", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_block_create": "true", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_cache_lru_size": "67108864", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-18T05:13:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_default_max_object_size": "16777216", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_device_size": "53687091200", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_capacity": "16", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_main_device_type": "SSD", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-18T05:13:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_segment_size": "67108864", 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "set_keepcaps": "false", 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "setgroup": "", 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "setuser": "", 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "setuser_match_path": "", 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "thp": "false", 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "threadpool_default_timeout": "60", 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "throttler_perf_counter": "true" 2024-09-18T05:13:43.818 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:43.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-18T05:13:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a: {} 2024-09-18T05:13:43.963 INFO:teuthology.orchestra.run.smithi017.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T05:13:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b: {} 2024-09-18T05:13:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T05:13:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c: {} 2024-09-18T05:13:43.986 INFO:teuthology.orchestra.run.smithi017.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T05:13:44.002 DEBUG:teuthology.orchestra.run.smithi086:> type ceph-objectstore-tool 2024-09-18T05:13:44.008 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T05:13:44.008 DEBUG:teuthology.orchestra.run.smithi017:> type ceph-objectstore-tool 2024-09-18T05:13:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T05:13:44.012 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-18T05:13:44.024 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-18T05:13:44.024 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-18T05:13:44.024 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T05:13:44.024 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:13:44.024 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-18T05:13:44.025 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T05:13:44.025 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T05:13:44.025 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-18T05:13:44.025 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-18T05:13:44.026 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-18T05:13:44.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:13:44.026 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-18T05:13:44.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:13:44.027 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-18T05:13:44.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:13:44.027 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-18T05:13:44.051 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:44.051+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:44.071 INFO:teuthology.orchestra.run.smithi017.stdout:mapped writes DISABLED 2024-09-18T05:13:44.072 INFO:teuthology.orchestra.run.smithi017.stdout:mapped reads DISABLED 2024-09-18T05:13:44.072 INFO:teuthology.orchestra.run.smithi017.stdout:Seed set to 4769 2024-09-18T05:13:44.128 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:44.122+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:44.175 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:44.175 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:13:44.175 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:13:44.175 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:44.181 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:44.181 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T05:13:44.182 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:44.189 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:13:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:13:44.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:13:44.205 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:13:44.205 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:13:44.220 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:13:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:13:44.228 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:44.222+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:44.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:13:44.236 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:13:44.255 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:13:44.255 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:13:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:13:44.274 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:13:44.293 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:13:44.294 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:13:44.313 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:13:44.314 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:13:44.314 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:44.314 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:44.331 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:13:44.332 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:44.327+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:44.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:44.426+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:44.496 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:44.496 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:44.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:13:44.532 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:44.531+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:44.633 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:44.631+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:44.675 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:44.675 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:44.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:13:44.734 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:44.727+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:44.812 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:44.813 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:44.826 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:13:44.834 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:44.831+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:44.870 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:13:44.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:44.930+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:45.124 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:45.124 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:45.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:13:45.133 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:45.126+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:45.225 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:45.223+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:45.264 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:45.264 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:45.279 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:13:45.326 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:45.318+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:45.426 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:45.423+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:45.451 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:45.451 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:45.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:13:45.528 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:45.522+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:45.593 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:45.593 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:45.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:13:45.628 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:45.627+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:45.729 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:45.727+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:45.779 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:45.779 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:45.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:13:45.839 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:45.834+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:45.931 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:45.931+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:45.934 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:45.934 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:45.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:13:46.032 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:46.031+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:46.110 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:46.110 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:46.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:13:46.171 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:46.171+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:46.234 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:46.230+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:46.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:13:46.333 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:13:46.359 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:46.359+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:46.436 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:46.435+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:46.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:13:46.492 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:13:46.492 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:13:46.509 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:13:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:13:46.525 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:13:46.526 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:13:46.539 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:46.539+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:46.543 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:13:46.544 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:13:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:13:46.561 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:13:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:13:46.582 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:13:46.600 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:13:46.601 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:13:46.619 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:13:46.619 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:13:46.621 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:13:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:13:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [] 2024-09-18T05:13:46.621 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:46.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:13:46.679 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:46.679+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:46.740 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:46.734+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:46.796 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:46.796 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:46.796 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:13:46.796 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:46.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:13:46.855 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:46.855+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:46.893 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:13:46.930 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:46.930 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:46.930 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:13:46.931 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:13:46.931 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:46.942 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:46.939+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:46.943 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:13:47.043 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:47.038+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:47.115 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:47.115 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:13:47.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:13:47.115 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:13:47.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.115 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4278.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-18T05:13:47.116 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:35.879621+0000", 2024-09-18T05:13:47.116 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 11.23373608, 2024-09-18T05:13:47.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0078733459999999998, 2024-09-18T05:13:47.116 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:47.116 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:47.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:47.117 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4278", 2024-09-18T05:13:47.117 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/447015652", 2024-09-18T05:13:47.117 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-18T05:13:47.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.117 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:47.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:47.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.879621+0000", 2024-09-18T05:13:47.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.879621+0000", 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.879612+0000", 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999909 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.879659+0000", 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7023e-05 2024-09-18T05:13:47.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.879995+0000", 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000335977 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.880025+0000", 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9980000000000001e-05 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.880552+0000", 2024-09-18T05:13:47.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052778299999999998 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.880846+0000", 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029380500000000001 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 2", 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.881207+0000", 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036060999999999998 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:47.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.883155+0000", 2024-09-18T05:13:47.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019482119999999999 2024-09-18T05:13:47.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.887227+0000", 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040719220000000004 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.887381+0000", 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000153552 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.887494+0000", 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011338899999999999 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.126 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:47.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4278.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:35.882997+0000", 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 11.230359829999999, 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000164399, 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.882997+0000", 2024-09-18T05:13:47.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.882997+0000", 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.882986+0000", 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999895 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.883006+0000", 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0197e-05 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.883033+0000", 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6302999999999999e-05 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.883052+0000", 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9117e-05 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.883132+0000", 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0139e-05 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.883146+0000", 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3963e-05 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.883161+0000", 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5290000000000001e-05 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4278.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:35.891889+0000", 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 11.221467534, 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039468000000000001, 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:47.132 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4278", 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/447015652", 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.891889+0000", 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.891889+0000", 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.891887+0000", 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:47.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.891901+0000", 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3835999999999999e-05 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.891933+0000", 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1943000000000002e-05 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.891948+0000", 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.499e-05 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.892069+0000", 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012155900000000001 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.892284+0000", 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021461900000000001 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4278.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:35.892779+0000", 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 11.220577655, 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033066399999999999, 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4278", 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/447015652", 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 3 2024-09-18T05:13:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.892779+0000", 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.892779+0000", 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.892777+0000", 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.892789+0000", 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1773999999999999e-05 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.892821+0000", 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2356e-05 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.892839+0000", 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8113000000000001e-05 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.892914+0000", 2024-09-18T05:13:47.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4852999999999996e-05 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:35.893110+0000", 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019580800000000001 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.141 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4278.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:36.884440+0000", 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.228917128000001, 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031713850000000001, 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4278", 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/447015652", 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 5 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.884440+0000", 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.884440+0000", 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.884437+0000", 2024-09-18T05:13:47.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.884455+0000", 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8087000000000001e-05 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.884487+0000", 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2286000000000002e-05 2024-09-18T05:13:47.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.884504+0000", 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7017e-05 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.884668+0000", 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016424899999999999 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.884882+0000", 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021371500000000001 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.885097+0000", 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214441 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.886617+0000", 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015203619999999999 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887465+0000", 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084766699999999997 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887544+0000", 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9886000000000001e-05 2024-09-18T05:13:47.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887611+0000", 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6549000000000003e-05 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4278.0:5 2.2 e20/18 ondisk, result = 0)", 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:36.887319+0000", 2024-09-18T05:13:47.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.226038141, 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030579199999999999, 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887319+0000", 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887319+0000", 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887316+0000", 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887329+0000", 2024-09-18T05:13:47.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.202e-05 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887358+0000", 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9543000000000002e-05 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887372+0000", 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3654e-05 2024-09-18T05:13:47.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887440+0000", 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7872000000000003e-05 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887455+0000", 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5037e-05 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:36.887624+0000", 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016974899999999999 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4278.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:37.892059+0000", 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.2212980160000004, 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073110040000000003, 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4278", 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/447015652", 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.892059+0000", 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.892059+0000", 2024-09-18T05:13:47.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.892055+0000", 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999962 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.892073+0000", 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8193e-05 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:47.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.892113+0000", 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9845999999999998e-05 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.892131+0000", 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.766e-05 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.892258+0000", 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012728899999999999 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.892269+0000", 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.114e-05 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.895572+0000", 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033028179999999999 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.895724+0000", 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015221500000000001 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.895946+0000", 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022214500000000001 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898462+0000", 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025153409999999999 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.899165+0000", 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070384400000000002 2024-09-18T05:13:47.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.899249+0000", 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3653999999999996e-05 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.899370+0000", 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012060199999999999 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4278.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:37.898308+0000", 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.2150488510000006, 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015976599999999999, 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898308+0000", 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:47.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898308+0000", 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898306+0000", 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898319+0000", 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898342+0000", 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3286999999999999e-05 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898356+0000", 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3723000000000001e-05 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898438+0000", 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1892999999999997e-05 2024-09-18T05:13:47.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898453+0000", 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.486e-05 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:37.898468+0000", 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4902999999999999e-05 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:47.163 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:47.165 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:13:47.166 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:47.158+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:47.267 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:47.262+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:47.282 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:47.283 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:47.283 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:13:47.284 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:47.296 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:13:47.367 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:47.362+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:47.414 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:47.415 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:47.415 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:13:47.415 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:13:47.415 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:47.429 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:13:47.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:47.462+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:47.564 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:47.564 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:13:47.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:13:47.565 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [] 2024-09-18T05:13:47.565 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:47.569 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:47.567+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:47.578 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:13:47.676 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:47.675+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:47.751 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:47.752 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:47.752 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:13:47.752 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:47.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:13:47.810 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:47.807+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:47.873 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:47.871+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:13:47.939 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:47.940 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:47.940 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:13:47.940 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:13:47.940 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:47.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:13:47.999 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:47.999+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:48.074 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:48.071+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:48.127 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:48.128 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:13:48.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:13:48.128 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:13:48.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.128 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.128 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:29.904983+0000", 2024-09-18T05:13:48.129 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.217101127999999, 2024-09-18T05:13:48.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01220135, 2024-09-18T05:13:48.129 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.129 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.130 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35 2024-09-18T05:13:48.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.130 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.904983+0000", 2024-09-18T05:13:48.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.904983+0000", 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.904982+0000", 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905077+0000", 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4319000000000003e-05 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905095+0000", 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905103+0000", 2024-09-18T05:13:48.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.157e-06 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.912758+0000", 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076545909999999997 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.912885+0000", 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012714900000000001 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.913096+0000", 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021136399999999999 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.916929+0000", 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003833028 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917016+0000", 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6876e-05 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917090+0000", 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4416e-05 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917184+0000", 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4103000000000003e-05 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.135 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:29.905113+0000", 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.216971332, 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012416471, 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905113+0000", 2024-09-18T05:13:48.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905113+0000", 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905112+0000", 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905119+0000", 2024-09-18T05:13:48.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.63e-06 2024-09-18T05:13:48.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905129+0000", 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0413e-05 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905136+0000", 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.914040+0000", 2024-09-18T05:13:48.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0089039210000000004 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.914284+0000", 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024426100000000001 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.914644+0000", 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035931100000000002 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917290+0000", 2024-09-18T05:13:48.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002646036 2024-09-18T05:13:48.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917343+0000", 2024-09-18T05:13:48.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3334000000000001e-05 2024-09-18T05:13:48.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917455+0000", 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112309 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917529+0000", 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3938999999999998e-05 2024-09-18T05:13:48.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.216939891999999, 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012895202999999999, 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.148 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905150+0000", 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4169999999999997e-06 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905160+0000", 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8900000000000002e-06 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905167+0000", 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3459999999999996e-06 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.915797+0000", 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010629932 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.916005+0000", 2024-09-18T05:13:48.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020727500000000001 2024-09-18T05:13:48.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.916381+0000", 2024-09-18T05:13:48.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000376077 2024-09-18T05:13:48.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917556+0000", 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001175117 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917913+0000", 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035677099999999998 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917987+0000", 2024-09-18T05:13:48.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4176000000000003e-05 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.918040+0000", 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2859000000000003e-05 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.010011+0000", 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.112072795, 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011831105, 2024-09-18T05:13:48.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 87 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010011+0000", 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010011+0000", 2024-09-18T05:13:48.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010011+0000", 2024-09-18T05:13:48.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010099+0000", 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8159999999999996e-05 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010112+0000", 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3322999999999999e-05 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010120+0000", 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.123e-06 2024-09-18T05:13:48.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.018279+0000", 2024-09-18T05:13:48.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081583100000000002 2024-09-18T05:13:48.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.018401+0000", 2024-09-18T05:13:48.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122316 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.018587+0000", 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018601800000000001 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021156+0000", 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025685669999999999 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021670+0000", 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000514143 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021775+0000", 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000104893 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021843+0000", 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7941999999999994e-05 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.010131+0000", 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.111953638999999, 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012246778999999999, 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.162 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010131+0000", 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010131+0000", 2024-09-18T05:13:48.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010130+0000", 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010136+0000", 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4099999999999996e-06 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010146+0000", 2024-09-18T05:13:48.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010153+0000", 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1439999999999997e-06 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.019673+0000", 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095191459999999992 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.019905+0000", 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000231905 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.020299+0000", 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039469700000000001 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021883+0000", 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015842709999999999 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.022268+0000", 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038488699999999999 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.022331+0000", 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2446999999999994e-05 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.022377+0000", 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6576000000000003e-05 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186194+0000", 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.935890108999999, 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012352007999999999, 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 108 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.168 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186194+0000", 2024-09-18T05:13:48.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186194+0000", 2024-09-18T05:13:48.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186193+0000", 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186204+0000", 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1080000000000001e-05 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186219+0000", 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.49e-05 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186228+0000", 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8829999999999995e-06 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.192601+0000", 2024-09-18T05:13:48.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063730080000000003 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.192839+0000", 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000238321 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.193242+0000", 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00040319100000000001 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.195847+0000", 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026052860000000001 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198422+0000", 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025744560000000001 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198487+0000", 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5712999999999999e-05 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198546+0000", 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8653000000000002e-05 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186238+0000", 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.935846058999999, 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014154981000000001, 2024-09-18T05:13:48.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 109 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186238+0000", 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186238+0000", 2024-09-18T05:13:48.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186237+0000", 2024-09-18T05:13:48.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:48.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186343+0000", 2024-09-18T05:13:48.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105689 2024-09-18T05:13:48.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186369+0000", 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5833000000000002e-05 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186385+0000", 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5665999999999999e-05 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.193898+0000", 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075130570000000001 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.194123+0000", 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022571099999999999 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.194474+0000", 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035039700000000001 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197381+0000", 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029071539999999999 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200249+0000", 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028681309999999999 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200334+0000", 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4662999999999999e-05 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200393+0000", 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9490000000000001e-05 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186412+0000", 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.935672057000001, 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014201561, 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 110 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.184 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186412+0000", 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186412+0000", 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186411+0000", 2024-09-18T05:13:48.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186427+0000", 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5800000000000001e-05 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186451+0000", 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4343000000000001e-05 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186467+0000", 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5843999999999999e-05 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.196299+0000", 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0098316940000000002 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.196520+0000", 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022157399999999999 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.196715+0000", 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000194923 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200099+0000", 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00338405 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200409+0000", 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030929699999999999 2024-09-18T05:13:48.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200518+0000", 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000109496 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200614+0000", 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5747000000000003e-05 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.190 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.190 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:48.190 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.935605868, 2024-09-18T05:13:48.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016756455, 2024-09-18T05:13:48.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.190 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 111 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186484+0000", 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7139999999999996e-06 2024-09-18T05:13:48.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186499+0000", 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4269e-05 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186506+0000", 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8669999999999994e-06 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197488+0000", 2024-09-18T05:13:48.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010982016000000001 2024-09-18T05:13:48.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197636+0000", 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014748499999999999 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197836+0000", 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020046800000000001 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200231+0000", 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023946789999999998 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202993+0000", 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027621820000000002 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203142+0000", 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000149016 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203235+0000", 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2528999999999994e-05 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186515+0000", 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.935569135000001, 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019640996000000001, 2024-09-18T05:13:48.197 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.198 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.198 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.198 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.198 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.198 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 112 2024-09-18T05:13:48.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.198 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186515+0000", 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186515+0000", 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186514+0000", 2024-09-18T05:13:48.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186634+0000", 2024-09-18T05:13:48.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119313 2024-09-18T05:13:48.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186648+0000", 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4073000000000001e-05 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186656+0000", 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.96e-06 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198658+0000", 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012002281 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198895+0000", 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023678499999999999 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.199247+0000", 2024-09-18T05:13:48.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035217000000000001 2024-09-18T05:13:48.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202824+0000", 2024-09-18T05:13:48.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035771000000000002 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.205884+0000", 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030599160000000002 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206051+0000", 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000166942 2024-09-18T05:13:48.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206156+0000", 2024-09-18T05:13:48.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105103 2024-09-18T05:13:48.205 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.205 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.205 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.206 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.206 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186666+0000", 2024-09-18T05:13:48.206 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.935417933, 2024-09-18T05:13:48.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019649272999999998, 2024-09-18T05:13:48.206 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.206 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.206 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 113 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186666+0000", 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186666+0000", 2024-09-18T05:13:48.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186665+0000", 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186672+0000", 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4840000000000001e-06 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186683+0000", 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0943e-05 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186690+0000", 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0999999999999998e-06 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200728+0000", 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014037979000000001 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200914+0000", 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018574800000000001 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.201111+0000", 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019744900000000001 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202966+0000", 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001854446 2024-09-18T05:13:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206180+0000", 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032147249999999999 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206267+0000", 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6471999999999995e-05 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206316+0000", 2024-09-18T05:13:48.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8797000000000001e-05 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.935385805999999, 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019931250000000001, 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 114 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186705+0000", 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3329999999999999e-06 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186715+0000", 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.023e-05 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186724+0000", 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9039999999999998e-06 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.201723+0000", 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014999164000000001 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.201963+0000", 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239445 2024-09-18T05:13:48.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202179+0000", 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021625799999999999 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206421+0000", 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042421539999999997 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206522+0000", 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101149 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206583+0000", 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0890000000000001e-05 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206630+0000", 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6353000000000002e-05 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.217 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186733+0000", 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.93535163, 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020010613, 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 115 2024-09-18T05:13:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186733+0000", 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186733+0000", 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186732+0000", 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186823+0000", 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1065999999999999e-05 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186840+0000", 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6523000000000001e-05 2024-09-18T05:13:48.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186849+0000", 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2739999999999996e-06 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203297+0000", 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016448536 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203447+0000", 2024-09-18T05:13:48.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014955200000000001 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203687+0000", 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000240335 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206509+0000", 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028219120000000002 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206644+0000", 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000135079 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206701+0000", 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6975999999999998e-05 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206743+0000", 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2002999999999997e-05 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.223 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186859+0000", 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.935225260999999, 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.021478490999999999, 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 116 2024-09-18T05:13:48.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186859+0000", 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186859+0000", 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186858+0000", 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186866+0000", 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5270000000000001e-06 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186876+0000", 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.029e-05 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186883+0000", 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.204534+0000", 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.017650795 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.204824+0000", 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029052400000000001 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.205223+0000", 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000398687 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206942+0000", 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00171923 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208154+0000", 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012111769999999999 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208280+0000", 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012694900000000001 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208337+0000", 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6999000000000001e-05 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.229 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.935191001, 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023698894000000002, 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 117 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186899+0000", 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3799999999999999e-06 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186909+0000", 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0149999999999999e-05 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186916+0000", 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.187e-06 2024-09-18T05:13:48.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206985+0000", 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020068236 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.207114+0000", 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012908900000000001 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.207328+0000", 2024-09-18T05:13:48.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021484100000000001 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208413+0000", 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010848050000000001 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.210466+0000", 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020526469999999999 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.210539+0000", 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2669999999999994e-05 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.210592+0000", 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3545999999999999e-05 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.689855+0000", 2024-09-18T05:13:48.235 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.432229658000001, 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012288926, 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 137 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689855+0000", 2024-09-18T05:13:48.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689855+0000", 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689854+0000", 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689957+0000", 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103334 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689971+0000", 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3954000000000001e-05 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689979+0000", 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695002+0000", 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050229230000000003 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695050+0000", 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8072000000000003e-05 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695119+0000", 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9473000000000004e-05 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697663+0000", 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025433610000000001 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702096+0000", 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044332750000000004 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702123+0000", 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7203e-05 2024-09-18T05:13:48.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702144+0000", 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0414000000000001e-05 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.432093906999999, 2024-09-18T05:13:48.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012392172, 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 138 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689996+0000", 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3810000000000004e-06 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690007+0000", 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0797e-05 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690014+0000", 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0890000000000002e-06 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695656+0000", 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056421850000000001 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695703+0000", 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6777999999999998e-05 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695784+0000", 2024-09-18T05:13:48.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0951999999999993e-05 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697665+0000", 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018816880000000001 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702240+0000", 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004574219 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702326+0000", 2024-09-18T05:13:48.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6006000000000003e-05 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702383+0000", 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6815999999999999e-05 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:48.247 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.432059031000001, 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01244515, 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 139 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690031+0000", 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9009999999999999e-06 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690040+0000", 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2969999999999992e-06 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690047+0000", 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8850000000000001e-06 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696069+0000", 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060226610000000003 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696117+0000", 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7169999999999997e-05 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696194+0000", 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7748000000000002e-05 2024-09-18T05:13:48.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.698074+0000", 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018799979999999999 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702422+0000", 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043472739999999999 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702448+0000", 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6707e-05 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702470+0000", 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2076999999999999e-05 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.690081+0000", 2024-09-18T05:13:48.253 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.432003704, 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012557894, 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 140 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690081+0000", 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690081+0000", 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690080+0000", 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690156+0000", 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5827000000000004e-05 2024-09-18T05:13:48.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690167+0000", 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1287000000000001e-05 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690179+0000", 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2157999999999999e-05 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696481+0000", 2024-09-18T05:13:48.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063017280000000004 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696539+0000", 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7818000000000001e-05 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696609+0000", 2024-09-18T05:13:48.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0358000000000006e-05 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.698078+0000", 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014688959999999999 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702522+0000", 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044438530000000002 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702590+0000", 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7926e-05 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702638+0000", 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8593e-05 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:48.259 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.690191+0000", 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.431893590000001, 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012801359, 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 141 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690191+0000", 2024-09-18T05:13:48.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690191+0000", 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690190+0000", 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:48.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690199+0000", 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6859999999999995e-06 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690216+0000", 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7285000000000001e-05 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690223+0000", 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5020000000000003e-06 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:48.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697194+0000", 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069710739999999998 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697244+0000", 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9363999999999997e-05 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697334+0000", 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0617000000000003e-05 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.698661+0000", 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013270490000000001 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702944+0000", 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042830029999999996 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702971+0000", 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6869999999999999e-05 2024-09-18T05:13:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702992+0000", 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0687999999999999e-05 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:48.265 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:48.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:13:48.267 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:48.262+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:48.368 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:48.362+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:48.404 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:48.404 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:13:48.405 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:13:48.405 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:48.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:13:48.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:48.502+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:48.570 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:48.562+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:48.582 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:13:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:13:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:13:48.582 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:48.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:13:48.638 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:13:48.689 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:48.682+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:29.903621+0000", 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.846147958, 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024588180000000002, 2024-09-18T05:13:48.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.903621+0000", 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.903621+0000", 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.903619+0000", 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.903632+0000", 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.289e-05 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.903662+0000", 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0043e-05 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.903675+0000", 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2926e-05 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.903774+0000", 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9432999999999995e-05 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.903809+0000", 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4932999999999999e-05 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.906025+0000", 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022160399999999999 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.906079+0000", 2024-09-18T05:13:48.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4196000000000001e-05 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'18)", 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:29.910337+0000", 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.839431658999999, 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002347652, 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.910337+0000", 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.910337+0000", 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.910335+0000", 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.910450+0000", 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114706 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.910478+0000", 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7983e-05 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.910504+0000", 2024-09-18T05:13:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5697000000000001e-05 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.910576+0000", 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2222000000000001e-05 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.910615+0000", 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9167e-05 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.912599+0000", 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019842549999999999 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.912685+0000", 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5146000000000001e-05 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-18T05:13:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:29.945968+0000", 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.803800714000001, 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025513829999999999, 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.945968+0000", 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.945968+0000", 2024-09-18T05:13:48.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.945966+0000", 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.945980+0000", 2024-09-18T05:13:48.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3662999999999999e-05 2024-09-18T05:13:48.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.946017+0000", 2024-09-18T05:13:48.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7268999999999998e-05 2024-09-18T05:13:48.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.946032+0000", 2024-09-18T05:13:48.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-18T05:13:48.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.946162+0000", 2024-09-18T05:13:48.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-18T05:13:48.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.946194+0000", 2024-09-18T05:13:48.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2466999999999999e-05 2024-09-18T05:13:48.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.948447+0000", 2024-09-18T05:13:48.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022524860000000002 2024-09-18T05:13:48.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.948519+0000", 2024-09-18T05:13:48.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2385999999999994e-05 2024-09-18T05:13:48.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.771 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.772 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-18T05:13:48.772 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:29.947378+0000", 2024-09-18T05:13:48.772 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.802390762000002, 2024-09-18T05:13:48.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025029470000000002, 2024-09-18T05:13:48.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.772 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.947378+0000", 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.947378+0000", 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.947376+0000", 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.947434+0000", 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8105e-05 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.947458+0000", 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4239999999999998e-05 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.947469+0000", 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0910000000000001e-05 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.947596+0000", 2024-09-18T05:13:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:13:48.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.947632+0000", 2024-09-18T05:13:48.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6627e-05 2024-09-18T05:13:48.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.949806+0000", 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021740560000000002 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:29.949881+0000", 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4382999999999996e-05 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-18T05:13:48.777 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.010188+0000", 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.739580076999999, 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024478880000000001, 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.010188+0000", 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.010188+0000", 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.010186+0000", 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.010256+0000", 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9839000000000007e-05 2024-09-18T05:13:48.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.010288+0000", 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.129e-05 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.010302+0000", 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4323e-05 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.010362+0000", 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9735999999999999e-05 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.010400+0000", 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7889999999999998e-05 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.012545+0000", 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002145447 2024-09-18T05:13:48.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.012636+0000", 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1378999999999994e-05 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:87 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'57, mlcod=16'54)", 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.015881+0000", 2024-09-18T05:13:48.782 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.733887244000002, 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024419939999999998, 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.015881+0000", 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.015881+0000", 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.015880+0000", 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.015930+0000", 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0834000000000002e-05 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.015958+0000", 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7821999999999999e-05 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.015971+0000", 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2486999999999999e-05 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.016043+0000", 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2383000000000001e-05 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.016079+0000", 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5902999999999998e-05 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.018239+0000", 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021594769999999999 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.018323+0000", 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4732000000000001e-05 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.688694+0000", 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.061074600000001, 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049830450000000002, 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.688694+0000", 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.688694+0000", 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.688692+0000", 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.688844+0000", 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152039 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.688880+0000", 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.574e-05 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.688899+0000", 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9076000000000002e-05 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.688970+0000", 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1792999999999995e-05 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689005+0000", 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4972999999999999e-05 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693587+0000", 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045819320000000004 2024-09-18T05:13:48.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693677+0000", 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9579000000000004e-05 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:132 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'90, mlcod=16'85)", 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.689477+0000", 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.060291646, 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064718670000000001, 2024-09-18T05:13:48.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689477+0000", 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689477+0000", 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689475+0000", 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689491+0000", 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5909e-05 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689522+0000", 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1390000000000003e-05 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689544+0000", 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1607000000000002e-05 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690093+0000", 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054960899999999995 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690127+0000", 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3436000000000003e-05 2024-09-18T05:13:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.695896+0000", 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057689860000000003 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.695949+0000", 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2880000000000002e-05 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:133 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'91, mlcod=16'86)", 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.690067+0000", 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.059702034000001, 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059184950000000002, 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690067+0000", 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690067+0000", 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690065+0000", 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690077+0000", 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1956e-05 2024-09-18T05:13:48.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690097+0000", 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9749999999999999e-05 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690109+0000", 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2119999999999999e-05 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690709+0000", 2024-09-18T05:13:48.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00060067900000000001 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690767+0000", 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7286e-05 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.695954+0000", 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051873900000000001 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.695985+0000", 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0867000000000001e-05 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'86)", 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.690708+0000", 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.059060295999998, 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064946140000000001, 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.800 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690708+0000", 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690708+0000", 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690707+0000", 2024-09-18T05:13:48.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690762+0000", 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5380000000000002e-05 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690782+0000", 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9966000000000002e-05 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690794+0000", 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1643e-05 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691599+0000", 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00080475100000000003 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691638+0000", 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697145+0000", 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055077549999999996 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697203+0000", 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7499e-05 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.804 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:135 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'93, mlcod=16'86)", 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.691359+0000", 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.058409746999999, 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058856109999999998, 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691359+0000", 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691359+0000", 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691357+0000", 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691369+0000", 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1714e-05 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691389+0000", 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0046000000000001e-05 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691400+0000", 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0643e-05 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692716+0000", 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001316263 2024-09-18T05:13:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692778+0000", 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2106999999999993e-05 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697208+0000", 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044302760000000004 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697244+0000", 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6086e-05 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:136 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'94, mlcod=16'87)", 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.691893+0000", 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.057875648, 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053826849999999999, 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691893+0000", 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691893+0000", 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691892+0000", 2024-09-18T05:13:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691907+0000", 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.508e-05 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691925+0000", 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8593e-05 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691936+0000", 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0319000000000001e-05 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693813+0000", 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018771199999999999 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693883+0000", 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0118999999999997e-05 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697248+0000", 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033654779999999999 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697276+0000", 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7236000000000001e-05 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:137 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'95, mlcod=16'87)", 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.692355+0000", 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.057413968999999, 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0065518970000000001, 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692355+0000", 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692355+0000", 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692352+0000", 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692478+0000", 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012573900000000001 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692502+0000", 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3689999999999998e-05 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692516+0000", 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.399e-05 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694770+0000", 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00225391 2024-09-18T05:13:48.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694828+0000", 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8449000000000002e-05 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698856+0000", 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040273890000000001 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698906+0000", 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0909999999999999e-05 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:138 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'96, mlcod=16'87)", 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.693043+0000", 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.056725926999999, 2024-09-18T05:13:48.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058985920000000002, 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693043+0000", 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693043+0000", 2024-09-18T05:13:48.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693041+0000", 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693055+0000", 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.394e-05 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693079+0000", 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4583000000000002e-05 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693092+0000", 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.276e-05 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.696062+0000", 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029703680000000001 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.696097+0000", 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4962999999999997e-05 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698912+0000", 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028141709999999999 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698941+0000", 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9614000000000001e-05 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:139 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'97, mlcod=16'87)", 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.693351+0000", 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.056417659000001, 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056155429999999998, 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.823 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693351+0000", 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693351+0000", 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693350+0000", 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693363+0000", 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3243e-05 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693380+0000", 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.755e-05 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693459+0000", 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8466000000000004e-05 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.696639+0000", 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031796530000000002 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.696672+0000", 2024-09-18T05:13:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3812000000000001e-05 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698943+0000", 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00227057 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698966+0000", 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3526000000000001e-05 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:140 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'98, mlcod=16'87)", 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.693865+0000", 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.055903535999999, 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051968029999999998, 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693865+0000", 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693865+0000", 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693860+0000", 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999948 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693970+0000", 2024-09-18T05:13:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110363 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693995+0000", 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5375999999999999e-05 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694007+0000", 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1732999999999999e-05 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697336+0000", 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033287379999999999 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697380+0000", 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3752999999999999e-05 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.699028+0000", 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016488239999999999 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.699062+0000", 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3380000000000002e-05 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:141 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'99, mlcod=16'87)", 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.694566+0000", 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.055203029000001, 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052206700000000002, 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694566+0000", 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694566+0000", 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694564+0000", 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694577+0000", 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.383e-05 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694601+0000", 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3986999999999999e-05 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694614+0000", 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2156e-05 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698323+0000", 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037098320000000001 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698353+0000", 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9053000000000001e-05 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.699750+0000", 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013979660000000001 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.699786+0000", 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5695999999999998e-05 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:142 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'100, mlcod=16'98)", 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.700839+0000", 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.048929080000001, 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003274824, 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.700839+0000", 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.700839+0000", 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.700833+0000", 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999938 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.700901+0000", 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7595999999999995e-05 2024-09-18T05:13:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.700928+0000", 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7019999999999999e-05 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.700941+0000", 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2819999999999999e-05 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701081+0000", 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140562 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701121+0000", 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0067000000000001e-05 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.704015+0000", 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002893217 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.704114+0000", 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9579000000000003e-05 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:143 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'101, mlcod=16'98)", 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.701298+0000", 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.048470231, 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028582109999999998, 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701298+0000", 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701298+0000", 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701297+0000", 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701385+0000", 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8376999999999998e-05 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701403+0000", 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7876e-05 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701413+0000", 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7769999999999997e-06 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701756+0000", 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034276100000000002 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701793+0000", 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7126000000000003e-05 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.704123+0000", 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023298680000000001 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.704157+0000", 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3843000000000001e-05 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:144 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'102, mlcod=16'98)", 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.701911+0000", 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.047857992000001, 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022798559999999998, 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701911+0000", 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701911+0000", 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.701909+0000", 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.702028+0000", 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119153 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.702056+0000", 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8515999999999999e-05 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.702074+0000", 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7566000000000001e-05 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.702497+0000", 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042318400000000001 2024-09-18T05:13:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.702535+0000", 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7613000000000001e-05 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.704159+0000", 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00162455 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.704190+0000", 2024-09-18T05:13:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1084000000000003e-05 2024-09-18T05:13:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:48.850 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:48.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:13:48.852 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:13:48.852 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:13:48.852 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:13:48.853 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:13:48.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:13:48.853 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:13:48.854 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:13:48.854 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:13:48.854 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:13:48.854 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:13:48.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:48.846+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:48.860 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:13:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:13:48.880 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:13:48.880 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:13:48.900 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:13:48.900 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:13:48.953 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:48.951+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:48.976 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:48.976 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:48.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:13:49.053 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:49.051+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:49.105 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:49.106 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:49.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:13:49.165 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:49.158+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:49.195 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T05:13:49.195 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:13:49.195 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-18T05:13:49.195 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T05:13:49.195 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T05:13:49.195 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-18T05:13:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:49.242 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:13:49.255 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:49.255+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:49.327 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "" 2024-09-18T05:13:49.327 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:49.356 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:49.350+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:49.416 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:49.416 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:49.429 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:13:49.457 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:49.455+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:49.558 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:49.550+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:49.583 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:49.583 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:49.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:13:49.683 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:49.678+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:49.760 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:49.759+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:49.766 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:49.766 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:49.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:13:49.836 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:49.836 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:49.836 INFO:teuthology.orchestra.run.smithi017.stdout:skipping zero size read 2024-09-18T05:13:49.847 INFO:teuthology.orchestra.run.smithi017.stdout:6 write 0x12baa56 thru 0x12c0278 (0x5823 bytes) 2024-09-18T05:13:49.854 INFO:teuthology.orchestra.run.smithi017.stdout:7 read 0x6fa14e thru 0x707bd9 (0xda8c bytes) 2024-09-18T05:13:49.861 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:49.859+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:49.871 INFO:teuthology.orchestra.run.smithi017.stdout:9 writesame 0x870be13 thru 0x87143d7 data_size 0x9(0x85c5 bytes) 2024-09-18T05:13:49.871 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:49.871 INFO:teuthology.orchestra.run.smithi017.stdout:11 writesame 0x5cf437b thru 0x5cf8f5a data_size 0x10(0x4be0 bytes) 2024-09-18T05:13:49.876 INFO:teuthology.orchestra.run.smithi017.stdout:12 punch from 0xd84ba7 to 0xd90e02, (0xc25b bytes) 2024-09-18T05:13:49.877 INFO:teuthology.orchestra.run.smithi017.stdout:14 punch from 0x116e120 to 0x1172ad4, (0x49b4 bytes) 2024-09-18T05:13:49.877 INFO:teuthology.orchestra.run.smithi017.stdout:15 read 0x65360a5 thru 0x6538025 (0x1f81 bytes) 2024-09-18T05:13:49.877 INFO:teuthology.orchestra.run.smithi017.stdout:16 punch from 0x82fb224 to 0x830a954, (0xf730 bytes) 2024-09-18T05:13:49.877 INFO:teuthology.orchestra.run.smithi017.stdout:17 read 0x5c01b51 thru 0x5c02dc6 (0x1276 bytes) 2024-09-18T05:13:49.877 INFO:teuthology.orchestra.run.smithi017.stdout:21 write 0x76ab019 thru 0x76b3684 (0x866c bytes) 2024-09-18T05:13:49.883 INFO:teuthology.orchestra.run.smithi017.stdout:22 write 0x5e53bc8 thru 0x5e545df (0xa18 bytes) 2024-09-18T05:13:49.885 INFO:teuthology.orchestra.run.smithi017.stdout:23 writesame 0xb56f77 thru 0xb5dd85 data_size 0x19(0x6e0f bytes) 2024-09-18T05:13:49.892 INFO:teuthology.orchestra.run.smithi017.stdout:25 punch from 0x7c47f13 to 0x7c56605, (0xe6f2 bytes) 2024-09-18T05:13:49.892 INFO:teuthology.orchestra.run.smithi017.stdout:26 punch from 0x34da6e2 to 0x34ea295, (0xfbb3 bytes) 2024-09-18T05:13:49.892 INFO:teuthology.orchestra.run.smithi017.stdout:truncating to largest ever: 0xcc8db3b 2024-09-18T05:13:49.897 INFO:teuthology.orchestra.run.smithi017.stdout:28 trunc from 0x87143d8 to 0xcc8db3b 2024-09-18T05:13:49.904 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:49.904 INFO:teuthology.orchestra.run.smithi017.stdout:30 read 0x9e97a25 thru 0x9e9deb7 (0x6493 bytes) 2024-09-18T05:13:49.904 INFO:teuthology.orchestra.run.smithi017.stdout:32 write 0x41ae90c thru 0x41b11d9 (0x28ce bytes) 2024-09-18T05:13:49.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:13:49.909 INFO:teuthology.orchestra.run.smithi017.stdout:34 punch from 0x7e6720f to 0x7e72a00, (0xb7f1 bytes) 2024-09-18T05:13:49.909 INFO:teuthology.orchestra.run.smithi017.stdout:37 writesame 0x1f19889 thru 0x1f213f7 data_size 0x3(0x7b6f bytes) 2024-09-18T05:13:49.922 INFO:teuthology.orchestra.run.smithi017.stdout:38 writesame 0x32afd7f thru 0x32b9f13 data_size 0x1(0xa195 bytes) 2024-09-18T05:13:49.946 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:49.946 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:49.960 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:13:49.983 INFO:teuthology.orchestra.run.smithi017.stdout:39 write 0xd16165b thru 0xd16ba38 (0xa3de bytes) 2024-09-18T05:13:49.983 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:49.978+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:49.989 INFO:teuthology.orchestra.run.smithi017.stdout:41 write 0xb3ac16 thru 0xb45eb7 (0xb2a2 bytes) 2024-09-18T05:13:49.990 INFO:teuthology.orchestra.run.smithi017.stdout:42 punch from 0x44b7dde to 0x44b8c90, (0xeb2 bytes) 2024-09-18T05:13:50.004 INFO:teuthology.orchestra.run.smithi017.stdout:43 trunc from 0xd16ba39 to 0x67a1a89 2024-09-18T05:13:50.021 INFO:teuthology.orchestra.run.smithi017.stdout:44 writesame 0x445e4cc thru 0x4465f3a data_size 0x1(0x7a6f bytes) 2024-09-18T05:13:50.044 INFO:teuthology.orchestra.run.smithi017.stdout:45 read 0x661435d thru 0x6616542 (0x21e6 bytes) 2024-09-18T05:13:50.044 INFO:teuthology.orchestra.run.smithi017.stdout:47 read 0x4438b79 thru 0x4448322 (0xf7aa bytes) 2024-09-18T05:13:50.059 INFO:teuthology.orchestra.run.smithi017.stdout:48 write 0xb644709 thru 0xb645353 (0xc4b bytes) 2024-09-18T05:13:50.063 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:50.063+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:50.064 INFO:teuthology.orchestra.run.smithi017.stdout:50 punch from 0x63f2006 to 0x63ff43a, (0xd434 bytes) 2024-09-18T05:13:50.065 INFO:teuthology.orchestra.run.smithi017.stdout:51 write 0x44ce152 thru 0x44d6b93 (0x8a42 bytes) 2024-09-18T05:13:50.067 INFO:teuthology.orchestra.run.smithi017.stdout:52 writesame 0x457f5f2 thru 0x45842e4 data_size 0x1(0x4cf3 bytes) 2024-09-18T05:13:50.076 INFO:teuthology.orchestra.run.smithi017.stdout:53 read 0x658566 thru 0x666e9e (0xe939 bytes) 2024-09-18T05:13:50.089 INFO:teuthology.orchestra.run.smithi017.stdout:54 trunc from 0xb645354 to 0x2a2cdd7 2024-09-18T05:13:50.109 INFO:teuthology.orchestra.run.smithi017.stdout:55 trunc from 0x2a2cdd7 to 0x3767ff8 2024-09-18T05:13:50.111 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:50.111 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:50.117 INFO:teuthology.orchestra.run.smithi017.stdout:57 writesame 0x28d7a72 thru 0x28e4126 data_size 0x2b(0xc6b5 bytes) 2024-09-18T05:13:50.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:13:50.132 INFO:teuthology.orchestra.run.smithi017.stdout:58 trunc from 0x3767ff8 to 0xa27f63c 2024-09-18T05:13:50.140 INFO:teuthology.orchestra.run.smithi017.stdout:60 read 0x9038730 thru 0x903d326 (0x4bf7 bytes) 2024-09-18T05:13:50.152 INFO:teuthology.orchestra.run.smithi017.stdout:61 write 0xc83bdc5 thru 0xc84170a (0x5946 bytes) 2024-09-18T05:13:50.163 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:50.158+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:50.165 INFO:teuthology.orchestra.run.smithi017.stdout:62 write 0xcde2e59 thru 0xcde748f (0x4637 bytes) 2024-09-18T05:13:50.180 INFO:teuthology.orchestra.run.smithi017.stdout:63 writesame 0xe219735 thru 0xe21a4c4 data_size 0x10(0xd90 bytes) 2024-09-18T05:13:50.181 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:50.181 INFO:teuthology.orchestra.run.smithi017.stdout:65 punch from 0x5859bc to 0x5955fe, (0xfc42 bytes) 2024-09-18T05:13:50.182 INFO:teuthology.orchestra.run.smithi017.stdout:66 trunc from 0xe21a4c5 to 0xca16f12 2024-09-18T05:13:50.209 INFO:teuthology.orchestra.run.smithi017.stdout:67 write 0xd7813ee thru 0xd783894 (0x24a7 bytes) 2024-09-18T05:13:50.216 INFO:teuthology.orchestra.run.smithi017.stdout:68 punch from 0x81e3630 to 0x81e9b11, (0x64e1 bytes) 2024-09-18T05:13:50.216 INFO:teuthology.orchestra.run.smithi017.stdout:70 read 0x83ce761 thru 0x83d2097 (0x3937 bytes) 2024-09-18T05:13:50.216 INFO:teuthology.orchestra.run.smithi017.stdout:71 read 0x9250efe thru 0x925769b (0x679e bytes) 2024-09-18T05:13:50.216 INFO:teuthology.orchestra.run.smithi017.stdout:72 writesame 0xb5783d3 thru 0xb5826c6 data_size 0x2(0xa2f4 bytes) 2024-09-18T05:13:50.234 INFO:teuthology.orchestra.run.smithi017.stdout:73 write 0xc504f24 thru 0xc50618b (0x1268 bytes) 2024-09-18T05:13:50.240 INFO:teuthology.orchestra.run.smithi017.stdout:75 trunc from 0xd783895 to 0xcc78b14 2024-09-18T05:13:50.253 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:50.253 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:50.258 INFO:teuthology.orchestra.run.smithi017.stdout:76 write 0x6385672 thru 0x6389f38 (0x48c7 bytes) 2024-09-18T05:13:50.264 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:50.258+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:50.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:13:50.276 INFO:teuthology.orchestra.run.smithi017.stdout:78 write 0xed3a68b thru 0xed49e97 (0xf80d bytes) 2024-09-18T05:13:50.282 INFO:teuthology.orchestra.run.smithi017.stdout:79 write 0xd06945f thru 0xd06a48c (0x102e bytes) 2024-09-18T05:13:50.286 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:50.286 INFO:teuthology.orchestra.run.smithi017.stdout:82 write 0x643ce24 thru 0x644169c (0x4879 bytes) 2024-09-18T05:13:50.291 INFO:teuthology.orchestra.run.smithi017.stdout:83 read 0xe4e24f6 thru 0xe4e9055 (0x6b60 bytes) 2024-09-18T05:13:50.294 INFO:teuthology.orchestra.run.smithi017.stdout:86 trunc from 0xed49e98 to 0xbca6209 2024-09-18T05:13:50.308 INFO:teuthology.orchestra.run.smithi017.stdout:87 read 0x50b0972 thru 0x50b981a (0x8ea9 bytes) 2024-09-18T05:13:50.308 INFO:teuthology.orchestra.run.smithi017.stdout:88 read 0x7eb55d1 thru 0x7ebcfc8 (0x79f8 bytes) 2024-09-18T05:13:50.311 INFO:teuthology.orchestra.run.smithi017.stdout:89 trunc from 0xbca6209 to 0x952e354 2024-09-18T05:13:50.322 INFO:teuthology.orchestra.run.smithi017.stdout:91 writesame 0x926ba25 thru 0x927699e data_size 0x3(0xaf7a bytes) 2024-09-18T05:13:50.335 INFO:teuthology.orchestra.run.smithi017.stdout:94 trunc from 0x952e354 to 0x5c865b0 2024-09-18T05:13:50.352 INFO:teuthology.orchestra.run.smithi017.stdout:95 punch from 0x3dcf3ed to 0x3ddbce8, (0xc8fb bytes) 2024-09-18T05:13:50.352 INFO:teuthology.orchestra.run.smithi017.stdout:96 read 0x5a05ea0 thru 0x5a12971 (0xcad2 bytes) 2024-09-18T05:13:50.352 INFO:teuthology.orchestra.run.smithi017.stdout:98 read 0x3ca718a thru 0x3ca874c (0x15c3 bytes) 2024-09-18T05:13:50.352 INFO:teuthology.orchestra.run.smithi017.stdout:99 punch from 0x38bdcd6 to 0x38c756c, (0x9896 bytes) 2024-09-18T05:13:50.352 INFO:teuthology.orchestra.run.smithi017.stdout:100 write 0x433e093 thru 0x434b837 (0xd7a5 bytes) 2024-09-18T05:13:50.360 INFO:teuthology.orchestra.run.smithi017.stdout:101 clone 1 order 19 su 8192 sc 15 2024-09-18T05:13:50.364 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:50.358+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:50.399 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:50.399 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:50.414 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:13:50.466 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:50.463+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:50.536 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:50.536 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:50.550 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:13:50.567 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:50.562+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:50.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:50.662+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:50.713 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:50.713 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:50.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:13:50.770 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:50.762+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:50.848 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:50.849 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:50.863 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:13:50.911 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:50.911+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:50.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:13:50.946 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:13:50.971 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:50.966+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:50.989 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:50.990 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:51.006 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:13:51.083 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:13:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:13:51.095 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:51.095+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:51.100 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:13:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:13:51.116 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:13:51.117 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:13:51.134 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:13:51.134 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:13:51.156 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:13:51.156 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:13:51.165 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:51.172 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:51.172 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:51.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:51.166+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:51.175 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:13:51.175 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:13:51.182 INFO:teuthology.orchestra.run.smithi017.stdout:105 write 0x741e982 thru 0x742601a (0x7699 bytes) 2024-09-18T05:13:51.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:13:51.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:13:51.199 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:13:51.204 INFO:teuthology.orchestra.run.smithi017.stdout:106 write 0xabb6f14 thru 0xabbf513 (0x8600 bytes) 2024-09-18T05:13:51.212 INFO:teuthology.orchestra.run.smithi017.stdout:107 write 0x73b4c7d thru 0x73b8a87 (0x3e0b bytes) 2024-09-18T05:13:51.220 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:13:51.220 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:13:51.221 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:51.221 INFO:teuthology.orchestra.run.smithi017.stdout:109 read 0xbeafa1 thru 0xbfad37 (0xfd97 bytes) 2024-09-18T05:13:51.230 INFO:teuthology.orchestra.run.smithi017.stdout:110 write 0xadcb147 thru 0xadd87c4 (0xd67e bytes) 2024-09-18T05:13:51.243 INFO:teuthology.orchestra.run.smithi017.stdout:111 write 0x7118314 thru 0x7122867 (0xa554 bytes) 2024-09-18T05:13:51.248 INFO:teuthology.orchestra.run.smithi017.stdout:112 read 0x7f77164 thru 0x7f7a0f8 (0x2f95 bytes) 2024-09-18T05:13:51.248 INFO:teuthology.orchestra.run.smithi017.stdout:113 writesame 0x256dd40 thru 0x257d410 data_size 0x1(0xf6d1 bytes) 2024-09-18T05:13:51.279 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:51.279+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:51.287 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:51.294 INFO:teuthology.orchestra.run.smithi017.stdout:115 write 0xb283c38 thru 0xb28966e (0x5a37 bytes) 2024-09-18T05:13:51.297 INFO:teuthology.orchestra.run.smithi017.stdout:116 punch from 0x986d653 to 0x9874923, (0x72d0 bytes) 2024-09-18T05:13:51.297 INFO:teuthology.orchestra.run.smithi017.stdout:117 writesame 0x3d86f32 thru 0x3d8b3d1 data_size 0x10(0x44a0 bytes) 2024-09-18T05:13:51.324 INFO:teuthology.orchestra.run.smithi017.stdout:119 read 0x5fe7ee5 thru 0x5fea382 (0x249e bytes) 2024-09-18T05:13:51.325 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:51.341 INFO:teuthology.orchestra.run.smithi017.stdout:121 writesame 0xe8dfcd9 thru 0xe8e7c21 data_size 0x5f(0x7f49 bytes) 2024-09-18T05:13:51.341 INFO:teuthology.orchestra.run.smithi017.stdout:124 read 0xc9a5afa thru 0xc9b143b (0xb942 bytes) 2024-09-18T05:13:51.341 INFO:teuthology.orchestra.run.smithi017.stdout:125 write 0x8c56270 thru 0x8c581b3 (0x1f44 bytes) 2024-09-18T05:13:51.346 INFO:teuthology.orchestra.run.smithi017.stdout:126 write 0x18b68ca thru 0x18c2470 (0xbba7 bytes) 2024-09-18T05:13:51.370 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:13:51.370 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:51.375 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:51.375+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:51.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:13:51.394 INFO:teuthology.orchestra.run.smithi017.stdout:130 writesame 0xdbd4034 thru 0xdbdb023 data_size 0x10(0x6ff0 bytes) 2024-09-18T05:13:51.420 INFO:teuthology.orchestra.run.smithi017.stdout:131 trunc from 0xe8e7c22 to 0x8c1b160 2024-09-18T05:13:51.446 INFO:teuthology.orchestra.run.smithi017.stdout:132 read 0x452a50a thru 0x45315b9 (0x70b0 bytes) 2024-09-18T05:13:51.446 INFO:teuthology.orchestra.run.smithi017.stdout:133 read 0x9f0c0f thru 0x9fa309 (0x96fb bytes) 2024-09-18T05:13:51.448 INFO:teuthology.orchestra.run.smithi017.stdout:135 write 0x23c12f9 thru 0x23c64d9 (0x51e1 bytes) 2024-09-18T05:13:51.477 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:51.475+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:51.478 INFO:teuthology.orchestra.run.smithi017.stdout:136 punch from 0x53a40d2 to 0x53a46a7, (0x5d5 bytes) 2024-09-18T05:13:51.478 INFO:teuthology.orchestra.run.smithi017.stdout:137 writesame 0x805d1fb thru 0x80668e5 data_size 0x1(0x96eb bytes) 2024-09-18T05:13:51.506 INFO:teuthology.orchestra.run.smithi017.stdout:138 write 0x1936843 thru 0x1942dbc (0xc57a bytes) 2024-09-18T05:13:51.540 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:51.541 INFO:teuthology.orchestra.run.smithi017.stdout:141 write 0x4d12cba thru 0x4d1d729 (0xaa70 bytes) 2024-09-18T05:13:51.560 INFO:teuthology.orchestra.run.smithi017.stdout:142 write 0x2e70716 thru 0x2e7c2ec (0xbbd7 bytes) 2024-09-18T05:13:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:51.561 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:51.561 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:13:51.561 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:13:51.561 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:51.577 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:13:51.578 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:51.575+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:51.579 INFO:teuthology.orchestra.run.smithi017.stdout:143 read 0x39eabc0 thru 0x39efc45 (0x5086 bytes) 2024-09-18T05:13:51.579 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:51.590 INFO:teuthology.orchestra.run.smithi017.stdout:145 trunc from 0x8c1b160 to 0x4b447a8 2024-09-18T05:13:51.633 INFO:teuthology.orchestra.run.smithi017.stdout:146 read 0x2b4671a thru 0x2b4724a (0xb31 bytes) 2024-09-18T05:13:51.635 INFO:teuthology.orchestra.run.smithi017.stdout:147 punch from 0x456f257 to 0x45797ec, (0xa595 bytes) 2024-09-18T05:13:51.635 INFO:teuthology.orchestra.run.smithi017.stdout:149 punch from 0x11785ae to 0x1180326, (0x7d78 bytes) 2024-09-18T05:13:51.663 INFO:teuthology.orchestra.run.smithi017.stdout:151 writesame 0xb1333f5 thru 0xb140a47 data_size 0x1(0xd653 bytes) 2024-09-18T05:13:51.663 INFO:teuthology.orchestra.run.smithi017.stdout:152 write 0x13ab558 thru 0x13ae69d (0x3146 bytes) 2024-09-18T05:13:51.678 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:51.679+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:51.686 INFO:teuthology.orchestra.run.smithi017.stdout:154 punch from 0x1aed1f2 to 0x1af2644, (0x5452 bytes) 2024-09-18T05:13:51.686 INFO:teuthology.orchestra.run.smithi017.stdout:155 writesame 0x33cbb7 thru 0x33f358 data_size 0x6(0x27a2 bytes) 2024-09-18T05:13:51.696 INFO:teuthology.orchestra.run.smithi017.stdout:truncating to largest ever: 0xe24c7ae 2024-09-18T05:13:51.705 INFO:teuthology.orchestra.run.smithi017.stdout:157 trunc from 0xb140a48 to 0xe24c7ae 2024-09-18T05:13:51.716 INFO:teuthology.orchestra.run.smithi017.stdout:158 write 0x29917bc thru 0x299381d (0x2062 bytes) 2024-09-18T05:13:51.743 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:51.743 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:13:51.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:13:51.743 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:13:51.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:459 3.a 3:56aa9f2f:::rbd_data.118b4598dbfb.00000000000000e6:head [set-alloc-hint object_size 524288 write_size 524288,write 224381~4995] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.215184+0000", 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.52605065699999998, 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003525687, 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 459 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.215184+0000", 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.215184+0000", 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.215178+0000", 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999943 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.215198+0000", 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0233000000000001e-05 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.215218+0000", 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0237999999999998e-05 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.215230+0000", 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1844999999999999e-05 2024-09-18T05:13:51.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.215306+0000", 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6021999999999998e-05 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.215440+0000", 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000133924 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.215535+0000", 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4537000000000006e-05 2024-09-18T05:13:51.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.218438+0000", 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002903311 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.218619+0000", 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018108600000000001 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.218669+0000", 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0207999999999998e-05 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.218709+0000", 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0012999999999998e-05 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:482 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'25, mlcod=26'21)", 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.232901+0000", 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.50833325399999996, 2024-09-18T05:13:51.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041568899999999999, 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.232901+0000", 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.232901+0000", 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.232900+0000", 2024-09-18T05:13:51.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.232909+0000", 2024-09-18T05:13:51.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9039999999999998e-06 2024-09-18T05:13:51.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.232931+0000", 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1886e-05 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.232938+0000", 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3509999999999996e-06 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.233376+0000", 2024-09-18T05:13:51.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000437293 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.233413+0000", 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7629999999999997e-05 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237015+0000", 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036023269999999998 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237058+0000", 2024-09-18T05:13:51.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2475999999999998e-05 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:483 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'26, mlcod=26'21)", 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.233494+0000", 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.50774069499999996, 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035837450000000002, 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.233494+0000", 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.233494+0000", 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.233493+0000", 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.233501+0000", 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0520000000000002e-06 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.233514+0000", 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3332e-05 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.233523+0000", 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4090000000000003e-06 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234150+0000", 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062713799999999996 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234181+0000", 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1296e-05 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237060+0000", 2024-09-18T05:13:51.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028792430000000001 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237077+0000", 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7122999999999999e-05 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:484 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'27, mlcod=26'21)", 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.234017+0000", 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.50721759399999999, 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00308662, 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234017+0000", 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234017+0000", 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234016+0000", 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234024+0000", 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0790000000000001e-06 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234042+0000", 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8133000000000001e-05 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234050+0000", 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0099999999999995e-06 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234751+0000", 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070107700000000004 2024-09-18T05:13:51.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234799+0000", 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8396999999999998e-05 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237080+0000", 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022806459999999999 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237103+0000", 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3207e-05 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:485 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'28, mlcod=26'21)", 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.234509+0000", 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.50672551399999999, 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048344959999999998, 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234509+0000", 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234509+0000", 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234508+0000", 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234522+0000", 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4372000000000001e-05 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234534+0000", 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1423999999999999e-05 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.234543+0000", 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0380000000000005e-06 2024-09-18T05:13:51.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235768+0000", 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012254869999999999 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235821+0000", 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2485999999999999e-05 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.239308+0000", 2024-09-18T05:13:51.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003487249 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.239343+0000", 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5132000000000002e-05 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:486 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'29, mlcod=26'23)", 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.235361+0000", 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.50587371400000003, 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060318580000000002, 2024-09-18T05:13:51.767 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235361+0000", 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235361+0000", 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235360+0000", 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235383+0000", 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3467000000000001e-05 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235414+0000", 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0722000000000002e-05 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235426+0000", 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2094e-05 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236284+0000", 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00085829199999999997 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236299+0000", 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4651000000000001e-05 2024-09-18T05:13:51.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241342+0000", 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050436509999999997 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241392+0000", 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9963000000000003e-05 2024-09-18T05:13:51.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:487 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'30, mlcod=26'23)", 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.50536787599999999, 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055603570000000001, 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235880+0000", 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4309e-05 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235892+0000", 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1744e-05 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235899+0000", 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9870000000000002e-06 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236614+0000", 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00071501599999999996 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236642+0000", 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8013000000000001e-05 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241396+0000", 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047546710000000002 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241427+0000", 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0460999999999999e-05 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:490 3.10 3:0ccc9a03:::rbd_data.118b4598dbfb.000000000000015b:head [set-alloc-hint object_size 524288 write_size 524288,write 90112~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.237447+0000", 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.50378717900000003, 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041726189999999998, 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.776 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 490 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237447+0000", 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237447+0000", 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237446+0000", 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237462+0000", 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6756e-05 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237478+0000", 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5508000000000001e-05 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237486+0000", 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9529999999999999e-06 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237539+0000", 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3433999999999997e-05 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237722+0000", 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018219699999999999 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237837+0000", 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011592800000000001 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.239088+0000", 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012509470000000001 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241400+0000", 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023115520000000001 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241530+0000", 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000129629 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241620+0000", 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0169999999999999e-05 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.781 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:492 3.a 3:57ef21b4:::rbd_data.118b4598dbfb.000000000000015d:head [set-alloc-hint object_size 524288 write_size 524288,write 90112~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.237648+0000", 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.50358625000000001, 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038414479999999999, 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 492 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.782 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237648+0000", 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237648+0000", 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237647+0000", 2024-09-18T05:13:51.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237662+0000", 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5121e-05 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237675+0000", 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3251999999999999e-05 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237692+0000", 2024-09-18T05:13:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6291999999999999e-05 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237745+0000", 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2933999999999998e-05 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.237876+0000", 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013095899999999999 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:51.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.238029+0000", 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015347000000000001 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241268+0000", 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003238678 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241415+0000", 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000147727 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241458+0000", 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2602999999999999e-05 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241490+0000", 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1513999999999997e-05 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.787 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:930 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'58, mlcod=26'55)", 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.396652+0000", 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.34458218699999998, 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039150649999999997, 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.396652+0000", 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.396652+0000", 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.396651+0000", 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.396659+0000", 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5039999999999996e-06 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.396676+0000", 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6918e-05 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.396683+0000", 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9500000000000004e-06 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.396841+0000", 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000158119 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.396861+0000", 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0667000000000001e-05 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.400529+0000", 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036680189999999998 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.400567+0000", 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7848000000000001e-05 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.791 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:931 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'59, mlcod=26'55)", 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.397706+0000", 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.34352860200000002, 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054888080000000004, 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397706+0000", 2024-09-18T05:13:51.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397706+0000", 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397705+0000", 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397711+0000", 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.998e-06 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397722+0000", 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1085e-05 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397728+0000", 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9669999999999998e-06 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397773+0000", 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5355999999999997e-05 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397792+0000", 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8343999999999999e-05 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.403085+0000", 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052930920000000001 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.403195+0000", 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000109696 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:932 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'60, mlcod=26'55)", 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.399067+0000", 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.34216734399999998, 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041982390000000003, 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.399067+0000", 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.399067+0000", 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.399066+0000", 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.399072+0000", 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6269999999999997e-06 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.399083+0000", 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0560999999999999e-05 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.399088+0000", 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5480000000000001e-06 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.399128+0000", 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0398999999999997e-05 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.399151+0000", 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2512000000000001e-05 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.403199+0000", 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004048144 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.403265+0000", 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6081999999999995e-05 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:945 3.10 3:0ccc9a03:::rbd_data.118b4598dbfb.000000000000015b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:51.800 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.424154+0000", 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.31708040799999998, 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031969810000000002, 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 945 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424154+0000", 2024-09-18T05:13:51.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424154+0000", 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424148+0000", 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999943 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424161+0000", 2024-09-18T05:13:51.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2503e-05 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424177+0000", 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6201e-05 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424185+0000", 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2509999999999994e-06 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424243+0000", 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7503000000000002e-05 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424338+0000", 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5104000000000003e-05 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424455+0000", 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011761599999999999 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.426101+0000", 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016461850000000001 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.427104+0000", 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010024960000000001 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.427232+0000", 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000128443 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.427351+0000", 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011852499999999999 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:947 3.a 3:57ef21b4:::rbd_data.118b4598dbfb.000000000000015d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.424201+0000", 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.31703352299999998, 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026731400000000001, 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 947 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424201+0000", 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424201+0000", 2024-09-18T05:13:51.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424200+0000", 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424204+0000", 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2890000000000002e-06 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424211+0000", 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1860000000000003e-06 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424216+0000", 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9690000000000002e-06 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424269+0000", 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3081999999999998e-05 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424345+0000", 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6589999999999997e-05 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.424449+0000", 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103133 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.426154+0000", 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00170539 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.426790+0000", 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00063579000000000001 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.426834+0000", 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4740999999999997e-05 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.426874+0000", 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9505999999999997e-05 2024-09-18T05:13:51.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:1045 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'68, mlcod=26'66)", 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.469868+0000", 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.27136602399999998, 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037127420000000002, 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.469868+0000", 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.469868+0000", 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.469867+0000", 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.469874+0000", 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1509999999999998e-06 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.469888+0000", 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3176999999999999e-05 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.469894+0000", 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.81e-06 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.469964+0000", 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9968999999999994e-05 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.469992+0000", 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7118e-05 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.473523+0000", 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035311539999999999 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.473581+0000", 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8374e-05 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:1054 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'75, mlcod=26'71)", 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.25224406599999999, 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061130209999999997, 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488989+0000", 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488997+0000", 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2089999999999999e-06 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489010+0000", 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3845e-05 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489018+0000", 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2470000000000002e-06 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489045+0000", 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6846e-05 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489064+0000", 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9134e-05 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495073+0000", 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060090760000000003 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495103+0000", 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0502e-05 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:1055 3.1e e26/22 3:7f28d8c4:::rbd_data.118b4598dbfb.0000000000000104:head v 26'76, mlcod=26'72)", 2024-09-18T05:13:51.820 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.491876+0000", 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.249358146, 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00353054, 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.491876+0000", 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.491876+0000", 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.491875+0000", 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.491955+0000", 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9925000000000005e-05 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.491969+0000", 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3219e-05 2024-09-18T05:13:51.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.491974+0000", 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2279999999999998e-06 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.494756+0000", 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027826650000000001 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.494778+0000", 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1401000000000001e-05 2024-09-18T05:13:51.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495385+0000", 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060675900000000001 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495407+0000", 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2146000000000001e-05 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:1145 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'88, mlcod=26'84)", 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.553709+0000", 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.18752569599999999, 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040861980000000001, 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.553709+0000", 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.553709+0000", 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.553707+0000", 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.553723+0000", 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5797000000000001e-05 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.553757+0000", 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4606e-05 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.553775+0000", 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7853999999999999e-05 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.553827+0000", 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1975999999999998e-05 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.553852+0000", 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5462000000000001e-05 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.557761+0000", 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039081339999999997 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.557795+0000", 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4248999999999997e-05 2024-09-18T05:13:51.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:1154 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'91, mlcod=26'87)", 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.565640+0000", 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.175594744, 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026391159999999999, 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.565640+0000", 2024-09-18T05:13:51.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.565640+0000", 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.565638+0000", 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.565648+0000", 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8530000000000004e-06 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.565667+0000", 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9287e-05 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.565680+0000", 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.565777+0000", 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6322000000000004e-05 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.565814+0000", 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7222999999999999e-05 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.568174+0000", 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023605660000000001 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.568279+0000", 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000104292 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:1158 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'95, mlcod=26'91)", 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.573513+0000", 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.16772105900000001, 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027168040000000002, 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:51.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.573513+0000", 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.573513+0000", 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.573511+0000", 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.573528+0000", 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.611e-05 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.573554+0000", 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6639999999999999e-05 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.573610+0000", 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5543e-05 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.573715+0000", 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105133 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.573755+0000", 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0191999999999997e-05 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.576204+0000", 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0024486709999999999 2024-09-18T05:13:51.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.576230+0000", 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6344999999999999e-05 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:51.837 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:51.839 INFO:teuthology.orchestra.run.smithi017.stdout:160 write 0x2fca5bc thru 0x2fd8042 (0xda87 bytes) 2024-09-18T05:13:51.839 INFO:teuthology.orchestra.run.smithi017.stdout:161 read 0x95285bc thru 0x953114b (0x8b90 bytes) 2024-09-18T05:13:51.839 INFO:teuthology.orchestra.run.smithi017.stdout:162 read 0xb49c829 thru 0xb4a4418 (0x7bf0 bytes) 2024-09-18T05:13:51.839 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:51.839 INFO:teuthology.orchestra.run.smithi017.stdout:164 read 0x2e53e73 thru 0x2e5b909 (0x7a97 bytes) 2024-09-18T05:13:51.839 INFO:teuthology.orchestra.run.smithi017.stdout:165 read 0x2f609b9 thru 0x2f62d41 (0x2389 bytes) 2024-09-18T05:13:51.840 INFO:teuthology.orchestra.run.smithi017.stdout:166 trunc from 0xe24c7ae to 0xd35cc3 2024-09-18T05:13:51.840 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:13:51.840 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:51.830+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:51.940 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:51.934+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:52.017 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:52.017 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:52.017 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:13:52.017 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:52.033 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:13:52.079 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:52.079+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:167 write 0xee45015 thru 0xee53686 (0xe672 bytes) 2024-09-18T05:13:52.141 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:52.139+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:52.143 INFO:teuthology.orchestra.run.smithi017.stdout:168 punch from 0xe96d6db to 0xe970479, (0x2d9e bytes) 2024-09-18T05:13:52.143 INFO:teuthology.orchestra.run.smithi017.stdout:170 read 0xae8a790 thru 0xae96142 (0xb9b3 bytes) 2024-09-18T05:13:52.143 INFO:teuthology.orchestra.run.smithi017.stdout:173 write 0xc43a499 thru 0xc441e82 (0x79ea bytes) 2024-09-18T05:13:52.165 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:52.165 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:52.165 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:13:52.165 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:13:52.165 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:52.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:13:52.184 INFO:teuthology.orchestra.run.smithi017.stdout:175 trunc from 0xee53687 to 0x22c16fd 2024-09-18T05:13:52.207 INFO:teuthology.orchestra.run.smithi017.stdout:177 read 0x201b189 thru 0x202405a (0x8ed2 bytes) 2024-09-18T05:13:52.207 INFO:teuthology.orchestra.run.smithi017.stdout:178 write 0x1466978 thru 0x146fe93 (0x951c bytes) 2024-09-18T05:13:52.242 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:52.234+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:52.251 INFO:teuthology.orchestra.run.smithi017.stdout:179 write 0xab2045a thru 0xab25724 (0x52cb bytes) 2024-09-18T05:13:52.260 INFO:teuthology.orchestra.run.smithi017.stdout:182 write 0x610aae1 thru 0x6112ec0 (0x83e0 bytes) 2024-09-18T05:13:52.272 INFO:teuthology.orchestra.run.smithi017.stdout:184 write 0x901f4d0 thru 0x902ec00 (0xf731 bytes) 2024-09-18T05:13:52.294 INFO:teuthology.orchestra.run.smithi017.stdout:185 write 0x83061d1 thru 0x83149d6 (0xe806 bytes) 2024-09-18T05:13:52.314 INFO:teuthology.orchestra.run.smithi017.stdout:186 punch from 0xcde0ff to 0xce13fb, (0x32fc bytes) 2024-09-18T05:13:52.314 INFO:teuthology.orchestra.run.smithi017.stdout:187 punch from 0x46eb0ff to 0x46f3306, (0x8207 bytes) 2024-09-18T05:13:52.315 INFO:teuthology.orchestra.run.smithi017.stdout:188 write 0x3f6013c thru 0x3f6f7d5 (0xf69a bytes) 2024-09-18T05:13:52.337 INFO:teuthology.orchestra.run.smithi017.stdout:189 writesame 0x81eea9c thru 0x81fbed1 data_size 0x17(0xd436 bytes) 2024-09-18T05:13:52.344 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:52.343+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:52.352 INFO:teuthology.orchestra.run.smithi017.stdout:190 write 0x9b4536 thru 0x9bd695 (0x9160 bytes) 2024-09-18T05:13:52.356 INFO:teuthology.orchestra.run.smithi017.stdout:191 read 0x6bc757f thru 0x6bcc00f (0x4a91 bytes) 2024-09-18T05:13:52.357 INFO:teuthology.orchestra.run.smithi017.stdout:192 write 0x395fdc0 thru 0x39659b6 (0x5bf7 bytes) 2024-09-18T05:13:52.368 INFO:teuthology.orchestra.run.smithi017.stdout:196 read 0x477dd66 thru 0x47871c0 (0x945b bytes) 2024-09-18T05:13:52.368 INFO:teuthology.orchestra.run.smithi017.stdout:200 write 0xea8f8a thru 0xeb678e (0xd805 bytes) 2024-09-18T05:13:52.368 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:29.904983+0000", 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.459716899, 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01220135, 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.904983+0000", 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.904983+0000", 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.904982+0000", 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905077+0000", 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4319000000000003e-05 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905095+0000", 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2024-09-18T05:13:52.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905103+0000", 2024-09-18T05:13:52.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.157e-06 2024-09-18T05:13:52.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.912758+0000", 2024-09-18T05:13:52.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076545909999999997 2024-09-18T05:13:52.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.912885+0000", 2024-09-18T05:13:52.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012714900000000001 2024-09-18T05:13:52.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.913096+0000", 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021136399999999999 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.916929+0000", 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003833028 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917016+0000", 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6876e-05 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917090+0000", 2024-09-18T05:13:52.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4416e-05 2024-09-18T05:13:52.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917184+0000", 2024-09-18T05:13:52.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4103000000000003e-05 2024-09-18T05:13:52.375 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:29.905113+0000", 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.459587103, 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012416471, 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.376 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905113+0000", 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905113+0000", 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905112+0000", 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905119+0000", 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.63e-06 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905129+0000", 2024-09-18T05:13:52.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0413e-05 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905136+0000", 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.914040+0000", 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0089039210000000004 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.914284+0000", 2024-09-18T05:13:52.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024426100000000001 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.914644+0000", 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035931100000000002 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917290+0000", 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002646036 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917343+0000", 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3334000000000001e-05 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917455+0000", 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112309 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917529+0000", 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3938999999999998e-05 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.459555663, 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012895202999999999, 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37 2024-09-18T05:13:52.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.383 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:52.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:52.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:52.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905150+0000", 2024-09-18T05:13:52.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4169999999999997e-06 2024-09-18T05:13:52.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905160+0000", 2024-09-18T05:13:52.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8900000000000002e-06 2024-09-18T05:13:52.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905167+0000", 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3459999999999996e-06 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.915797+0000", 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010629932 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.916005+0000", 2024-09-18T05:13:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020727500000000001 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.916381+0000", 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000376077 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917556+0000", 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001175117 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917913+0000", 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035677099999999998 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917987+0000", 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4176000000000003e-05 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.918040+0000", 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2859000000000003e-05 2024-09-18T05:13:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.010011+0000", 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.354688566, 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011831105, 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 87 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010011+0000", 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010011+0000", 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010011+0000", 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010099+0000", 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8159999999999996e-05 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010112+0000", 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3322999999999999e-05 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010120+0000", 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.123e-06 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.018279+0000", 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081583100000000002 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.018401+0000", 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122316 2024-09-18T05:13:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.018587+0000", 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018601800000000001 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021156+0000", 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025685669999999999 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021670+0000", 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000514143 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021775+0000", 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000104893 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021843+0000", 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7941999999999994e-05 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.010131+0000", 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.35456941, 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012246778999999999, 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010131+0000", 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010131+0000", 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010130+0000", 2024-09-18T05:13:52.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010136+0000", 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4099999999999996e-06 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010146+0000", 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010153+0000", 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1439999999999997e-06 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.019673+0000", 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095191459999999992 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.019905+0000", 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000231905 2024-09-18T05:13:52.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.020299+0000", 2024-09-18T05:13:52.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039469700000000001 2024-09-18T05:13:52.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021883+0000", 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015842709999999999 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.022268+0000", 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038488699999999999 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.022331+0000", 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2446999999999994e-05 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.022377+0000", 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6576000000000003e-05 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186194+0000", 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.178505879999999, 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012352007999999999, 2024-09-18T05:13:52.402 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 108 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186194+0000", 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186194+0000", 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186193+0000", 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186204+0000", 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1080000000000001e-05 2024-09-18T05:13:52.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186219+0000", 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.49e-05 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186228+0000", 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8829999999999995e-06 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.192601+0000", 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063730080000000003 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.192839+0000", 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000238321 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.193242+0000", 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00040319100000000001 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.195847+0000", 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026052860000000001 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198422+0000", 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025744560000000001 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198487+0000", 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5712999999999999e-05 2024-09-18T05:13:52.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198546+0000", 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8653000000000002e-05 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186238+0000", 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.17846183, 2024-09-18T05:13:52.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014154981000000001, 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 109 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186238+0000", 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186238+0000", 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186237+0000", 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186343+0000", 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105689 2024-09-18T05:13:52.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186369+0000", 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5833000000000002e-05 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186385+0000", 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5665999999999999e-05 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.193898+0000", 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075130570000000001 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.194123+0000", 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022571099999999999 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.194474+0000", 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035039700000000001 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197381+0000", 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029071539999999999 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200249+0000", 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028681309999999999 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200334+0000", 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4662999999999999e-05 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200393+0000", 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9490000000000001e-05 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186412+0000", 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.178287827999998, 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014201561, 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.414 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 110 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186412+0000", 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186412+0000", 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186411+0000", 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186427+0000", 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5800000000000001e-05 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186451+0000", 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4343000000000001e-05 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186467+0000", 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5843999999999999e-05 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.196299+0000", 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0098316940000000002 2024-09-18T05:13:52.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.196520+0000", 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022157399999999999 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.196715+0000", 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000194923 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200099+0000", 2024-09-18T05:13:52.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00338405 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200409+0000", 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030929699999999999 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200518+0000", 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000109496 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200614+0000", 2024-09-18T05:13:52.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5747000000000003e-05 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.178221639, 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016756455, 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 111 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186484+0000", 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7139999999999996e-06 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186499+0000", 2024-09-18T05:13:52.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4269e-05 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186506+0000", 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8669999999999994e-06 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197488+0000", 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010982016000000001 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197636+0000", 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014748499999999999 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197836+0000", 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020046800000000001 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200231+0000", 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023946789999999998 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202993+0000", 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027621820000000002 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203142+0000", 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000149016 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203235+0000", 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2528999999999994e-05 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186515+0000", 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.178184905999998, 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019640996000000001, 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 112 2024-09-18T05:13:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186515+0000", 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186515+0000", 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186514+0000", 2024-09-18T05:13:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.429 INFO:teuthology.orchestra.run.smithi017.stdout:201 punch from 0x790a3c8 to 0x790c410, (0x2048 bytes) 2024-09-18T05:13:52.429 INFO:teuthology.orchestra.run.smithi017.stdout:202 write 0xb3cb7f8 thru 0xb3d86cd (0xced6 bytes) 2024-09-18T05:13:52.429 INFO:teuthology.orchestra.run.smithi017.stdout:204 trunc from 0xb3d86ce to 0xd0a9de4 2024-09-18T05:13:52.429 INFO:teuthology.orchestra.run.smithi017.stdout:205 punch from 0x5518640 to 0x551b45e, (0x2e1e bytes) 2024-09-18T05:13:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186634+0000", 2024-09-18T05:13:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119313 2024-09-18T05:13:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186648+0000", 2024-09-18T05:13:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4073000000000001e-05 2024-09-18T05:13:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186656+0000", 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.96e-06 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198658+0000", 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012002281 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198895+0000", 2024-09-18T05:13:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023678499999999999 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.199247+0000", 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035217000000000001 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202824+0000", 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035771000000000002 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.205884+0000", 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030599160000000002 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206051+0000", 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000166942 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206156+0000", 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105103 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186666+0000", 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.178033704000001, 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019649272999999998, 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 113 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186666+0000", 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186666+0000", 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186665+0000", 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186672+0000", 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4840000000000001e-06 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186683+0000", 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0943e-05 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186690+0000", 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0999999999999998e-06 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200728+0000", 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014037979000000001 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200914+0000", 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018574800000000001 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.201111+0000", 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019744900000000001 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202966+0000", 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001854446 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206180+0000", 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032147249999999999 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206267+0000", 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6471999999999995e-05 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206316+0000", 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8797000000000001e-05 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.178001577, 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019931250000000001, 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 114 2024-09-18T05:13:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186705+0000", 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3329999999999999e-06 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186715+0000", 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.023e-05 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186724+0000", 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9039999999999998e-06 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.201723+0000", 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014999164000000001 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.201963+0000", 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239445 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202179+0000", 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021625799999999999 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206421+0000", 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042421539999999997 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206522+0000", 2024-09-18T05:13:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101149 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206583+0000", 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0890000000000001e-05 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206630+0000", 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6353000000000002e-05 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186733+0000", 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.177967401, 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020010613, 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 115 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186733+0000", 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186733+0000", 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186732+0000", 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186823+0000", 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1065999999999999e-05 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186840+0000", 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6523000000000001e-05 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186849+0000", 2024-09-18T05:13:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2739999999999996e-06 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203297+0000", 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016448536 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203447+0000", 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014955200000000001 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203687+0000", 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000240335 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206509+0000", 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028219120000000002 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206644+0000", 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000135079 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206701+0000", 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6975999999999998e-05 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206743+0000", 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2002999999999997e-05 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186859+0000", 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.177841032, 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.021478490999999999, 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 116 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186859+0000", 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186859+0000", 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186858+0000", 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186866+0000", 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5270000000000001e-06 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186876+0000", 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.029e-05 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186883+0000", 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:13:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.204534+0000", 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.017650795 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.204824+0000", 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029052400000000001 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.205223+0000", 2024-09-18T05:13:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000398687 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206942+0000", 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00171923 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208154+0000", 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012111769999999999 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208280+0000", 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012694900000000001 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208337+0000", 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6999000000000001e-05 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.177806772, 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023698894000000002, 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 117 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186899+0000", 2024-09-18T05:13:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3799999999999999e-06 2024-09-18T05:13:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186909+0000", 2024-09-18T05:13:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0149999999999999e-05 2024-09-18T05:13:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186916+0000", 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.187e-06 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206985+0000", 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020068236 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.207114+0000", 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012908900000000001 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.207328+0000", 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021484100000000001 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208413+0000", 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010848050000000001 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.210466+0000", 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020526469999999999 2024-09-18T05:13:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.210539+0000", 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2669999999999994e-05 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.210592+0000", 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3545999999999999e-05 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.689855+0000", 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.674845429000001, 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012288926, 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 137 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689855+0000", 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689855+0000", 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689854+0000", 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689957+0000", 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103334 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689971+0000", 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3954000000000001e-05 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689979+0000", 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:13:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695002+0000", 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050229230000000003 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695050+0000", 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8072000000000003e-05 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695119+0000", 2024-09-18T05:13:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9473000000000004e-05 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697663+0000", 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025433610000000001 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702096+0000", 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044332750000000004 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702123+0000", 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7203e-05 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702144+0000", 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0414000000000001e-05 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.674709677999999, 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012392172, 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 138 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689996+0000", 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3810000000000004e-06 2024-09-18T05:13:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690007+0000", 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0797e-05 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690014+0000", 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0890000000000002e-06 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695656+0000", 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056421850000000001 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695703+0000", 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6777999999999998e-05 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695784+0000", 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0951999999999993e-05 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697665+0000", 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018816880000000001 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702240+0000", 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004574219 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702326+0000", 2024-09-18T05:13:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6006000000000003e-05 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702383+0000", 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6815999999999999e-05 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.674674801999998, 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01244515, 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 139 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690031+0000", 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9009999999999999e-06 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690040+0000", 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2969999999999992e-06 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690047+0000", 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8850000000000001e-06 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696069+0000", 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060226610000000003 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696117+0000", 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7169999999999997e-05 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696194+0000", 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7748000000000002e-05 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.698074+0000", 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018799979999999999 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702422+0000", 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043472739999999999 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702448+0000", 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6707e-05 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702470+0000", 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2076999999999999e-05 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.690081+0000", 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.674619475, 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012557894, 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 140 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690081+0000", 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690081+0000", 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690080+0000", 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690156+0000", 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5827000000000004e-05 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690167+0000", 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1287000000000001e-05 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690179+0000", 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2157999999999999e-05 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696481+0000", 2024-09-18T05:13:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063017280000000004 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696539+0000", 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7818000000000001e-05 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696609+0000", 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0358000000000006e-05 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.698078+0000", 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014688959999999999 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702522+0000", 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044438530000000002 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702590+0000", 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7926e-05 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702638+0000", 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8593e-05 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.690191+0000", 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.674509360999998, 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012801359, 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 141 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690191+0000", 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690191+0000", 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690190+0000", 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690199+0000", 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6859999999999995e-06 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690216+0000", 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7285000000000001e-05 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690223+0000", 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5020000000000003e-06 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697194+0000", 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069710739999999998 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697244+0000", 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9363999999999997e-05 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697334+0000", 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0617000000000003e-05 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.698661+0000", 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013270490000000001 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702944+0000", 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042830029999999996 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702971+0000", 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6869999999999999e-05 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702992+0000", 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0687999999999999e-05 2024-09-18T05:13:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:52.493 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:52.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:13:52.494 INFO:teuthology.orchestra.run.smithi017.stdout:206 trunc from 0xd0a9de4 to 0x71b1226 2024-09-18T05:13:52.494 INFO:teuthology.orchestra.run.smithi017.stdout:208 writesame 0x2cb937f thru 0x2cbff85 data_size 0x1(0x6c07 bytes) 2024-09-18T05:13:52.495 INFO:teuthology.orchestra.run.smithi017.stdout:209 punch from 0x70198b4 to 0x701d186, (0x38d2 bytes) 2024-09-18T05:13:52.495 INFO:teuthology.orchestra.run.smithi017.stdout:210 write 0x40c18a8 thru 0x40cae5d (0x95b6 bytes) 2024-09-18T05:13:52.495 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:52.490+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:212 punch from 0x685d209 to 0x6864e0c, (0x7c03 bytes) 2024-09-18T05:13:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:214 read 0x6db8f32 thru 0x6dc2837 (0x9906 bytes) 2024-09-18T05:13:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:215 write 0x37a6409 thru 0x37ae737 (0x832f bytes) 2024-09-18T05:13:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:217 write 0xc539c52 thru 0xc546a30 (0xcddf bytes) 2024-09-18T05:13:52.555 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:52.555 INFO:teuthology.orchestra.run.smithi017.stdout:219 write 0xb861b3a thru 0xb8641ca (0x2691 bytes) 2024-09-18T05:13:52.561 INFO:teuthology.orchestra.run.smithi017.stdout:221 read 0x23a7523 thru 0x23a7f51 (0xa2f bytes) 2024-09-18T05:13:52.561 INFO:teuthology.orchestra.run.smithi017.stdout:222 writesame 0x2e62f21 thru 0x2e6e381 data_size 0x1(0xb461 bytes) 2024-09-18T05:13:52.596 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:52.595+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:52.596 INFO:teuthology.orchestra.run.smithi017.stdout:224 read 0x601b66a thru 0x6023ff6 (0x898d bytes) 2024-09-18T05:13:52.609 INFO:teuthology.orchestra.run.smithi017.stdout:225 write 0xcf0eb50 thru 0xcf1a182 (0xb633 bytes) 2024-09-18T05:13:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:228 write 0xd41cc74 thru 0xd420534 (0x38c1 bytes) 2024-09-18T05:13:52.646 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:13:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2425 3.1b 3:df27f76b:::rbd_data.118b4598dbfb.00000000000001a5:head [set-alloc-hint object_size 524288 write_size 524288,write 147456~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.641642+0000", 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.001773614, 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017964509999999999, 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for sub ops", 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2425 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641642+0000", 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641642+0000", 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641640+0000", 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641665+0000", 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4967e-05 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641701+0000", 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6226000000000002e-05 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641723+0000", 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2473999999999999e-05 2024-09-18T05:13:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641798+0000", 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4590000000000002e-05 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641923+0000", 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012484400000000001 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642041+0000", 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011780799999999999 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.643029+0000", 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00098840699999999996 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2426 3.1f 3:f9c80fd1:::rbd_data.118b4598dbfb.00000000000001a6:head [set-alloc-hint object_size 524288 write_size 524288,write 147456~1333 in=1333b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.641967+0000", 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.001448733, 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001527455, 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for sub ops", 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2426 2024-09-18T05:13:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641967+0000", 2024-09-18T05:13:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641967+0000", 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641966+0000", 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641976+0000", 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.995e-06 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641988+0000", 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.187e-05 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.641995+0000", 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3679999999999996e-06 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642052+0000", 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6217000000000001e-05 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642185+0000", 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013383399999999999 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642334+0000", 2024-09-18T05:13:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014884300000000001 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:2424 3.10 e26/22 3:09dc0b07:::rbd_data.118b4598dbfb.00000000000001a4:head v 26'12, mlcod=26'10)", 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.642287+0000", 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.001128698, 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012517819999999999, 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642287+0000", 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642287+0000", 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642286+0000", 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642301+0000", 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5441e-05 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642319+0000", 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7696000000000001e-05 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642327+0000", 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1839999999999999e-06 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642379+0000", 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1629000000000003e-05 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.642394+0000", 2024-09-18T05:13:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5273000000000001e-05 2024-09-18T05:13:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:13:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 3 2024-09-18T05:13:52.661 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:52.662 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:52.662 INFO:teuthology.orchestra.run.smithi017.stdout:230 write 0x1cfb5fa thru 0x1d0880b (0xd212 bytes) 2024-09-18T05:13:52.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:13:52.666 INFO:teuthology.orchestra.run.smithi017.stdout:233 punch from 0xb05471a to 0xb061548, (0xce2e bytes) 2024-09-18T05:13:52.666 INFO:teuthology.orchestra.run.smithi017.stdout:234 write 0x2077f4c thru 0x20827d9 (0xa88e bytes) 2024-09-18T05:13:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:235 write 0xd9ace96 thru 0xd9b6512 (0x967d bytes) 2024-09-18T05:13:52.696 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:52.690+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:52.706 INFO:teuthology.orchestra.run.smithi017.stdout:236 read 0x241e530 thru 0x2426c86 (0x8757 bytes) 2024-09-18T05:13:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:237 read 0x6328045 thru 0x632e81f (0x67db bytes) 2024-09-18T05:13:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:238 read 0x626c23c thru 0x62731e1 (0x6fa6 bytes) 2024-09-18T05:13:52.721 INFO:teuthology.orchestra.run.smithi017.stdout:241 writesame 0xed7bfc4 thru 0xed857c9 data_size 0x3d(0x9806 bytes) 2024-09-18T05:13:52.742 INFO:teuthology.orchestra.run.smithi017.stdout:243 trunc from 0xed857ca to 0x1af6b6b 2024-09-18T05:13:52.797 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:52.795+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:52.803 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:52.804 INFO:teuthology.orchestra.run.smithi017.stdout:246 read 0x1069aec thru 0x106a7e6 (0xcfb bytes) 2024-09-18T05:13:52.804 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:52.804 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:13:52.804 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:13:52.805 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:13:52.805 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:52.805 INFO:teuthology.orchestra.run.smithi017.stdout:247 read 0x1735f11 thru 0x17458a0 (0xf990 bytes) 2024-09-18T05:13:52.805 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:52.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:13:52.826 INFO:teuthology.orchestra.run.smithi017.stdout:249 write 0x57e8e84 thru 0x57ea626 (0x17a3 bytes) 2024-09-18T05:13:52.853 INFO:teuthology.orchestra.run.smithi017.stdout:250 write 0x79c14e6 thru 0x79c4311 (0x2e2c bytes) 2024-09-18T05:13:52.881 INFO:teuthology.orchestra.run.smithi017.stdout:252 trunc from 0x79c4312 to 0xf7ee8e 2024-09-18T05:13:52.898 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:52.890+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:52.931 INFO:teuthology.orchestra.run.smithi017.stdout:254 trunc from 0xf7ee8e to 0xb6edc92 2024-09-18T05:13:52.944 INFO:teuthology.orchestra.run.smithi017.stdout:255 write 0x97e1277 thru 0x97eeedc (0xdc66 bytes) 2024-09-18T05:13:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:257 read 0xe1b418 thru 0xe215d5 (0x61be bytes) 2024-09-18T05:13:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:258 read 0x7573fe7 thru 0x75835ba (0xf5d4 bytes) 2024-09-18T05:13:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:truncating to largest ever: 0xeadaea9 2024-09-18T05:13:52.971 INFO:teuthology.orchestra.run.smithi017.stdout:260 trunc from 0xb6edc92 to 0xeadaea9 2024-09-18T05:13:52.975 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:132 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'90, mlcod=16'85)", 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.689477+0000", 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.278589003, 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064718670000000001, 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689477+0000", 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689477+0000", 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689475+0000", 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689491+0000", 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5909e-05 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689522+0000", 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1390000000000003e-05 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.689544+0000", 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1607000000000002e-05 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690093+0000", 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054960899999999995 2024-09-18T05:13:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690127+0000", 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3436000000000003e-05 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.695896+0000", 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057689860000000003 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.695949+0000", 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2880000000000002e-05 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:133 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'91, mlcod=16'86)", 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.690067+0000", 2024-09-18T05:13:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.277999391000002, 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059184950000000002, 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690067+0000", 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690067+0000", 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690065+0000", 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690077+0000", 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1956e-05 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690097+0000", 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9749999999999999e-05 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690109+0000", 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2119999999999999e-05 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690709+0000", 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00060067900000000001 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690767+0000", 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7286e-05 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.695954+0000", 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051873900000000001 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.695985+0000", 2024-09-18T05:13:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0867000000000001e-05 2024-09-18T05:13:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'86)", 2024-09-18T05:13:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.690708+0000", 2024-09-18T05:13:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.277357652999999, 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064946140000000001, 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690708+0000", 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690708+0000", 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690707+0000", 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690762+0000", 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5380000000000002e-05 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690782+0000", 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9966000000000002e-05 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.690794+0000", 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1643e-05 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691599+0000", 2024-09-18T05:13:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00080475100000000003 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691638+0000", 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697145+0000", 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055077549999999996 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697203+0000", 2024-09-18T05:13:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7499e-05 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:135 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'93, mlcod=16'86)", 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.691359+0000", 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.276707104, 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058856109999999998, 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691359+0000", 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691359+0000", 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691357+0000", 2024-09-18T05:13:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691369+0000", 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1714e-05 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691389+0000", 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0046000000000001e-05 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.691400+0000", 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0643e-05 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692716+0000", 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001316263 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692778+0000", 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2106999999999993e-05 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697208+0000", 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044302760000000004 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.697244+0000", 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6086e-05 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:137 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'95, mlcod=16'87)", 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.692355+0000", 2024-09-18T05:13:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.275711326, 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0065518970000000001, 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692355+0000", 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692355+0000", 2024-09-18T05:13:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692352+0000", 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692478+0000", 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012573900000000001 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692502+0000", 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3689999999999998e-05 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.692516+0000", 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.399e-05 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694770+0000", 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00225391 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.694828+0000", 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8449000000000002e-05 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698856+0000", 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040273890000000001 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698906+0000", 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0909999999999999e-05 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:138 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'96, mlcod=16'87)", 2024-09-18T05:13:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.693043+0000", 2024-09-18T05:13:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.275023284, 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058985920000000002, 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693043+0000", 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693043+0000", 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693041+0000", 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693055+0000", 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.394e-05 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693079+0000", 2024-09-18T05:13:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4583000000000002e-05 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693092+0000", 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.276e-05 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.696062+0000", 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029703680000000001 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.696097+0000", 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4962999999999997e-05 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698912+0000", 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028141709999999999 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698941+0000", 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9614000000000001e-05 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4204.0:139 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'97, mlcod=16'87)", 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:30.693351+0000", 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.274715015999998, 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056155429999999998, 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693351+0000", 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693351+0000", 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693350+0000", 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693363+0000", 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3243e-05 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693380+0000", 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.755e-05 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.693459+0000", 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8466000000000004e-05 2024-09-18T05:13:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.696639+0000", 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031796530000000002 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.696672+0000", 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3812000000000001e-05 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698943+0000", 2024-09-18T05:13:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00227057 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:30.698966+0000", 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3526000000000001e-05 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1148 3.12 3:48b8c1ae:::rbd_data.118b4598dbfb.00000000000000a1:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 139264~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.549271+0000", 2024-09-18T05:13:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.418794554, 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058252829999999997, 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1148 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.549271+0000", 2024-09-18T05:13:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.549271+0000", 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.549268+0000", 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:13:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.549328+0000", 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0164999999999997e-05 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.549367+0000", 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8130999999999998e-05 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.549390+0000", 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3292e-05 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.549496+0000", 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010635499999999999 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.549795+0000", 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00029914600000000003 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.550237+0000", 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000441951 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.551765+0000", 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015279239999999999 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.554974+0000", 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032091839999999999 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.555049+0000", 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4721999999999994e-05 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.555097+0000", 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7502e-05 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1452 3.12 3:4bd21895:::rbd_data.118b4598dbfb.0000000000000030:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.818668+0000", 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.149397598, 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085655969999999994, 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1452 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818668+0000", 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818668+0000", 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818667+0000", 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818675+0000", 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1270000000000003e-06 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818694+0000", 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8899e-05 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818710+0000", 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5486999999999999e-05 2024-09-18T05:13:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.819852+0000", 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011427340000000001 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.820198+0000", 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034537800000000003 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-18T05:13:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.820508+0000", 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000310527 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822390+0000", 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001882119 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826998+0000", 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046074480000000001 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.827139+0000", 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141042 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.827234+0000", 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5023000000000001e-05 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1482 3.1f 3:f82df421:::rbd_data.118b4598dbfb.0000000000000061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.834412+0000", 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1336542569999999, 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071445789999999999, 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1482 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834412+0000", 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834412+0000", 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834409+0000", 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:13:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834422+0000", 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.346e-05 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834461+0000", 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9096e-05 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834483+0000", 2024-09-18T05:13:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2079999999999999e-05 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834628+0000", 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144466 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834829+0000", 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020148400000000001 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-18T05:13:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.835061+0000", 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231735 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.836657+0000", 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001596208 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.841351+0000", 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046937610000000003 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.841481+0000", 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013005199999999999 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.841556+0000", 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5190000000000003e-05 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1498 3.17 3:ecb92100:::rbd_data.118b4598dbfb.000000000000009c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.844346+0000", 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1237196309999999, 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094984240000000001, 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1498 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844346+0000", 2024-09-18T05:13:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844346+0000", 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844331+0000", 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999843 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844356+0000", 2024-09-18T05:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.586e-05 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844390+0000", 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3340000000000003e-05 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844407+0000", 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7467000000000001e-05 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844508+0000", 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100492 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844707+0000", 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019911000000000001 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844839+0000", 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132559 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846090+0000", 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001250541 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.853692+0000", 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0076019599999999996 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.853771+0000", 2024-09-18T05:13:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8759999999999998e-05 2024-09-18T05:13:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.853845+0000", 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4041999999999993e-05 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1503 3.12 3:48b8c1ae:::rbd_data.118b4598dbfb.00000000000000a1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.846751+0000", 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1213152639999999, 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010841952, 2024-09-18T05:13:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1503 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846751+0000", 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846751+0000", 2024-09-18T05:13:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846749+0000", 2024-09-18T05:13:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846761+0000", 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2232000000000001e-05 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846791+0000", 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9515000000000001e-05 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846807+0000", 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6354999999999998e-05 2024-09-18T05:13:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846967+0000", 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016001700000000001 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.847132+0000", 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000165348 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.847366+0000", 2024-09-18T05:13:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023328499999999999 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.848691+0000", 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001325147 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.857445+0000", 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0087538530000000007 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.857512+0000", 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7441999999999996e-05 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.857593+0000", 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0623000000000004e-05 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2282 3.12 3:48298be1:::rbd_data.118b4598dbfb.000000000000011e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.436472+0000", 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.53159367999999996, 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077283639999999997, 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2282 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.436472+0000", 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.436472+0000", 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.436471+0000", 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.436479+0000", 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7340000000000008e-06 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.436498+0000", 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9383000000000001e-05 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.436513+0000", 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5243e-05 2024-09-18T05:13:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.437608+0000", 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010950109999999999 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.437942+0000", 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033336100000000001 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-18T05:13:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.438307+0000", 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036514499999999999 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.439764+0000", 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014571720000000001 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.444120+0000", 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043558650000000004 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.444165+0000", 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.494e-05 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.444201+0000", 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5735999999999998e-05 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2290 3.12 3:4891e7e4:::rbd_data.118b4598dbfb.000000000000014e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.441463+0000", 2024-09-18T05:13:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.52660239499999995, 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054907660000000002, 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2290 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.441463+0000", 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.441463+0000", 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.441461+0000", 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.441479+0000", 2024-09-18T05:13:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8604e-05 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.441516+0000", 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7082999999999997e-05 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.441538+0000", 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1693000000000001e-05 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.441836+0000", 2024-09-18T05:13:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00029840299999999998 2024-09-18T05:13:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.441958+0000", 2024-09-18T05:13:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121525 2024-09-18T05:13:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.442126+0000", 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167861 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.443763+0000", 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001637143 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.446800+0000", 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003036993 2024-09-18T05:13:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.446884+0000", 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3999000000000007e-05 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.446954+0000", 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0265999999999994e-05 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2318 3.6 3:64ee52fe:::rbd_data.118b4598dbfb.0000000000000057:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.473264+0000", 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.49480143100000001, 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091971929999999993, 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2318 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473264+0000", 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473264+0000", 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473262+0000", 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473279+0000", 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7053000000000001e-05 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473318+0000", 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8834000000000001e-05 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473340+0000", 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2549999999999999e-05 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473431+0000", 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0543000000000004e-05 2024-09-18T05:13:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473607+0000", 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017654300000000001 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.474900+0000", 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012928810000000001 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.482276+0000", 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0073758340000000004 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.482298+0000", 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1866e-05 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.482392+0000", 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4596e-05 2024-09-18T05:13:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.482462+0000", 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9170000000000004e-05 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2408 3.1 3:8454facc:::rbd_data.118b4598dbfb.0000000000000198:head [set-alloc-hint object_size 524288 write_size 524288,write 319488~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.614564+0000", 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.35350183099999999, 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062245119999999998, 2024-09-18T05:13:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2408 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.614564+0000", 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.614564+0000", 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.614563+0000", 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.614577+0000", 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.428e-05 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.614594+0000", 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7061000000000001e-05 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.614601+0000", 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0260000000000002e-06 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.614660+0000", 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8360999999999999e-05 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.614810+0000", 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000150168 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.615009+0000", 2024-09-18T05:13:53.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000199457 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.616627+0000", 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001617641 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.620710+0000", 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040836249999999996 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.620757+0000", 2024-09-18T05:13:53.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6165000000000003e-05 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.620789+0000", 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2011999999999998e-05 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2524 3.1b 3:d8b6ae7f:::rbd_data.118b4598dbfb.0000000000000080:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.066 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.754401+0000", 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.21366478, 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060991200000000004, 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2524 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.067 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.754401+0000", 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.754401+0000", 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.754400+0000", 2024-09-18T05:13:53.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.754407+0000", 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0129999999999996e-06 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.754426+0000", 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9494999999999999e-05 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.754436+0000", 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4490000000000005e-06 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.754573+0000", 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013745599999999999 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.754790+0000", 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021681099999999999 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.754976+0000", 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000186286 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.755729+0000", 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075243300000000005 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.760438+0000", 2024-09-18T05:13:53.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0047089539999999996 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.760475+0000", 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7499000000000001e-05 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.760500+0000", 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5125000000000001e-05 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2549 3.1b 3:d8923ab5:::rbd_data.118b4598dbfb.0000000000000197:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.767178+0000", 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.200887661, 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056804239999999999, 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2549 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.073 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.767178+0000", 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.767178+0000", 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.767177+0000", 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.767183+0000", 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3940000000000001e-06 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.767194+0000", 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0414999999999999e-05 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.767200+0000", 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0009999999999998e-06 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.767236+0000", 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6538000000000002e-05 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.767321+0000", 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4907000000000005e-05 2024-09-18T05:13:53.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.767419+0000", 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7534999999999994e-05 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.768647+0000", 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012283439999999999 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.772645+0000", 2024-09-18T05:13:53.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003998049 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.772747+0000", 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010156499999999999 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.772859+0000", 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111829 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.078 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2555 3.1b 3:df27f76b:::rbd_data.118b4598dbfb.00000000000001a5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.770538+0000", 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.197528222, 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057727129999999996, 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2555 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.079 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.770538+0000", 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.770538+0000", 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.770535+0000", 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.770548+0000", 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2707e-05 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.770578+0000", 2024-09-18T05:13:53.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.029e-05 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.770597+0000", 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8736000000000002e-05 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.770736+0000", 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013835599999999999 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.770951+0000", 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021546799999999999 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.771880+0000", 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092908300000000004 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.772890+0000", 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010098850000000001 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.776233+0000", 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033433429999999999 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.776277+0000", 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3977999999999998e-05 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.776310+0000", 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3096999999999998e-05 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.084 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2565 3.1 3:83fa69bd:::rbd_data.118b4598dbfb.0000000000000032:head [truncate 311296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.779818+0000", 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.188248203, 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077575309999999998, 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:53.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2565 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.779818+0000", 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:53.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.779818+0000", 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.779815+0000", 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.779830+0000", 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4603000000000001e-05 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.779878+0000", 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8296e-05 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.779901+0000", 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.780033+0000", 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013197600000000001 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.780229+0000", 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196073 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.780600+0000", 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037091199999999999 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.781862+0000", 2024-09-18T05:13:53.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012625679999999999 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.787419+0000", 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055566840000000001 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.787493+0000", 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3907999999999998e-05 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:53.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:53.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:53.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.787575+0000", 2024-09-18T05:13:53.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2428000000000004e-05 2024-09-18T05:13:53.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:53.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:53.091 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:53.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:13:53.092 INFO:teuthology.orchestra.run.smithi017.stdout:261 writesame 0x995479 thru 0x998d9b data_size 0x1(0x3923 bytes) 2024-09-18T05:13:53.093 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:13:53.094 INFO:teuthology.orchestra.run.smithi017.stdout:262 punch from 0x88bd074 to 0x88c820f, (0xb19b bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:263 write 0x8cbd682 thru 0x8cbfbe6 (0x2565 bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:264 read 0xcad7680 thru 0xcae0fd2 (0x9953 bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:265 write 0xed1f62d thru 0xed286d7 (0x90ab bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:266 punch from 0xc433a5d to 0xc43736e, (0x3911 bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:267 write 0x43c7deb thru 0x43d598c (0xdba2 bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:269 punch from 0x783773 to 0x7923af, (0xec3c bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:270 write 0x6fe1992 thru 0x6fea191 (0x8800 bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:271 write 0xa0db0b4 thru 0xa0e6a4a (0xb997 bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:273 read 0x5c730fb thru 0x5c819db (0xe8e1 bytes) 2024-09-18T05:13:53.095 INFO:teuthology.orchestra.run.smithi017.stdout:275 writesame 0x446abaf thru 0x4475f99 data_size 0xd(0xb3eb bytes) 2024-09-18T05:13:53.096 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:53.091+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:53.107 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.107 INFO:teuthology.orchestra.run.smithi017.stdout:277 punch from 0x19cd9b0 to 0x19d75b8, (0x9c08 bytes) 2024-09-18T05:13:53.107 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.108 INFO:teuthology.orchestra.run.smithi017.stdout:281 read 0x989fa2 thru 0x993667 (0x96c6 bytes) 2024-09-18T05:13:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:truncating to largest ever: 0xecf5761 2024-09-18T05:13:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:284 trunc from 0xed286d8 to 0xecf5761 2024-09-18T05:13:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:285 read 0x4e3c08f thru 0x4e44a61 (0x89d3 bytes) 2024-09-18T05:13:53.125 INFO:teuthology.orchestra.run.smithi017.stdout:286 trunc from 0xecf5761 to 0xe1c95b4 2024-09-18T05:13:53.150 INFO:teuthology.orchestra.run.smithi017.stdout:287 write 0x4330ef1 thru 0x433c644 (0xb754 bytes) 2024-09-18T05:13:53.167 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.167 INFO:teuthology.orchestra.run.smithi017.stdout:289 write 0x9b4bcaf thru 0x9b4c395 (0x6e7 bytes) 2024-09-18T05:13:53.170 INFO:teuthology.orchestra.run.smithi017.stdout:291 write 0x2f812c thru 0x2fa1ca (0x209f bytes) 2024-09-18T05:13:53.177 INFO:teuthology.orchestra.run.smithi017.stdout:293 punch from 0xc04dece to 0xc050110, (0x2242 bytes) 2024-09-18T05:13:53.188 INFO:teuthology.orchestra.run.smithi017.stdout:294 trunc from 0xe1c95b4 to 0x709de99 2024-09-18T05:13:53.194 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:53.191+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:53.225 INFO:teuthology.orchestra.run.smithi017.stdout:295 trunc from 0x709de99 to 0x34fb3d0 2024-09-18T05:13:53.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:13:53.252 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:13:53.252 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:13:53.252 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:53.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:13:53.289 INFO:teuthology.orchestra.run.smithi017.stdout:298 write 0xd75c066 thru 0xd760983 (0x491e bytes) 2024-09-18T05:13:53.298 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.298 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.298 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.298 INFO:teuthology.orchestra.run.smithi017.stdout:302 read 0x5420af6 thru 0x542492a (0x3e35 bytes) 2024-09-18T05:13:53.298 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.298 INFO:teuthology.orchestra.run.smithi017.stdout:304 punch from 0x80e01b9 to 0x80e2504, (0x234b bytes) 2024-09-18T05:13:53.298 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:53.290+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:53.310 INFO:teuthology.orchestra.run.smithi017.stdout:305 writesame 0xe129080 thru 0xe1337ff data_size 0x50(0xa780 bytes) 2024-09-18T05:13:53.310 INFO:teuthology.orchestra.run.smithi017.stdout:306 read 0x8e183f5 thru 0x8e1e348 (0x5f54 bytes) 2024-09-18T05:13:53.310 INFO:teuthology.orchestra.run.smithi017.stdout:307 read 0x5e3b75b thru 0x5e47802 (0xc0a8 bytes) 2024-09-18T05:13:53.310 INFO:teuthology.orchestra.run.smithi017.stdout:309 write 0x11bf520 thru 0x11c1d8d (0x286e bytes) 2024-09-18T05:13:53.317 INFO:teuthology.orchestra.run.smithi017.stdout:311 write 0x9bacf17 thru 0x9bbbdb2 (0xee9c bytes) 2024-09-18T05:13:53.336 INFO:teuthology.orchestra.run.smithi017.stdout:318 punch from 0x790be47 to 0x7919631, (0xd7ea bytes) 2024-09-18T05:13:53.336 INFO:teuthology.orchestra.run.smithi017.stdout:319 punch from 0x7418952 to 0x741ed95, (0x6443 bytes) 2024-09-18T05:13:53.336 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.336 INFO:teuthology.orchestra.run.smithi017.stdout:321 trunc from 0xe133800 to 0xec00c1f 2024-09-18T05:13:53.348 INFO:teuthology.orchestra.run.smithi017.stdout:322 write 0x30f7635 thru 0x30f992c (0x22f8 bytes) 2024-09-18T05:13:53.356 INFO:teuthology.orchestra.run.smithi017.stdout:324 write 0xa912605 thru 0xa91daaa (0xb4a6 bytes) 2024-09-18T05:13:53.391 INFO:teuthology.orchestra.run.smithi017.stdout:325 trunc from 0xec00c1f to 0xec82 2024-09-18T05:13:53.396 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:53.395+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:53.405 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:13:53.406 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:13:53.425 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:13:53.426 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:13:53.430 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:53.430 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:53.442 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:13:53.442 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:13:53.444 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:13:53.461 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:13:53.462 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:13:53.479 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:13:53.479 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:13:53.496 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:53.490+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:53.499 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:13:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:13:53.519 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:13:53.520 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:13:53.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:13:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:13:53.586 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:53.586 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:53.592 INFO:teuthology.orchestra.run.smithi017.stdout:326 writesame 0x4773711 thru 0x478170a data_size 0x1(0xdffa bytes) 2024-09-18T05:13:53.592 INFO:teuthology.orchestra.run.smithi017.stdout:327 read 0x9f58e3 thru 0xa03dcb (0xe4e9 bytes) 2024-09-18T05:13:53.592 INFO:teuthology.orchestra.run.smithi017.stdout:328 read 0x2e1bb48 thru 0x2e2755f (0xba18 bytes) 2024-09-18T05:13:53.592 INFO:teuthology.orchestra.run.smithi017.stdout:329 write 0x2a3b831 thru 0x2a4678e (0xaf5e bytes) 2024-09-18T05:13:53.597 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:53.590+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:53.602 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:13:53.608 INFO:teuthology.orchestra.run.smithi017.stdout:330 read 0x41be5f6 thru 0x41c8e60 (0xa86b bytes) 2024-09-18T05:13:53.608 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.626 INFO:teuthology.orchestra.run.smithi017.stdout:332 writesame 0x99bbe04 thru 0x99c045b data_size 0x4(0x4658 bytes) 2024-09-18T05:13:53.627 INFO:teuthology.orchestra.run.smithi017.stdout:333 write 0x7a18368 thru 0x7a24a66 (0xc6ff bytes) 2024-09-18T05:13:53.642 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.643 INFO:teuthology.orchestra.run.smithi017.stdout:337 write 0x1a89f69 thru 0x1a951d1 (0xb269 bytes) 2024-09-18T05:13:53.665 INFO:teuthology.orchestra.run.smithi017.stdout:339 trunc from 0x99c045c to 0x3db2bfb 2024-09-18T05:13:53.689 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.697 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:53.695+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:53.712 INFO:teuthology.orchestra.run.smithi017.stdout:342 write 0xb9b4b61 thru 0xb9b84e9 (0x3989 bytes) 2024-09-18T05:13:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:343 read 0x4fe7b8a thru 0x4fe7f60 (0x3d7 bytes) 2024-09-18T05:13:53.732 INFO:teuthology.orchestra.run.smithi017.stdout:344 trunc from 0xb9b84ea to 0x4e457f4 2024-09-18T05:13:53.737 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:53.737 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:53.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:13:53.759 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.760 INFO:teuthology.orchestra.run.smithi017.stdout:350 write 0x187f55c thru 0x1884b30 (0x55d5 bytes) 2024-09-18T05:13:53.798 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:53.795+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:53.799 INFO:teuthology.orchestra.run.smithi017.stdout:351 writesame 0xd2d8b0f thru 0xd2e77bd data_size 0x13(0xecaf bytes) 2024-09-18T05:13:53.799 INFO:teuthology.orchestra.run.smithi017.stdout:352 write 0x9d99315 thru 0x9d9ebac (0x5898 bytes) 2024-09-18T05:13:53.811 INFO:teuthology.orchestra.run.smithi017.stdout:354 write 0x3bbbc25 thru 0x3bbc518 (0x8f4 bytes) 2024-09-18T05:13:53.819 INFO:teuthology.orchestra.run.smithi017.stdout:355 read 0x4554cbf thru 0x455947a (0x47bc bytes) 2024-09-18T05:13:53.819 INFO:teuthology.orchestra.run.smithi017.stdout:356 read 0x5ce6917 thru 0x5cec30b (0x59f5 bytes) 2024-09-18T05:13:53.819 INFO:teuthology.orchestra.run.smithi017.stdout:358 read 0x68085be thru 0x6814249 (0xbc8c bytes) 2024-09-18T05:13:53.819 INFO:teuthology.orchestra.run.smithi017.stdout:359 write 0x2ab12d thru 0x2ad016 (0x1eea bytes) 2024-09-18T05:13:53.825 INFO:teuthology.orchestra.run.smithi017.stdout:360 punch from 0x8099650 to 0x809e17f, (0x4b2f bytes) 2024-09-18T05:13:53.826 INFO:teuthology.orchestra.run.smithi017.stdout:361 read 0x9ffdd24 thru 0xa00afa4 (0xd281 bytes) 2024-09-18T05:13:53.826 INFO:teuthology.orchestra.run.smithi017.stdout:362 write 0xb757402 thru 0xb757cfb (0x8fa bytes) 2024-09-18T05:13:53.839 INFO:teuthology.orchestra.run.smithi017.stdout:363 trunc from 0xd2e77be to 0x82052bb 2024-09-18T05:13:53.863 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:53.863 INFO:teuthology.orchestra.run.smithi017.stdout:365 read 0x20a641d thru 0x20b391e (0xd502 bytes) 2024-09-18T05:13:53.863 INFO:teuthology.orchestra.run.smithi017.stdout:367 punch from 0x1a1ac12 to 0x1a1f523, (0x4911 bytes) 2024-09-18T05:13:53.887 INFO:teuthology.orchestra.run.smithi017.stdout:368 write 0xdc8b9a2 thru 0xdc98c86 (0xd2e5 bytes) 2024-09-18T05:13:53.888 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:53.888 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:53.898 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:53.890+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:53.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:13:53.912 INFO:teuthology.orchestra.run.smithi017.stdout:369 read 0x3268044 thru 0x3270564 (0x8521 bytes) 2024-09-18T05:13:53.912 INFO:teuthology.orchestra.run.smithi017.stdout:372 writesame 0x304cb1c thru 0x3058666 data_size 0x1(0xbb4b bytes) 2024-09-18T05:13:53.939 INFO:teuthology.orchestra.run.smithi017.stdout:374 write 0xb9b9ca4 thru 0xb9beb9f (0x4efc bytes) 2024-09-18T05:13:53.950 INFO:teuthology.orchestra.run.smithi017.stdout:377 write 0x326c90b thru 0x32751d7 (0x88cd bytes) 2024-09-18T05:13:53.954 INFO:teuthology.orchestra.run.smithi017.stdout:379 writesame 0x7f3f2db thru 0x7f4913d data_size 0x1(0x9e63 bytes) 2024-09-18T05:13:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:13:53.984 INFO:teuthology.orchestra.run.smithi017.stdout:380 write 0xa2c5f6a thru 0xa2ca79d (0x4834 bytes) 2024-09-18T05:13:53.999 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:53.999+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:54.005 INFO:teuthology.orchestra.run.smithi017.stdout:381 trunc from 0xdc98c87 to 0x7c6f1df 2024-09-18T05:13:54.035 INFO:teuthology.orchestra.run.smithi017.stdout:382 writesame 0x6167331 thru 0x616e91b data_size 0x1(0x75eb bytes) 2024-09-18T05:13:54.053 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:54.054 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:54.058 INFO:teuthology.orchestra.run.smithi017.stdout:384 write 0x354ad60 thru 0x3557fb4 (0xd255 bytes) 2024-09-18T05:13:54.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:13:54.079 INFO:teuthology.orchestra.run.smithi017.stdout:385 trunc from 0x7c6f1df to 0x3fac638 2024-09-18T05:13:54.100 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:54.099+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:54.103 INFO:teuthology.orchestra.run.smithi017.stdout:386 trunc from 0x3fac638 to 0x14dcd61 2024-09-18T05:13:54.162 INFO:teuthology.orchestra.run.smithi017.stdout:387 write 0x6bc4b1d thru 0x6bd0565 (0xba49 bytes) 2024-09-18T05:13:54.178 INFO:teuthology.orchestra.run.smithi017.stdout:388 punch from 0x2a728bb to 0x2a81c76, (0xf3bb bytes) 2024-09-18T05:13:54.179 INFO:teuthology.orchestra.run.smithi017.stdout:389 trunc from 0x6bd0566 to 0x61cd712 2024-09-18T05:13:54.201 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:54.199+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:54.221 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:54.221 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:54.222 INFO:teuthology.orchestra.run.smithi017.stdout:391 writesame 0xa2e7dae thru 0xa2ed516 data_size 0x1(0x5769 bytes) 2024-09-18T05:13:54.222 INFO:teuthology.orchestra.run.smithi017.stdout:392 read 0x1d0a304 thru 0x1d15c53 (0xb950 bytes) 2024-09-18T05:13:54.222 INFO:teuthology.orchestra.run.smithi017.stdout:393 read 0x5e4254c thru 0x5e47b89 (0x563e bytes) 2024-09-18T05:13:54.222 INFO:teuthology.orchestra.run.smithi017.stdout:396 read 0x91a043c thru 0x91a80be (0x7c83 bytes) 2024-09-18T05:13:54.222 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:54.223 INFO:teuthology.orchestra.run.smithi017.stdout:399 read 0x27099af thru 0x271308b (0x96dd bytes) 2024-09-18T05:13:54.223 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:54.223 INFO:teuthology.orchestra.run.smithi017.stdout:401 punch from 0x956e792 to 0x95732db, (0x4b49 bytes) 2024-09-18T05:13:54.223 INFO:teuthology.orchestra.run.smithi017.stdout:402 write 0xa268947 thru 0xa272c49 (0xa303 bytes) 2024-09-18T05:13:54.233 INFO:teuthology.orchestra.run.smithi017.stdout:403 write 0x79ecd88 thru 0x79fc29b (0xf514 bytes) 2024-09-18T05:13:54.236 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:13:54.253 INFO:teuthology.orchestra.run.smithi017.stdout:405 write 0x2098c06 thru 0x209ba00 (0x2dfb bytes) 2024-09-18T05:13:54.273 INFO:teuthology.orchestra.run.smithi017.stdout:407 write 0xac5955d thru 0xac62df4 (0x9898 bytes) 2024-09-18T05:13:54.298 INFO:teuthology.orchestra.run.smithi017.stdout:408 trunc from 0xac62df5 to 0x1bc807c 2024-09-18T05:13:54.302 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:54.294+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:54.327 INFO:teuthology.orchestra.run.smithi017.stdout:409 read 0x108a09 thru 0x11840e (0xfa06 bytes) 2024-09-18T05:13:54.342 INFO:teuthology.orchestra.run.smithi017.stdout:410 write 0x291e8cd thru 0x2927716 (0x8e4a bytes) 2024-09-18T05:13:54.344 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T05:13:54.344 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:13:54.344 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-18T05:13:54.345 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T05:13:54.345 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T05:13:54.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-18T05:13:54.361 INFO:teuthology.orchestra.run.smithi017.stdout:411 trunc from 0x2927717 to 0x79f8e45 2024-09-18T05:13:54.370 INFO:teuthology.orchestra.run.smithi017.stdout:412 read 0x1873f5a thru 0x18839d3 (0xfa7a bytes) 2024-09-18T05:13:54.370 INFO:teuthology.orchestra.run.smithi017.stdout:413 read 0x46df0a4 thru 0x46e47ee (0x574b bytes) 2024-09-18T05:13:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:414 read 0x2e3b938 thru 0x2e3f4c5 (0x3b8e bytes) 2024-09-18T05:13:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:416 punch from 0x12d8cab to 0x12dae09, (0x215e bytes) 2024-09-18T05:13:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:417 writesame 0xe2850e thru 0xe33320 data_size 0x1(0xae13 bytes) 2024-09-18T05:13:54.384 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:54.384 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:54.391 INFO:teuthology.orchestra.run.smithi017.stdout:418 write 0x5364fb2 thru 0x536d5dc (0x862b bytes) 2024-09-18T05:13:54.399 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:13:54.402 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:54.402 INFO:teuthology.orchestra.run.smithi017.stdout:421 writesame 0x252b7da thru 0x2534990 data_size 0x7(0x91b7 bytes) 2024-09-18T05:13:54.402 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:54.394+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:54.412 INFO:teuthology.orchestra.run.smithi017.stdout:422 read 0x21018ac thru 0x210cdd3 (0xb528 bytes) 2024-09-18T05:13:54.412 INFO:teuthology.orchestra.run.smithi017.stdout:423 writesame 0x13b130f thru 0x13b96c7 data_size 0x1(0x83b9 bytes) 2024-09-18T05:13:54.424 INFO:teuthology.orchestra.run.smithi017.stdout:424 writesame 0x425bdb8 thru 0x42697e8 data_size 0x2b(0xda31 bytes) 2024-09-18T05:13:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:425 punch from 0x1a0782 to 0x1a5651, (0x4ecf bytes) 2024-09-18T05:13:54.437 INFO:teuthology.orchestra.run.smithi017.stdout:427 clone 2 order 19 su 4096 sc 3 2024-09-18T05:13:54.487 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:54.487 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T05:13:54.487 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:54.502 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:54.494+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:54.529 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:54.529 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:54.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:13:54.603 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:54.603+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:54.666 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:54.667 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:54.681 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:13:54.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:54.698+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:54.805 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:54.803+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:54.843 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:54.843 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:54.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:13:54.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:54.898+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:55.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:54.998+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:55.030 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:55.030 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:55.045 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:13:55.107 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:55.107+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:55.111 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone1 from 0x79f8e45 (overlap 0xec82) to 0xd4db 2024-09-18T05:13:55.176 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:55.176 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:55.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:13:55.235 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:55.235+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:55.274 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-18T05:13:55.310 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:55.302+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:55.357 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:55.357 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:55.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:13:55.419 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:55.419+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:55.493 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:55.493 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:55.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:13:55.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:55.506+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:55.520 INFO:teuthology.orchestra.run.smithi017.stdout:428 trunc from 0x79f8e45 to 0xe3044cf 2024-09-18T05:13:55.538 INFO:teuthology.orchestra.run.smithi017.stdout:429 write 0x458477 thru 0x45b11c (0x2ca6 bytes) 2024-09-18T05:13:55.564 INFO:teuthology.orchestra.run.smithi017.stdout:430 write 0xb34d762 thru 0xb34db55 (0x3f4 bytes) 2024-09-18T05:13:55.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:13:55.570 INFO:teuthology.orchestra.run.smithi017.stdout:432 punch from 0x11c5585 to 0x11d54b8, (0xff33 bytes) 2024-09-18T05:13:55.570 INFO:teuthology.orchestra.run.smithi017.stdout:433 write 0x259da23 thru 0x25a5128 (0x7706 bytes) 2024-09-18T05:13:55.592 INFO:teuthology.orchestra.run.smithi017.stdout:434 trunc from 0xe3044cf to 0xbcc5e48 2024-09-18T05:13:55.611 INFO:teuthology.orchestra.run.smithi017.stdout:435 write 0xed37ef8 thru 0xed42d1b (0xae24 bytes) 2024-09-18T05:13:55.612 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:55.611+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:55.617 INFO:teuthology.orchestra.run.smithi017.stdout:436 write 0xcc35648 thru 0xcc455e5 (0xff9e bytes) 2024-09-18T05:13:55.624 INFO:teuthology.orchestra.run.smithi017.stdout:437 read 0x3b4224f thru 0x3b4cba8 (0xa95a bytes) 2024-09-18T05:13:55.624 INFO:teuthology.orchestra.run.smithi017.stdout:439 punch from 0x8be3595 to 0x8bef5f3, (0xc05e bytes) 2024-09-18T05:13:55.624 INFO:teuthology.orchestra.run.smithi017.stdout:440 writesame 0xac975c0 thru 0xaca316c data_size 0x5(0xbbad bytes) 2024-09-18T05:13:55.635 INFO:teuthology.orchestra.run.smithi017.stdout:442 write 0x166e773 thru 0x1674624 (0x5eb2 bytes) 2024-09-18T05:13:55.654 INFO:teuthology.orchestra.run.smithi017.stdout:443 read 0x7a5e46d thru 0x7a69607 (0xb19b bytes) 2024-09-18T05:13:55.665 INFO:teuthology.orchestra.run.smithi017.stdout:445 trunc from 0xed42d1c to 0x8dd17fd 2024-09-18T05:13:55.684 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:55.684 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:55.685 INFO:teuthology.orchestra.run.smithi017.stdout:447 read 0x51aa936 thru 0x51ae3e9 (0x3ab4 bytes) 2024-09-18T05:13:55.685 INFO:teuthology.orchestra.run.smithi017.stdout:448 write 0x313565e thru 0x3139039 (0x39dc bytes) 2024-09-18T05:13:55.694 INFO:teuthology.orchestra.run.smithi017.stdout:449 write 0x2f8d1b0 thru 0x2f94405 (0x7256 bytes) 2024-09-18T05:13:55.699 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:13:55.702 INFO:teuthology.orchestra.run.smithi017.stdout:451 read 0x47bb293 thru 0x47bd386 (0x20f4 bytes) 2024-09-18T05:13:55.702 INFO:teuthology.orchestra.run.smithi017.stdout:452 read 0x663fc0a thru 0x66466c9 (0x6ac0 bytes) 2024-09-18T05:13:55.702 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:55.702 INFO:teuthology.orchestra.run.smithi017.stdout:456 write 0x622ea73 thru 0x623cad6 (0xe064 bytes) 2024-09-18T05:13:55.719 INFO:teuthology.orchestra.run.smithi017.stdout:457 writesame 0xa4e6b96 thru 0xa4f3532 data_size 0x1(0xc99d bytes) 2024-09-18T05:13:55.719 INFO:teuthology.orchestra.run.smithi017.stdout:459 read 0x81c6f5f thru 0x81d1562 (0xa604 bytes) 2024-09-18T05:13:55.728 INFO:teuthology.orchestra.run.smithi017.stdout:462 writesame 0xb6725a7 thru 0xb6740d9 data_size 0xb(0x1b33 bytes) 2024-09-18T05:13:55.728 INFO:teuthology.orchestra.run.smithi017.stdout:464 read 0x6e652b5 thru 0x6e6ecb6 (0x9a02 bytes) 2024-09-18T05:13:55.728 INFO:teuthology.orchestra.run.smithi017.stdout:465 read 0x6723584 thru 0x672cc67 (0x96e4 bytes) 2024-09-18T05:13:55.728 INFO:teuthology.orchestra.run.smithi017.stdout:466 read 0x88dc0fa thru 0x88dd48d (0x1394 bytes) 2024-09-18T05:13:55.730 INFO:teuthology.orchestra.run.smithi017.stdout:468 trunc from 0xb6740da to 0xa0d8056 2024-09-18T05:13:55.735 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:13:55.735 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:13:55.737 INFO:teuthology.orchestra.run.smithi017.stdout:469 read 0x5e10230 thru 0x5e1e604 (0xe3d5 bytes) 2024-09-18T05:13:55.738 INFO:teuthology.orchestra.run.smithi017.stdout:470 write 0x2079506 thru 0x208754f (0xe04a bytes) 2024-09-18T05:13:55.745 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:55.743+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:55.754 INFO:teuthology.orchestra.run.smithi017.stdout:471 trunc from 0xa0d8056 to 0xb09d55a 2024-09-18T05:13:55.758 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:13:55.759 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:13:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:474 write 0xd3c4c68 thru 0xd3d06fe (0xba97 bytes) 2024-09-18T05:13:55.776 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:13:55.776 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:13:55.778 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:55.782 INFO:teuthology.orchestra.run.smithi017.stdout:476 trunc from 0xd3d06ff to 0xa467e59 2024-09-18T05:13:55.795 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:13:55.796 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:13:55.799 INFO:teuthology.orchestra.run.smithi017.stdout:477 write 0x265e358 thru 0x2667354 (0x8ffd bytes) 2024-09-18T05:13:55.814 INFO:teuthology.orchestra.run.smithi017.stdout:480 writesame 0xd06a97e thru 0xd06f0b8 data_size 0x7(0x473b bytes) 2024-09-18T05:13:55.814 INFO:teuthology.orchestra.run.smithi017.stdout:483 read 0x2e322d4 thru 0x2e407d8 (0xe505 bytes) 2024-09-18T05:13:55.814 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:55.811+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:55.815 INFO:teuthology.orchestra.run.smithi017.stdout:484 trunc from 0xd06f0b9 to 0xdd26400 2024-09-18T05:13:55.816 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:13:55.816 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:13:55.829 INFO:teuthology.orchestra.run.smithi017.stdout:485 write 0xec897f1 thru 0xec8bed3 (0x26e3 bytes) 2024-09-18T05:13:55.836 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:13:55.836 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:13:55.839 INFO:teuthology.orchestra.run.smithi017.stdout:487 writesame 0x68cd21b thru 0x68d381f data_size 0x31(0x6605 bytes) 2024-09-18T05:13:55.851 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:55.851 INFO:teuthology.orchestra.run.smithi017.stdout:490 trunc from 0xec8bed4 to 0xe9d8c70 2024-09-18T05:13:55.857 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:13:55.858 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:13:55.864 INFO:teuthology.orchestra.run.smithi017.stdout:491 read 0x41b3cde thru 0x41ba94f (0x6c72 bytes) 2024-09-18T05:13:55.865 INFO:teuthology.orchestra.run.smithi017.stdout:492 write 0x1321001 thru 0x1325e85 (0x4e85 bytes) 2024-09-18T05:13:55.874 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:55.875 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:55.875 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:13:55.875 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:13:55.875 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:55.880 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:13:55.881 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:13:55.883 INFO:teuthology.orchestra.run.smithi017.stdout:493 writesame 0x88a01ee thru 0x88ab850 data_size 0x1(0xb663 bytes) 2024-09-18T05:13:55.891 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:13:55.900 INFO:teuthology.orchestra.run.smithi017.stdout:494 write 0x78ab045 thru 0x78b9043 (0xdfff bytes) 2024-09-18T05:13:55.906 INFO:teuthology.orchestra.run.smithi017.stdout:496 clone 3 order 19 su 65536 sc 5 2024-09-18T05:13:55.916 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:55.906+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:55.985 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:13:56.016 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:56.015+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:486 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'29, mlcod=26'23)", 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.235361+0000", 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8204999239999999, 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060318580000000002, 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.061 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235361+0000", 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235361+0000", 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235360+0000", 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235383+0000", 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3467000000000001e-05 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235414+0000", 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0722000000000002e-05 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235426+0000", 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2094e-05 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236284+0000", 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00085829199999999997 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236299+0000", 2024-09-18T05:13:56.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4651000000000001e-05 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241342+0000", 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050436509999999997 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241392+0000", 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9963000000000003e-05 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.065 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:487 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'30, mlcod=26'23)", 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8199940860000003, 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055603570000000001, 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235880+0000", 2024-09-18T05:13:56.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4309e-05 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235892+0000", 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1744e-05 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235899+0000", 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9870000000000002e-06 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236614+0000", 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00071501599999999996 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236642+0000", 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8013000000000001e-05 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241396+0000", 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047546710000000002 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241427+0000", 2024-09-18T05:13:56.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0460999999999999e-05 2024-09-18T05:13:56.070 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.070 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.070 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:931 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'59, mlcod=26'55)", 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.397706+0000", 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6581548120000003, 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054888080000000004, 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397706+0000", 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397706+0000", 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397705+0000", 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397711+0000", 2024-09-18T05:13:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.998e-06 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397722+0000", 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1085e-05 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397728+0000", 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9669999999999998e-06 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397773+0000", 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5355999999999997e-05 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397792+0000", 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8343999999999999e-05 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.403085+0000", 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052930920000000001 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.403195+0000", 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000109696 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:1054 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'75, mlcod=26'71)", 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5668702759999995, 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061130209999999997, 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.075 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488989+0000", 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488997+0000", 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2089999999999999e-06 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489010+0000", 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3845e-05 2024-09-18T05:13:56.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489018+0000", 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2470000000000002e-06 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489045+0000", 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6846e-05 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489064+0000", 2024-09-18T05:13:56.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9134e-05 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495073+0000", 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060090760000000003 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495103+0000", 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0502e-05 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:1474 3.a 3:5343cb89:::rbd_data.118b4598dbfb.0000000000000056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.834668+0000", 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.2211923139999996, 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073003749999999996, 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:56.080 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1474 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834668+0000", 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834668+0000", 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834667+0000", 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834679+0000", 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2397e-05 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834708+0000", 2024-09-18T05:13:56.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9339000000000001e-05 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834729+0000", 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0832999999999999e-05 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834852+0000", 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122939 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834992+0000", 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013991900000000001 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.835234+0000", 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024224199999999999 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.837039+0000", 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001804167 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.841864+0000", 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048259790000000002 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.841925+0000", 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0585999999999999e-05 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.841969+0000", 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3510999999999997e-05 2024-09-18T05:13:56.085 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:1496 3.a 3:5784533e:::rbd_data.118b4598dbfb.000000000000009a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.845995+0000", 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.2098651980000001, 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050684939999999998, 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:56.086 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1496 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.845995+0000", 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.845995+0000", 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.845993+0000", 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.846004+0000", 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0626e-05 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.846032+0000", 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8217000000000001e-05 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.846047+0000", 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4456e-05 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.846093+0000", 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6415999999999997e-05 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.846150+0000", 2024-09-18T05:13:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7012999999999998e-05 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.846224+0000", 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4047000000000004e-05 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.846915+0000", 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069094399999999998 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.850844+0000", 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039290269999999999 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.850963+0000", 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000118825 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.851064+0000", 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010082299999999999 2024-09-18T05:13:56.091 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2316 3.a 3:56bb9c78:::rbd_data.118b4598dbfb.0000000000000055:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.473356+0000", 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.5825046999999999, 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.017501419000000001, 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:56.092 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2316 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473356+0000", 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473356+0000", 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473355+0000", 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473361+0000", 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6270000000000002e-06 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473375+0000", 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3378e-05 2024-09-18T05:13:56.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473381+0000", 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6669999999999999e-06 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473429+0000", 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7839000000000001e-05 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473488+0000", 2024-09-18T05:13:56.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8817999999999998e-05 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.474466+0000", 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00097748400000000004 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490699+0000", 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016233195999999998 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490722+0000", 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3387000000000002e-05 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490800+0000", 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8279e-05 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490857+0000", 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6807e-05 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.097 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2317 3.a 3:5343cb89:::rbd_data.118b4598dbfb.0000000000000056:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.478386+0000", 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.5774749789999998, 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012680342000000001, 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2317 2024-09-18T05:13:56.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478386+0000", 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478386+0000", 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478383+0000", 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478398+0000", 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.454e-05 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478429+0000", 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0895999999999997e-05 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478443+0000", 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4097000000000001e-05 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.480367+0000", 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001923775 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.480496+0000", 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012927199999999999 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.481973+0000", 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001477426 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490876+0000", 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0089027010000000007 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490939+0000", 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2440000000000005e-05 2024-09-18T05:13:56.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.491013+0000", 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4219000000000002e-05 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.491066+0000", 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3155999999999997e-05 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4491.0:2316 3.a e26/22 ondisk, result = 0)", 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.479730+0000", 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.576130756, 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010977288999999999, 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479730+0000", 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479730+0000", 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479728+0000", 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479737+0000", 2024-09-18T05:13:56.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7629999999999995e-06 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479762+0000", 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4544000000000001e-05 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479784+0000", 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2180000000000001e-05 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490674+0000", 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010889981999999999 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490687+0000", 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2717e-05 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490707+0000", 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.107 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2501 3.a 3:5343cb89:::rbd_data.118b4598dbfb.0000000000000056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.746170+0000", 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3096900759999999, 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058028919999999996, 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2501 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.108 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746170+0000", 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746170+0000", 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746169+0000", 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746178+0000", 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8959999999999992e-06 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746201+0000", 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2915999999999999e-05 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746216+0000", 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5136999999999999e-05 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.747427+0000", 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001211071 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.747645+0000", 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217658 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.747945+0000", 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030051399999999999 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.751177+0000", 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032322760000000001 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.751742+0000", 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056475899999999996 2024-09-18T05:13:56.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.751866+0000", 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000123745 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.751973+0000", 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010735599999999999 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2543 3.a 3:565046da:::rbd_data.118b4598dbfb.000000000000018a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.767238+0000", 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2886228009999998, 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061646319999999998, 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2543 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767238+0000", 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767238+0000", 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767235+0000", 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767248+0000", 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3312999999999999e-05 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767301+0000", 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2580000000000001e-05 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767321+0000", 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9910000000000001e-05 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767419+0000", 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8228999999999998e-05 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767647+0000", 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000227405 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767880+0000", 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023299200000000001 2024-09-18T05:13:56.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.772085+0000", 2024-09-18T05:13:56.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042059039999999999 2024-09-18T05:13:56.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.773145+0000", 2024-09-18T05:13:56.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001059618 2024-09-18T05:13:56.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.773290+0000", 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014529500000000001 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.773402+0000", 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011202 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2610 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'313, mlcod=26'310)", 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.855098+0000", 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2007621529999999, 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005154367, 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.855098+0000", 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.855098+0000", 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.855097+0000", 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.855117+0000", 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0250000000000001e-05 2024-09-18T05:13:56.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.855147+0000", 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9594000000000002e-05 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.855163+0000", 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6402999999999999e-05 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.855347+0000", 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018408500000000001 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.855380+0000", 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086000000000001e-05 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.860171+0000", 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047910770000000004 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.860253+0000", 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1426000000000003e-05 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2611 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'314, mlcod=26'310)", 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.856021+0000", 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.1998395739999999, 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081837939999999994, 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856021+0000", 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856021+0000", 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856019+0000", 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:56.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856034+0000", 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5150000000000001e-05 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856063+0000", 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9346999999999999e-05 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856082+0000", 2024-09-18T05:13:56.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8845999999999999e-05 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856316+0000", 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000234069 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856358+0000", 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1523000000000002e-05 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.864108+0000", 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077500670000000002 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.864205+0000", 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6892000000000007e-05 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2711 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'340, mlcod=26'337)", 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.039084+0000", 2024-09-18T05:13:56.130 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.0167764890000002, 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068687360000000003, 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039084+0000", 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039084+0000", 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039083+0000", 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039092+0000", 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7630000000000006e-06 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039105+0000", 2024-09-18T05:13:56.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2999e-05 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039112+0000", 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5800000000000003e-06 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039625+0000", 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051310600000000004 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039661+0000", 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5633000000000003e-05 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045892+0000", 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0062304889999999996 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045953+0000", 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1218999999999998e-05 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.134 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2712 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'341, mlcod=26'337)", 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.039870+0000", 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.0159903419999998, 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061192420000000004, 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039870+0000", 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039870+0000", 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039868+0000", 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039884+0000", 2024-09-18T05:13:56.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6039999999999999e-05 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039919+0000", 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4876000000000003e-05 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039961+0000", 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2277000000000002e-05 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040662+0000", 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070039799999999997 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040714+0000", 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2062999999999999e-05 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045958+0000", 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052443619999999998 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045989+0000", 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1112999999999998e-05 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2713 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'342, mlcod=26'337)", 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.040643+0000", 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.0152173950000001, 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053832849999999998, 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.139 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040643+0000", 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040643+0000", 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040642+0000", 2024-09-18T05:13:56.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040653+0000", 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1173e-05 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040670+0000", 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7053000000000001e-05 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040681+0000", 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1174e-05 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.041742+0000", 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010605250000000001 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.041773+0000", 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1387000000000003e-05 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045997+0000", 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004223877 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.046026+0000", 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9356000000000002e-05 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2717 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'346, mlcod=26'338)", 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.044310+0000", 2024-09-18T05:13:56.143 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.0115504400000002, 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051300030000000002, 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.044310+0000", 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.044310+0000", 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.044308+0000", 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.044324+0000", 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5203e-05 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.044351+0000", 2024-09-18T05:13:56.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7464e-05 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.044367+0000", 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6146000000000001e-05 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.046196+0000", 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001829099 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.046263+0000", 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.656e-05 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.049371+0000", 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031080859999999999 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.049440+0000", 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9165000000000006e-05 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2731 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'352, mlcod=26'347)", 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.063327+0000", 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.9925339470000001, 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058073659999999996, 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063327+0000", 2024-09-18T05:13:56.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063327+0000", 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063325+0000", 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063338+0000", 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2836999999999999e-05 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063365+0000", 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6783000000000001e-05 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063383+0000", 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8813000000000001e-05 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063490+0000", 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010637 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063547+0000", 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7618999999999998e-05 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.069043+0000", 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054954009999999996 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.069134+0000", 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1089999999999997e-05 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2807 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'377, mlcod=26'371)", 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.158054+0000", 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.897806605, 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006727055, 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.152 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158054+0000", 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158054+0000", 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158052+0000", 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158067+0000", 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5073e-05 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158111+0000", 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3463e-05 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158130+0000", 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9259999999999999e-05 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.159247+0000", 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011168020000000001 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.159316+0000", 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8821999999999999e-05 2024-09-18T05:13:56.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.164692+0000", 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053760459999999998 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.164781+0000", 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9232000000000002e-05 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2868 3.a 3:5376ad2d:::rbd_data.118b4598dbfb.0000000000000094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.235008+0000", 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.8208526320000002, 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064425769999999997, 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2868 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235008+0000", 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235008+0000", 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235004+0000", 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-18T05:13:56.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235043+0000", 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8617e-05 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235091+0000", 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7642999999999998e-05 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235112+0000", 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1290000000000001e-05 2024-09-18T05:13:56.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235288+0000", 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176181 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235510+0000", 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221492 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235714+0000", 2024-09-18T05:13:56.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020429199999999999 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.237797+0000", 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020828209999999999 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.241245+0000", 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034486529999999999 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.241380+0000", 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000134645 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.241450+0000", 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0423e-05 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.162 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:56.163 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone2 from 0xe9d8c70 (overlap 0x79f8e45) to 0x1864fa7 2024-09-18T05:13:56.164 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:13:56.164 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:56.163+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:56.264 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:56.263+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:56.360 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:56.360 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:56.360 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:13:56.360 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:56.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:56.358+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:56.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:13:56.443 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-18T05:13:56.446 INFO:teuthology.orchestra.run.smithi017.stdout:497 write 0xdaeb7fb thru 0xdafa0a8 (0xe8ae bytes) 2024-09-18T05:13:56.459 INFO:teuthology.orchestra.run.smithi017.stdout:498 punch from 0x79d6772 to 0x79dfb1b, (0x93a9 bytes) 2024-09-18T05:13:56.459 INFO:teuthology.orchestra.run.smithi017.stdout:500 read 0x78c2228 thru 0x78cc670 (0xa449 bytes) 2024-09-18T05:13:56.459 INFO:teuthology.orchestra.run.smithi017.stdout:501 write 0x6a4264c thru 0x6a473ab (0x4d60 bytes) 2024-09-18T05:13:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:503 writesame 0xc6339a thru 0xc63d57 data_size 0x2(0x9be bytes) 2024-09-18T05:13:56.465 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:56.463+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:56.487 INFO:teuthology.orchestra.run.smithi017.stdout:504 trunc from 0xe9d8c70 to 0x593c11d 2024-09-18T05:13:56.529 INFO:teuthology.orchestra.run.smithi017.stdout:505 write 0x315b355 thru 0x3161df6 (0x6aa2 bytes) 2024-09-18T05:13:56.545 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:56.545 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:13:56.545 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:13:56.545 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:13:56.545 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:56.551 INFO:teuthology.orchestra.run.smithi017.stdout:506 write 0x6feb5ee thru 0x6feec9d (0x36b0 bytes) 2024-09-18T05:13:56.556 INFO:teuthology.orchestra.run.smithi017.stdout:507 read 0x574a879 thru 0x574e3d4 (0x3b5c bytes) 2024-09-18T05:13:56.557 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:56.557 INFO:teuthology.orchestra.run.smithi017.stdout:509 read 0x4bdd079 thru 0x4be0048 (0x2fd0 bytes) 2024-09-18T05:13:56.561 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:13:56.578 INFO:teuthology.orchestra.run.smithi017.stdout:510 write 0xd1211d1 thru 0xd12c8ad (0xb6dd bytes) 2024-09-18T05:13:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:513 trunc from 0xd12c8ae to 0xe066caf 2024-09-18T05:13:56.603 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:56.603+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:56.610 INFO:teuthology.orchestra.run.smithi017.stdout:514 trunc from 0xe066caf to 0x40fa572 2024-09-18T05:13:56.647 INFO:teuthology.orchestra.run.smithi017.stdout:515 trunc from 0x40fa572 to 0x16589ad 2024-09-18T05:13:56.667 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:56.667+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:56.679 INFO:teuthology.orchestra.run.smithi017.stdout:516 punch from 0xba0ddd to 0xbaea79, (0xdc9c bytes) 2024-09-18T05:13:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:517 write 0xedeb910 thru 0xedfa8ec (0xefdd bytes) 2024-09-18T05:13:56.734 INFO:teuthology.orchestra.run.smithi017.stdout:520 write 0x821fcca thru 0x82284d7 (0x880e bytes) 2024-09-18T05:13:56.737 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:13:56.737 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:13:56.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:29.905113+0000", 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.827413404000001, 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012416471, 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.738 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905113+0000", 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905113+0000", 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905112+0000", 2024-09-18T05:13:56.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905119+0000", 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.63e-06 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905129+0000", 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0413e-05 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905136+0000", 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.914040+0000", 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0089039210000000004 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.914284+0000", 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024426100000000001 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.914644+0000", 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035931100000000002 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917290+0000", 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002646036 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917343+0000", 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3334000000000001e-05 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917455+0000", 2024-09-18T05:13:56.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112309 2024-09-18T05:13:56.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917529+0000", 2024-09-18T05:13:56.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3938999999999998e-05 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.827381964000001, 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012895202999999999, 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905144+0000", 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905150+0000", 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4169999999999997e-06 2024-09-18T05:13:56.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905160+0000", 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8900000000000002e-06 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.905167+0000", 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3459999999999996e-06 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.915797+0000", 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010629932 2024-09-18T05:13:56.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.916005+0000", 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020727500000000001 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.916381+0000", 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000376077 2024-09-18T05:13:56.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917556+0000", 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001175117 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917913+0000", 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035677099999999998 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.917987+0000", 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4176000000000003e-05 2024-09-18T05:13:56.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:29.918040+0000", 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2859000000000003e-05 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.750 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.010131+0000", 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.722395711000001, 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012246778999999999, 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010131+0000", 2024-09-18T05:13:56.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010131+0000", 2024-09-18T05:13:56.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010130+0000", 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010136+0000", 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4099999999999996e-06 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010146+0000", 2024-09-18T05:13:56.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.010153+0000", 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1439999999999997e-06 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.019673+0000", 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095191459999999992 2024-09-18T05:13:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.019905+0000", 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000231905 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.020299+0000", 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039469700000000001 2024-09-18T05:13:56.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.021883+0000", 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015842709999999999 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.022268+0000", 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038488699999999999 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.022331+0000", 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2446999999999994e-05 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.022377+0000", 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6576000000000003e-05 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186194+0000", 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.546332181, 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012352007999999999, 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.759 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 108 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186194+0000", 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186194+0000", 2024-09-18T05:13:56.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186193+0000", 2024-09-18T05:13:56.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:56.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186204+0000", 2024-09-18T05:13:56.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1080000000000001e-05 2024-09-18T05:13:56.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186219+0000", 2024-09-18T05:13:56.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.49e-05 2024-09-18T05:13:56.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186228+0000", 2024-09-18T05:13:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8829999999999995e-06 2024-09-18T05:13:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.192601+0000", 2024-09-18T05:13:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063730080000000003 2024-09-18T05:13:56.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.192839+0000", 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000238321 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.193242+0000", 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00040319100000000001 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.195847+0000", 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026052860000000001 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198422+0000", 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025744560000000001 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198487+0000", 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5712999999999999e-05 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198546+0000", 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8653000000000002e-05 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186238+0000", 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.546288131000001, 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014154981000000001, 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.766 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 109 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186238+0000", 2024-09-18T05:13:56.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186238+0000", 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186237+0000", 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186343+0000", 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105689 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186369+0000", 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5833000000000002e-05 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186385+0000", 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5665999999999999e-05 2024-09-18T05:13:56.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.193898+0000", 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075130570000000001 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.194123+0000", 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022571099999999999 2024-09-18T05:13:56.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.194474+0000", 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035039700000000001 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197381+0000", 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029071539999999999 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200249+0000", 2024-09-18T05:13:56.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028681309999999999 2024-09-18T05:13:56.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200334+0000", 2024-09-18T05:13:56.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4662999999999999e-05 2024-09-18T05:13:56.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200393+0000", 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9490000000000001e-05 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186412+0000", 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.546114128999999, 2024-09-18T05:13:56.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014201561, 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 110 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186412+0000", 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186412+0000", 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186411+0000", 2024-09-18T05:13:56.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:13:56.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186427+0000", 2024-09-18T05:13:56.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5800000000000001e-05 2024-09-18T05:13:56.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186451+0000", 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4343000000000001e-05 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186467+0000", 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5843999999999999e-05 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.196299+0000", 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0098316940000000002 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.196520+0000", 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022157399999999999 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.196715+0000", 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000194923 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200099+0000", 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00338405 2024-09-18T05:13:56.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200409+0000", 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030929699999999999 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200518+0000", 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000109496 2024-09-18T05:13:56.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200614+0000", 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5747000000000003e-05 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.546047940000001, 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016756455, 2024-09-18T05:13:56.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 111 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:56.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:56.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186478+0000", 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186484+0000", 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7139999999999996e-06 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186499+0000", 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4269e-05 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186506+0000", 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8669999999999994e-06 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197488+0000", 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010982016000000001 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197636+0000", 2024-09-18T05:13:56.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014748499999999999 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.197836+0000", 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020046800000000001 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200231+0000", 2024-09-18T05:13:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023946789999999998 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202993+0000", 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027621820000000002 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203142+0000", 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000149016 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203235+0000", 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2528999999999994e-05 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186515+0000", 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.546011206999999, 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019640996000000001, 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.787 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 112 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186515+0000", 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186515+0000", 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186514+0000", 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186634+0000", 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119313 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186648+0000", 2024-09-18T05:13:56.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4073000000000001e-05 2024-09-18T05:13:56.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186656+0000", 2024-09-18T05:13:56.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.96e-06 2024-09-18T05:13:56.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198658+0000", 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012002281 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.198895+0000", 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023678499999999999 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.199247+0000", 2024-09-18T05:13:56.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035217000000000001 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202824+0000", 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035771000000000002 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.205884+0000", 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030599160000000002 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206051+0000", 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000166942 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206156+0000", 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105103 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186666+0000", 2024-09-18T05:13:56.793 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.545860005000002, 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019649272999999998, 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 113 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186666+0000", 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186666+0000", 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186665+0000", 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186672+0000", 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4840000000000001e-06 2024-09-18T05:13:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186683+0000", 2024-09-18T05:13:56.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0943e-05 2024-09-18T05:13:56.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186690+0000", 2024-09-18T05:13:56.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0999999999999998e-06 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200728+0000", 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014037979000000001 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.200914+0000", 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018574800000000001 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.201111+0000", 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019744900000000001 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202966+0000", 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001854446 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206180+0000", 2024-09-18T05:13:56.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032147249999999999 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206267+0000", 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6471999999999995e-05 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206316+0000", 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8797000000000001e-05 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.545827878000001, 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019931250000000001, 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.800 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 114 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186698+0000", 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186705+0000", 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3329999999999999e-06 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186715+0000", 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.023e-05 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186724+0000", 2024-09-18T05:13:56.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9039999999999998e-06 2024-09-18T05:13:56.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.201723+0000", 2024-09-18T05:13:56.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014999164000000001 2024-09-18T05:13:56.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.201963+0000", 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239445 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.202179+0000", 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021625799999999999 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206421+0000", 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042421539999999997 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206522+0000", 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101149 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206583+0000", 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0890000000000001e-05 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206630+0000", 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6353000000000002e-05 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186733+0000", 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.545793702000001, 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020010613, 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.807 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 115 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186733+0000", 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186733+0000", 2024-09-18T05:13:56.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186732+0000", 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186823+0000", 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1065999999999999e-05 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186840+0000", 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6523000000000001e-05 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186849+0000", 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2739999999999996e-06 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203297+0000", 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016448536 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203447+0000", 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014955200000000001 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.203687+0000", 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000240335 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206509+0000", 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028219120000000002 2024-09-18T05:13:56.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206644+0000", 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000135079 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206701+0000", 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6975999999999998e-05 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206743+0000", 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2002999999999997e-05 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186859+0000", 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.545667333000001, 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.021478490999999999, 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.813 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 116 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186859+0000", 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186859+0000", 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186858+0000", 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186866+0000", 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5270000000000001e-06 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186876+0000", 2024-09-18T05:13:56.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.029e-05 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186883+0000", 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.204534+0000", 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.017650795 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.204824+0000", 2024-09-18T05:13:56.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029052400000000001 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.205223+0000", 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000398687 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206942+0000", 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00171923 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208154+0000", 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012111769999999999 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208280+0000", 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012694900000000001 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208337+0000", 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6999000000000001e-05 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.818 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.545633073000001, 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023698894000000002, 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 117 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.819 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186893+0000", 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186899+0000", 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3799999999999999e-06 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186909+0000", 2024-09-18T05:13:56.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0149999999999999e-05 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.186916+0000", 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.187e-06 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.206985+0000", 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020068236 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.207114+0000", 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012908900000000001 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.207328+0000", 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021484100000000001 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.208413+0000", 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010848050000000001 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.210466+0000", 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020526469999999999 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.210539+0000", 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2669999999999994e-05 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.210592+0000", 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3545999999999999e-05 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.824 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.689855+0000", 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.042671729999999, 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012288926, 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 137 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689855+0000", 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689855+0000", 2024-09-18T05:13:56.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689854+0000", 2024-09-18T05:13:56.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:56.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689957+0000", 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103334 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689971+0000", 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3954000000000001e-05 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689979+0000", 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695002+0000", 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050229230000000003 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695050+0000", 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8072000000000003e-05 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695119+0000", 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9473000000000004e-05 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697663+0000", 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025433610000000001 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702096+0000", 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044332750000000004 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702123+0000", 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7203e-05 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702144+0000", 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0414000000000001e-05 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.042535979, 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012392172, 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.832 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.833 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 138 2024-09-18T05:13:56.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.833 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689990+0000", 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.689996+0000", 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3810000000000004e-06 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690007+0000", 2024-09-18T05:13:56.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0797e-05 2024-09-18T05:13:56.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690014+0000", 2024-09-18T05:13:56.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0890000000000002e-06 2024-09-18T05:13:56.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695656+0000", 2024-09-18T05:13:56.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056421850000000001 2024-09-18T05:13:56.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695703+0000", 2024-09-18T05:13:56.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6777999999999998e-05 2024-09-18T05:13:56.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.695784+0000", 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0951999999999993e-05 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697665+0000", 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018816880000000001 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702240+0000", 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004574219 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702326+0000", 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6006000000000003e-05 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702383+0000", 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6815999999999999e-05 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.042501102999999, 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01244515, 2024-09-18T05:13:56.840 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 139 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690025+0000", 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690031+0000", 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9009999999999999e-06 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690040+0000", 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2969999999999992e-06 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690047+0000", 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8850000000000001e-06 2024-09-18T05:13:56.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696069+0000", 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060226610000000003 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696117+0000", 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7169999999999997e-05 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696194+0000", 2024-09-18T05:13:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7748000000000002e-05 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.698074+0000", 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018799979999999999 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702422+0000", 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043472739999999999 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702448+0000", 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6707e-05 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702470+0000", 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2076999999999999e-05 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.690081+0000", 2024-09-18T05:13:56.846 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.042445776000001, 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012557894, 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 140 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690081+0000", 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690081+0000", 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690080+0000", 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690156+0000", 2024-09-18T05:13:56.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5827000000000004e-05 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690167+0000", 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1287000000000001e-05 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690179+0000", 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2157999999999999e-05 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696481+0000", 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063017280000000004 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696539+0000", 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7818000000000001e-05 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.696609+0000", 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0358000000000006e-05 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.698078+0000", 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014688959999999999 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702522+0000", 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044438530000000002 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702590+0000", 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7926e-05 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702638+0000", 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8593e-05 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4204.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:30.690191+0000", 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.042335661999999, 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012801359, 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.852 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4204", 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.86:0/1704763959", 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 141 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690191+0000", 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690191+0000", 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690190+0000", 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690199+0000", 2024-09-18T05:13:56.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6859999999999995e-06 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690216+0000", 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7285000000000001e-05 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.690223+0000", 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5020000000000003e-06 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697194+0000", 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069710739999999998 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697244+0000", 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9363999999999997e-05 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.697334+0000", 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0617000000000003e-05 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.698661+0000", 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013270490000000001 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702944+0000", 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042830029999999996 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702971+0000", 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6869999999999999e-05 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:30.702992+0000", 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0687999999999999e-05 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:4897 3.e 3:74e83c6a:::rbd_data.118b29ff732c.0000000000000111:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:55.886588+0000", 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.84593855100000004, 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012624597, 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.858 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 4897 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.886588+0000", 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.886588+0000", 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.886585+0000", 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.886599+0000", 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3546e-05 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.886627+0000", 2024-09-18T05:13:56.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.832e-05 2024-09-18T05:13:56.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.886649+0000", 2024-09-18T05:13:56.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1747e-05 2024-09-18T05:13:56.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.886708+0000", 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9002000000000002e-05 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.886850+0000", 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000141839 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.888844+0000", 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019943309999999998 2024-09-18T05:13:56.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.899105+0000", 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010260477 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.899117+0000", 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2231e-05 2024-09-18T05:13:56.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.899166+0000", 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9508000000000001e-05 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.899212+0000", 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6051999999999999e-05 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:6730 3.13 3:cff9bd68:::rbd_data.118b4598dbfb.000000000000007b:5 [read 315392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:56.198190+0000", 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.53433622999999997, 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01224738, 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 6730 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:13:56.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:56.198190+0000", 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:56.198190+0000", 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:56.198190+0000", 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:56.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:56.198192+0000", 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5000000000000002e-06 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:56.198198+0000", 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4060000000000002e-06 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:56.198203+0000", 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8760000000000004e-06 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:56.210330+0000", 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012126390000000001 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:13:56.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:56.210381+0000", 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1085000000000003e-05 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:56.210437+0000", 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6696000000000001e-05 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:13:56.869 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:13:56.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:13:56.873 INFO:teuthology.orchestra.run.smithi017.stdout:521 read 0xc3e34c thru 0xc49a47 (0xb6fc bytes) 2024-09-18T05:13:56.873 INFO:teuthology.orchestra.run.smithi017.stdout:522 trunc from 0xedfa8ed to 0x9090f13 2024-09-18T05:13:56.873 INFO:teuthology.orchestra.run.smithi017.stdout:523 read 0x5063db4 thru 0x506e76e (0xa9bb bytes) 2024-09-18T05:13:56.873 INFO:teuthology.orchestra.run.smithi017.stdout:524 punch from 0x7cf1a0e to 0x7cf3084, (0x1676 bytes) 2024-09-18T05:13:56.873 INFO:teuthology.orchestra.run.smithi017.stdout:525 trunc from 0x9090f13 to 0x74e3828 2024-09-18T05:13:56.874 INFO:teuthology.orchestra.run.smithi017.stdout:526 write 0x5dbd285 thru 0x5dc425d (0x6fd9 bytes) 2024-09-18T05:13:56.874 INFO:teuthology.orchestra.run.smithi017.stdout:527 write 0x32b7b64 thru 0x32bbd71 (0x420e bytes) 2024-09-18T05:13:56.874 INFO:teuthology.orchestra.run.smithi017.stdout:528 punch from 0x524d16b to 0x5258ee4, (0xbd79 bytes) 2024-09-18T05:13:56.874 INFO:teuthology.orchestra.run.smithi017.stdout:529 write 0xe9b79a2 thru 0xe9beee3 (0x7542 bytes) 2024-09-18T05:13:56.874 INFO:teuthology.orchestra.run.smithi017.stdout:530 punch from 0xb2f47de to 0xb300a4a, (0xc26c bytes) 2024-09-18T05:13:56.874 INFO:teuthology.orchestra.run.smithi017.stdout:531 punch from 0x187f51b to 0x18873a1, (0x7e86 bytes) 2024-09-18T05:13:56.874 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:56.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:56.866+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:56.875 INFO:teuthology.orchestra.run.smithi017.stdout:535 trunc from 0xe9beee4 to 0x529afe5 2024-09-18T05:13:56.900 INFO:teuthology.orchestra.run.smithi017.stdout:536 write 0x3872ff9 thru 0x387c75f (0x9767 bytes) 2024-09-18T05:13:56.907 INFO:teuthology.orchestra.run.smithi017.stdout:537 read 0x111c0f9 thru 0x112969c (0xd5a4 bytes) 2024-09-18T05:13:56.927 INFO:teuthology.orchestra.run.smithi017.stdout:538 writesame 0x77c03df thru 0x77c1f06 data_size 0x16(0x1b28 bytes) 2024-09-18T05:13:56.950 INFO:teuthology.orchestra.run.smithi017.stdout:539 write 0xbcfd9ad thru 0xbd0c79a (0xedee bytes) 2024-09-18T05:13:56.959 INFO:teuthology.orchestra.run.smithi017.stdout:540 read 0x623ba14 thru 0x623fbfa (0x41e7 bytes) 2024-09-18T05:13:56.960 INFO:teuthology.orchestra.run.smithi017.stdout:541 punch from 0x51aa91b to 0x51b2a34, (0x8119 bytes) 2024-09-18T05:13:56.960 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:56.960 INFO:teuthology.orchestra.run.smithi017.stdout:545 write 0x952d50f thru 0x9530661 (0x3153 bytes) 2024-09-18T05:13:56.971 INFO:teuthology.orchestra.run.smithi017.stdout:547 write 0x93e2f8c thru 0x93ea284 (0x72f9 bytes) 2024-09-18T05:13:56.972 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:56.971+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:56.975 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:13:56.980 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:56.980 INFO:teuthology.orchestra.run.smithi017.stdout:549 write 0x16888d thru 0x16dcf0 (0x5464 bytes) 2024-09-18T05:13:57.016 INFO:teuthology.orchestra.run.smithi017.stdout:550 write 0xc036567 thru 0xc0415fe (0xb098 bytes) 2024-09-18T05:13:57.017 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:13:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:13:57.018 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:57.026 INFO:teuthology.orchestra.run.smithi017.stdout:551 read 0xb6953ba thru 0xb6a33e8 (0xe02f bytes) 2024-09-18T05:13:57.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:13:57.039 INFO:teuthology.orchestra.run.smithi017.stdout:552 writesame 0xce04ca0 thru 0xce0f968 data_size 0x7(0xacc9 bytes) 2024-09-18T05:13:57.056 INFO:teuthology.orchestra.run.smithi017.stdout:553 trunc from 0xce0f969 to 0x7d36d0 2024-09-18T05:13:57.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:57.066+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:57.156 INFO:teuthology.orchestra.run.smithi017.stdout:554 write 0xc91b59f thru 0xc928377 (0xcdd9 bytes) 2024-09-18T05:13:57.165 INFO:teuthology.orchestra.run.smithi017.stdout:557 write 0x64e5329 thru 0x64f3df6 (0xeace bytes) 2024-09-18T05:13:57.173 INFO:teuthology.orchestra.run.smithi017.stdout:558 write 0x21b6e46 thru 0x21b9d45 (0x2f00 bytes) 2024-09-18T05:13:57.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:57.166+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:57.179 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:57.179 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:57.185 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:13:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:13:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:13:57.185 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:57.194 INFO:teuthology.orchestra.run.smithi017.stdout:564 trunc from 0xc928378 to 0x4dec440 2024-09-18T05:13:57.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:13:57.223 INFO:teuthology.orchestra.run.smithi017.stdout:565 trunc from 0x4dec440 to 0x238f882 2024-09-18T05:13:57.263 INFO:teuthology.orchestra.run.smithi017.stdout:566 write 0x97a12f1 thru 0x97b073b (0xf44b bytes) 2024-09-18T05:13:57.272 INFO:teuthology.orchestra.run.smithi017.stdout:567 writesame 0x49f4ae3 thru 0x49fd5ee data_size 0x16(0x8b0c bytes) 2024-09-18T05:13:57.273 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:57.271+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:57.280 INFO:teuthology.orchestra.run.smithi017.stdout:568 read 0x8cb9b5 thru 0x8ce831 (0x2e7d bytes) 2024-09-18T05:13:57.281 INFO:teuthology.orchestra.run.smithi017.stdout:569 read 0x642627a thru 0x642cfed (0x6d74 bytes) 2024-09-18T05:13:57.281 INFO:teuthology.orchestra.run.smithi017.stdout:570 clone 4 order 23 su 524288 sc 9 2024-09-18T05:13:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1452 3.12 3:4bd21895:::rbd_data.118b4598dbfb.0000000000000030:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.818668+0000", 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.5239264549999998, 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085655969999999994, 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1452 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818668+0000", 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818668+0000", 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818667+0000", 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818675+0000", 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1270000000000003e-06 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818694+0000", 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8899e-05 2024-09-18T05:13:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.818710+0000", 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5486999999999999e-05 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.819852+0000", 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011427340000000001 2024-09-18T05:13:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.820198+0000", 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034537800000000003 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.820508+0000", 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000310527 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822390+0000", 2024-09-18T05:13:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001882119 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826998+0000", 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046074480000000001 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.827139+0000", 2024-09-18T05:13:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141042 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.827234+0000", 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5023000000000001e-05 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1498 3.17 3:ecb92100:::rbd_data.118b4598dbfb.000000000000009c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.844346+0000", 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.4982484879999998, 2024-09-18T05:13:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094984240000000001, 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1498 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844346+0000", 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844346+0000", 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844331+0000", 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999843 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844356+0000", 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.586e-05 2024-09-18T05:13:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844390+0000", 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3340000000000003e-05 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844407+0000", 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7467000000000001e-05 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844508+0000", 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100492 2024-09-18T05:13:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844707+0000", 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019911000000000001 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.844839+0000", 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132559 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846090+0000", 2024-09-18T05:13:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001250541 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.853692+0000", 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0076019599999999996 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.853771+0000", 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8759999999999998e-05 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.853845+0000", 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4041999999999993e-05 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1503 3.12 3:48b8c1ae:::rbd_data.118b4598dbfb.00000000000000a1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.846751+0000", 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.4958441210000002, 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010841952, 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1503 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846751+0000", 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846751+0000", 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846749+0000", 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846761+0000", 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2232000000000001e-05 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846791+0000", 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9515000000000001e-05 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846807+0000", 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6354999999999998e-05 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.846967+0000", 2024-09-18T05:13:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016001700000000001 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.847132+0000", 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000165348 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.847366+0000", 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023328499999999999 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.848691+0000", 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001325147 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.857445+0000", 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0087538530000000007 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.857512+0000", 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7441999999999996e-05 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.857593+0000", 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0623000000000004e-05 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:2318 3.6 3:64ee52fe:::rbd_data.118b4598dbfb.0000000000000057:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.473264+0000", 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8693302880000005, 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091971929999999993, 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2318 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473264+0000", 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473264+0000", 2024-09-18T05:13:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473262+0000", 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473279+0000", 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7053000000000001e-05 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473318+0000", 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8834000000000001e-05 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473340+0000", 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2549999999999999e-05 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473431+0000", 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0543000000000004e-05 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.473607+0000", 2024-09-18T05:13:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017654300000000001 2024-09-18T05:13:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-18T05:13:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.474900+0000", 2024-09-18T05:13:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012928810000000001 2024-09-18T05:13:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.482276+0000", 2024-09-18T05:13:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0073758340000000004 2024-09-18T05:13:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.482298+0000", 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1866e-05 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.482392+0000", 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4596e-05 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.482462+0000", 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9170000000000004e-05 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:5964 3.17 3:e80a67c2:::rbd_data.118b4598dbfb.000000000000004d:5 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.157575+0000", 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.185020017, 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086439640000000005, 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5964 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157575+0000", 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157575+0000", 2024-09-18T05:13:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157574+0000", 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157577+0000", 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1660000000000001e-06 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157583+0000", 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157588+0000", 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1209999999999998e-06 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.166021+0000", 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084330429999999994 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.166138+0000", 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011702 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.166219+0000", 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0438000000000005e-05 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:5965 3.17 3:e80a67c2:::rbd_data.118b4598dbfb.000000000000004d:5 [read 417792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.157593+0000", 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1850020100000001, 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0088067460000000007, 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 5965 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157593+0000", 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157593+0000", 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157592+0000", 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157595+0000", 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2869999999999999e-06 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157600+0000", 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7939999999999999e-06 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.157605+0000", 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7339999999999999e-06 2024-09-18T05:13:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.166248+0000", 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086427129999999998 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.166329+0000", 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1514000000000006e-05 2024-09-18T05:13:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.166399+0000", 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0048000000000004e-05 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:6740 3.17 3:eadf21ef:::rbd_data.118b4598dbfb.000000000000007d:5 [read 286720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.198880+0000", 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.14371457, 2024-09-18T05:13:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0099532419999999993, 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6740 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198880+0000", 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198880+0000", 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198880+0000", 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198882+0000", 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1449999999999998e-06 2024-09-18T05:13:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198888+0000", 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8919999999999997e-06 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198892+0000", 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2339999999999996e-06 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.208613+0000", 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0097207749999999992 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.208720+0000", 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106952 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.208833+0000", 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113557 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:6741 3.17 3:eadf21ef:::rbd_data.118b4598dbfb.000000000000007d:5 [read 294912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.198902+0000", 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.143693179, 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010127503, 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6741 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198902+0000", 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198902+0000", 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198901+0000", 2024-09-18T05:13:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198904+0000", 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.621e-06 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198911+0000", 2024-09-18T05:13:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7050000000000002e-06 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198919+0000", 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.918e-06 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.208863+0000", 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0099432919999999994 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.208947+0000", 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3871999999999999e-05 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209029+0000", 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2461999999999998e-05 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:6742 3.17 3:eadf21ef:::rbd_data.118b4598dbfb.000000000000007d:5 [read 303104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.198925+0000", 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.143670108, 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010293267, 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6742 2024-09-18T05:13:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198925+0000", 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198925+0000", 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198924+0000", 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198927+0000", 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198933+0000", 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.806e-06 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198937+0000", 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7319999999999998e-06 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209056+0000", 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010118976999999999 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209138+0000", 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2037000000000001e-05 2024-09-18T05:13:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209218+0000", 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9481999999999996e-05 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:6743 3.17 3:eadf21ef:::rbd_data.118b4598dbfb.000000000000007d:5 [read 311296~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.198941+0000", 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1436534709999999, 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010697742, 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6743 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198941+0000", 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198941+0000", 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198941+0000", 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198943+0000", 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3120000000000001e-06 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198949+0000", 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8259999999999998e-06 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198954+0000", 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6720000000000003e-06 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209244+0000", 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010289937000000001 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209319+0000", 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5488999999999995e-05 2024-09-18T05:13:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209639+0000", 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031985299999999999 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:6801 3.17 3:eadf21ef:::rbd_data.118b4598dbfb.000000000000007d:5 [read 217088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.198958+0000", 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.14363696, 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010904192, 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6801 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198958+0000", 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198958+0000", 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198957+0000", 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198961+0000", 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2509999999999999e-06 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198968+0000", 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1420000000000004e-06 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198973+0000", 2024-09-18T05:13:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0189999999999997e-06 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209670+0000", 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010696803 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209760+0000", 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0148999999999994e-05 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209862+0000", 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000102168 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:6802 3.17 3:eadf21ef:::rbd_data.118b4598dbfb.000000000000007d:5 [read 225280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.198977+0000", 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1436176579999999, 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011105063, 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 6802 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198977+0000", 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198977+0000", 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198977+0000", 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.198979+0000", 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2239999999999998e-06 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.202550+0000", 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035711359999999999 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.202560+0000", 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7359999999999996e-06 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209892+0000", 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.007332173 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.209985+0000", 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2501000000000001e-05 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.210082+0000", 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7641999999999998e-05 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:7328 3.1b 3:db7e9c32:::rbd_data.118b29ff732c.0000000000000086:head [delete] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.236798+0000", 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.1057967849999999, 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010282727, 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 7328 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.236798+0000", 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.236798+0000", 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.236797+0000", 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.236801+0000", 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.157e-06 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.236807+0000", 2024-09-18T05:13:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8260000000000004e-06 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.236812+0000", 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1619999999999999e-06 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.238118+0000", 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013053159999999999 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.238195+0000", 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6994000000000002e-05 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.238369+0000", 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017393899999999999 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.239340+0000", 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097173500000000005 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.246989+0000", 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0076481509999999997 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.247041+0000", 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2033000000000001e-05 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.247081+0000", 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0027999999999997e-05 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:7822 3.1 3:85abe841:::rbd_data.118b4598dbfb.00000000000000b2:5 [read 249856~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.285619+0000", 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.056975929, 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014937479, 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 7822 2024-09-18T05:13:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285619+0000", 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285619+0000", 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285618+0000", 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285621+0000", 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3929999999999998e-06 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285627+0000", 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3709999999999996e-06 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285632+0000", 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1880000000000001e-06 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.293249+0000", 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0076162529999999999 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.293382+0000", 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013356199999999999 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.300556+0000", 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071741770000000003 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:7826 3.1 3:85abe841:::rbd_data.118b4598dbfb.00000000000000b2:5 [read 282624~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.285687+0000", 2024-09-18T05:13:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.056907434, 2024-09-18T05:13:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085248349999999997, 2024-09-18T05:13:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 7826 2024-09-18T05:13:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285687+0000", 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285687+0000", 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285687+0000", 2024-09-18T05:13:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285689+0000", 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0669999999999999e-06 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285695+0000", 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9039999999999997e-06 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285700+0000", 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6909999999999996e-06 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294067+0000", 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0083669799999999996 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294143+0000", 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6205999999999995e-05 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294212+0000", 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9301999999999995e-05 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:7827 3.1 3:85abe841:::rbd_data.118b4598dbfb.00000000000000b2:5 [read 290816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.285705+0000", 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.0568898229999999, 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086851840000000003, 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 7827 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285705+0000", 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285705+0000", 2024-09-18T05:13:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285705+0000", 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285707+0000", 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.277e-06 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285722+0000", 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4651000000000001e-05 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285727+0000", 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8159999999999999e-06 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294234+0000", 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085068379999999992 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294316+0000", 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1505e-05 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294390+0000", 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4407999999999996e-05 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:7828 3.1 3:85abe841:::rbd_data.118b4598dbfb.00000000000000b2:5 [read 299008~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.285733+0000", 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.056861783, 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0088548680000000001, 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 7828 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285733+0000", 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285733+0000", 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285732+0000", 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285735+0000", 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285742+0000", 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9480000000000002e-06 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285748+0000", 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1259999999999997e-06 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294415+0000", 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086678250000000005 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294502+0000", 2024-09-18T05:13:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7151000000000006e-05 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294588+0000", 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5334999999999995e-05 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:7829 3.1 3:85abe841:::rbd_data.118b4598dbfb.00000000000000b2:5 [read 307200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.285753+0000", 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.0568420270000001, 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0090211670000000001, 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 7829 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285753+0000", 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285753+0000", 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285752+0000", 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285755+0000", 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7e-06 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285761+0000", 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1800000000000001e-06 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.285766+0000", 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6469999999999997e-06 2024-09-18T05:13:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294613+0000", 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0088475949999999998 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294702+0000", 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8425999999999997e-05 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.294774+0000", 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2125999999999994e-05 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:8011 3.1 3:85abe841:::rbd_data.118b4598dbfb.00000000000000b2:5 [read 401408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.292071+0000", 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.0505240339999999, 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086196039999999995, 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 8011 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292071+0000", 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292071+0000", 2024-09-18T05:13:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292070+0000", 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292073+0000", 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.056e-06 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292080+0000", 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0480000000000001e-06 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292086+0000", 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1390000000000003e-06 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.300245+0000", 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00815923 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.300304+0000", 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9706000000000001e-05 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.300690+0000", 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038586700000000002 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:8012 3.1 3:85abe841:::rbd_data.118b4598dbfb.00000000000000b2:5 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.292090+0000", 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.0505046300000001, 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0088418990000000003, 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 8012 2024-09-18T05:13:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292090+0000", 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292090+0000", 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292090+0000", 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292097+0000", 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7130000000000005e-06 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292104+0000", 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8859999999999998e-06 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.292109+0000", 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9779999999999996e-06 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.300720+0000", 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086108680000000007 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.300860+0000", 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013974199999999999 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.300932+0000", 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2247000000000001e-05 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.452 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:57.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:13:57.454 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:57.451+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:57.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:13:57.546+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:13:57.625 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:57.625 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:13:57.626 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:13:57.626 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:57.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:13:57.683 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:57.678+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:57.757 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:57.755+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:57.810 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:13:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:13:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:13:57.811 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:57.824 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:13:57.871 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:57.866+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:57.901 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:13:57.953 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:13:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:13:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:13:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:895 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 1957888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.349901+0000", 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5987012069999995, 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030452495, 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349901+0000", 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349901+0000", 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349900+0000", 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:13:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349903+0000", 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1930000000000002e-06 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349920+0000", 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7133e-05 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349927+0000", 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1439999999999997e-06 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380205+0000", 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030277615000000001 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380263+0000", 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8318e-05 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380353+0000", 2024-09-18T05:13:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9819000000000002e-05 2024-09-18T05:13:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:896 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 2080768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.349933+0000", 2024-09-18T05:13:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5986683949999998, 2024-09-18T05:13:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030598655999999998, 2024-09-18T05:13:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 896 2024-09-18T05:13:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349933+0000", 2024-09-18T05:13:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349933+0000", 2024-09-18T05:13:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349933+0000", 2024-09-18T05:13:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349936+0000", 2024-09-18T05:13:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1429999999999998e-06 2024-09-18T05:13:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349949+0000", 2024-09-18T05:13:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3137e-05 2024-09-18T05:13:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349961+0000", 2024-09-18T05:13:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1705999999999999e-05 2024-09-18T05:13:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380395+0000", 2024-09-18T05:13:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030434095000000001 2024-09-18T05:13:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380453+0000", 2024-09-18T05:13:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8446999999999998e-05 2024-09-18T05:13:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380532+0000", 2024-09-18T05:13:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8720999999999994e-05 2024-09-18T05:13:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:897 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.349967+0000", 2024-09-18T05:13:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5986348150000005, 2024-09-18T05:13:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030748013000000001, 2024-09-18T05:13:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 897 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349967+0000", 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349967+0000", 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349966+0000", 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349969+0000", 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1970000000000001e-06 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349987+0000", 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7963000000000001e-05 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.349995+0000", 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.357e-06 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380572+0000", 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030577301000000001 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380631+0000", 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8987999999999998e-05 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380715+0000", 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3824000000000002e-05 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:898 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 122880~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350001+0000", 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5986006079999999, 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030894765000000001, 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350001+0000", 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350001+0000", 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350000+0000", 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350004+0000", 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2600000000000001e-06 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350017+0000", 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3097e-05 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350024+0000", 2024-09-18T05:13:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.917e-06 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380757+0000", 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030733089000000002 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380816+0000", 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9002000000000002e-05 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380896+0000", 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0043999999999995e-05 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:899 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 245760~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350030+0000", 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5985720949999997, 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031131260000000001, 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 899 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350030+0000", 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350030+0000", 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350029+0000", 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350032+0000", 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1200000000000002e-06 2024-09-18T05:13:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350041+0000", 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4060000000000005e-06 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350047+0000", 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6800000000000004e-06 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.380939+0000", 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030892167000000002 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.381012+0000", 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2154000000000001e-05 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.381161+0000", 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014934599999999999 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:900 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 368640~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350057+0000", 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5985449149999997, 2024-09-18T05:13:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031645057999999997, 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 900 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350057+0000", 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350057+0000", 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350056+0000", 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350060+0000", 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.98e-06 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350071+0000", 2024-09-18T05:13:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0686000000000001e-05 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350088+0000", 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7105999999999999e-05 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.381258+0000", 2024-09-18T05:13:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031170165999999999 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.381463+0000", 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020504099999999999 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.381702+0000", 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000238679 2024-09-18T05:13:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:901 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350095+0000", 2024-09-18T05:13:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.598507133, 2024-09-18T05:13:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031931056999999999, 2024-09-18T05:13:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 901 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350095+0000", 2024-09-18T05:13:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350095+0000", 2024-09-18T05:13:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350094+0000", 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350097+0000", 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1829999999999998e-06 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350108+0000", 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.102e-05 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350115+0000", 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7900000000000002e-06 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.381781+0000", 2024-09-18T05:13:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031666370999999999 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.381903+0000", 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121755 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.382026+0000", 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012255400000000001 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:902 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 614400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350124+0000", 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5984776929999995, 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.032335693999999998, 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 902 2024-09-18T05:13:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350124+0000", 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350124+0000", 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350123+0000", 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350127+0000", 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1760000000000002e-06 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350140+0000", 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.296e-05 2024-09-18T05:13:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350147+0000", 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9439999999999999e-06 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.382097+0000", 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.031950368999999999 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.382292+0000", 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019527300000000001 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.382460+0000", 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016756799999999999 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:903 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 737280~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350153+0000", 2024-09-18T05:13:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5984489430000002, 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.032643367999999999, 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350153+0000", 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350153+0000", 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350152+0000", 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350155+0000", 2024-09-18T05:13:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1970000000000001e-06 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350165+0000", 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6970000000000005e-06 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350174+0000", 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3330000000000003e-06 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.382543+0000", 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.032368312000000003 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.382664+0000", 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118800000000001 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.382796+0000", 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132311 2024-09-18T05:13:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:904 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 860160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350232+0000", 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5983692899999999, 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.032916951999999999, 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 904 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350232+0000", 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350232+0000", 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350232+0000", 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350244+0000", 2024-09-18T05:13:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2213e-05 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350254+0000", 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8570000000000007e-06 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350264+0000", 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7569999999999999e-06 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.382880+0000", 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.032616935999999999 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383017+0000", 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013698000000000001 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383149+0000", 2024-09-18T05:13:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013195599999999999 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:905 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350270+0000", 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5983314970000002, 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033156772000000001, 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 905 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350270+0000", 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350270+0000", 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350270+0000", 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350273+0000", 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.49e-06 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350283+0000", 2024-09-18T05:13:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0033e-05 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350302+0000", 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8703e-05 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383201+0000", 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.032899376000000001 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383306+0000", 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105225 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383427+0000", 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120668 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:906 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 1105920~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350308+0000", 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5982934039999996, 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033424927, 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 906 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350308+0000", 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350308+0000", 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350308+0000", 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350311+0000", 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4060000000000001e-06 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350322+0000", 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1e-05 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350329+0000", 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.063e-06 2024-09-18T05:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383500+0000", 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033171297000000002 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383609+0000", 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108859 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383733+0000", 2024-09-18T05:13:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012389500000000001 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:907 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 1228800~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350336+0000", 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.598266228, 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033678523000000002, 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350336+0000", 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350336+0000", 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350335+0000", 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350338+0000", 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0170000000000001e-06 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350348+0000", 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0506000000000001e-05 2024-09-18T05:13:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350355+0000", 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8770000000000004e-06 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383784+0000", 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033428263 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.383886+0000", 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010283100000000001 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.384014+0000", 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127639 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:908 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 1351680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350361+0000", 2024-09-18T05:13:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5982403810000001, 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034048716, 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 908 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350361+0000", 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350361+0000", 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350361+0000", 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350364+0000", 2024-09-18T05:13:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.044e-06 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350372+0000", 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3100000000000001e-06 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350379+0000", 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.63e-06 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.384115+0000", 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.033736614999999998 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.384228+0000", 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112157 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.384410+0000", 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000182564 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:909 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 1474560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350385+0000", 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.598216571, 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034383473999999997, 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 909 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.029 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350385+0000", 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350385+0000", 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350385+0000", 2024-09-18T05:13:58.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350387+0000", 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9440000000000001e-06 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350399+0000", 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1556000000000001e-05 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350428+0000", 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8484e-05 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.384489+0000", 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034061543 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.384615+0000", 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012591600000000001 2024-09-18T05:13:58.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.384769+0000", 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000153635 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.033 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:910 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 1597440~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350439+0000", 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5981630180000002, 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034864483000000002, 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 910 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350439+0000", 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350439+0000", 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350438+0000", 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350441+0000", 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4699999999999998e-06 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350455+0000", 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3353000000000001e-05 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350462+0000", 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8870000000000003e-06 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.384867+0000", 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034404984 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.385058+0000", 2024-09-18T05:13:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019082100000000001 2024-09-18T05:13:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.385303+0000", 2024-09-18T05:13:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000245665 2024-09-18T05:13:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:911 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 1720320~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350468+0000", 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5981340560000001, 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.035181740000000003, 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 911 2024-09-18T05:13:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350468+0000", 2024-09-18T05:13:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350468+0000", 2024-09-18T05:13:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350467+0000", 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350483+0000", 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5447e-05 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350492+0000", 2024-09-18T05:13:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0170000000000002e-06 2024-09-18T05:13:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350498+0000", 2024-09-18T05:13:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7530000000000004e-06 2024-09-18T05:13:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.385360+0000", 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.034861663000000001 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.385511+0000", 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015056100000000001 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.385649+0000", 2024-09-18T05:13:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013890899999999999 2024-09-18T05:13:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:912 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 1843200~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350504+0000", 2024-09-18T05:13:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5980972690000002, 2024-09-18T05:13:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.035604706, 2024-09-18T05:13:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.046 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 912 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350504+0000", 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350504+0000", 2024-09-18T05:13:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350504+0000", 2024-09-18T05:13:58.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:13:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350514+0000", 2024-09-18T05:13:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0484e-05 2024-09-18T05:13:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350523+0000", 2024-09-18T05:13:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6559999999999998e-06 2024-09-18T05:13:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350544+0000", 2024-09-18T05:13:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0927000000000001e-05 2024-09-18T05:13:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.385732+0000", 2024-09-18T05:13:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.035188177000000001 2024-09-18T05:13:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.385919+0000", 2024-09-18T05:13:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000187343 2024-09-18T05:13:58.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.386109+0000", 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018971600000000001 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.052 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:913 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 1966080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350605+0000", 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5979965729999996, 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.035815755999999997, 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 913 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.053 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350605+0000", 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350605+0000", 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350604+0000", 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350609+0000", 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8570000000000003e-06 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350623+0000", 2024-09-18T05:13:58.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4229999999999999e-05 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350631+0000", 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3030000000000002e-06 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.386174+0000", 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.035543410999999997 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.386298+0000", 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123786 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.386421+0000", 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012318299999999999 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:914 3.19 3:9f6ad125:::rbd_data.118bc12db472.0000000000000007:4 [read 2088960~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.350637+0000", 2024-09-18T05:13:58.057 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5979648629999996, 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036063370999999997, 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 914 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350637+0000", 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350637+0000", 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350636+0000", 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350639+0000", 2024-09-18T05:13:58.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3000000000000002e-06 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350648+0000", 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7129999999999994e-06 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.350660+0000", 2024-09-18T05:13:58.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.186e-05 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.386465+0000", 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.035804500000000003 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.386567+0000", 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000102249 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:13:58.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.386700+0000", 2024-09-18T05:13:58.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013347899999999999 2024-09-18T05:13:58.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.062 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:58.062 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:58.062 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:58.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:13:58.064 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:13:58.064 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:13:58.065 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:58.058+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:58.072 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:13:58.072 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:13:58.090 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:13:58.090 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:13:58.106 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:13:58.107 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:13:58.116 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone3 from 0x97b073c (overlap 0x7d36d0) to 0x4b20e3 2024-09-18T05:13:58.131 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:13:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:13:58.162 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:13:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:13:58.170 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:58.158+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:58.186 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:13:58.187 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:13:58.204 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:58.204 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:58.205 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:13:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:13:58.223 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:13:58.264 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:58.263+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:58.307 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-18T05:13:58.365 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:58.358+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:58.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:13:58.466 INFO:teuthology.orchestra.run.smithi017.stdout:571 punch from 0x1b85b15 to 0x1b8f466, (0x9951 bytes) 2024-09-18T05:13:58.466 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:58.458+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:58.479 INFO:teuthology.orchestra.run.smithi017.stdout:572 trunc from 0x97b073c to 0xe92b6bc 2024-09-18T05:13:58.490 INFO:teuthology.orchestra.run.smithi017.stdout:573 write 0x1039520 thru 0x103be2c (0x290d bytes) 2024-09-18T05:13:58.512 INFO:teuthology.orchestra.run.smithi017.stdout:574 writesame 0x688d9b9 thru 0x6896f94 data_size 0x5c(0x95dc bytes) 2024-09-18T05:13:58.522 INFO:teuthology.orchestra.run.smithi017.stdout:575 trunc from 0xe92b6bc to 0xca48b84 2024-09-18T05:13:58.545 INFO:teuthology.orchestra.run.smithi017.stdout:576 write 0x1545ddd thru 0x1550999 (0xabbd bytes) 2024-09-18T05:13:58.566 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:58.567+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:58.578 INFO:teuthology.orchestra.run.smithi017.stdout:577 trunc from 0xca48b84 to 0x1195935 2024-09-18T05:13:58.626 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:58.626 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:58.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:13:58.667 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:58.667+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:58.672 INFO:teuthology.orchestra.run.smithi017.stdout:578 write 0xe238553 thru 0xe24198f (0x943d bytes) 2024-09-18T05:13:58.676 INFO:teuthology.orchestra.run.smithi017.stdout:579 writesame 0x1eaa1c2 thru 0x1eb8ed3 data_size 0x2a(0xed12 bytes) 2024-09-18T05:13:58.680 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:58.680 INFO:teuthology.orchestra.run.smithi017.stdout:581 write 0xabebd33 thru 0xabfbc0f (0xfedd bytes) 2024-09-18T05:13:58.696 INFO:teuthology.orchestra.run.smithi017.stdout:582 trunc from 0xe241990 to 0x604f6a3 2024-09-18T05:13:58.712 INFO:teuthology.orchestra.run.smithi017.stdout:583 writesame 0x32f5209 thru 0x32fa7e8 data_size 0x30(0x55e0 bytes) 2024-09-18T05:13:58.715 INFO:teuthology.orchestra.run.smithi017.stdout:584 write 0x5bf1d39 thru 0x5bfc76a (0xaa32 bytes) 2024-09-18T05:13:58.729 INFO:teuthology.orchestra.run.smithi017.stdout:585 trunc from 0x604f6a3 to 0xbded0d6 2024-09-18T05:13:58.740 INFO:teuthology.orchestra.run.smithi017.stdout:586 write 0x8fb5a12 thru 0x8fb847c (0x2a6b bytes) 2024-09-18T05:13:58.744 INFO:teuthology.orchestra.run.smithi017.stdout:587 read 0xb0dd24a thru 0xb0df9a9 (0x2760 bytes) 2024-09-18T05:13:58.744 INFO:teuthology.orchestra.run.smithi017.stdout:588 read 0x42d66d2 thru 0x42d844c (0x1d7b bytes) 2024-09-18T05:13:58.745 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:58.745 INFO:teuthology.orchestra.run.smithi017.stdout:594 write 0x55bcdf thru 0x56a83f (0xeb61 bytes) 2024-09-18T05:13:58.748 INFO:teuthology.orchestra.run.smithi017.stdout:595 punch from 0x3667bab to 0x3667d84, (0x1d9 bytes) 2024-09-18T05:13:58.748 INFO:teuthology.orchestra.run.smithi017.stdout:596 read 0x9c22a83 thru 0x9c25b86 (0x3104 bytes) 2024-09-18T05:13:58.748 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:58.748 INFO:teuthology.orchestra.run.smithi017.stdout:598 read 0x228b237 thru 0x2297132 (0xbefc bytes) 2024-09-18T05:13:58.752 INFO:teuthology.orchestra.run.smithi017.stdout:599 trunc from 0xbded0d6 to 0x99099c6 2024-09-18T05:13:58.762 INFO:teuthology.orchestra.run.smithi017.stdout:600 write 0x43504cc thru 0x4350a66 (0x59b bytes) 2024-09-18T05:13:58.764 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:58.764 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:58.764 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:58.765 INFO:teuthology.orchestra.run.smithi017.stdout:605 read 0x8f45398 thru 0x8f46726 (0x138f bytes) 2024-09-18T05:13:58.765 INFO:teuthology.orchestra.run.smithi017.stdout:606 punch from 0x6897bfb to 0x689dd6f, (0x6174 bytes) 2024-09-18T05:13:58.765 INFO:teuthology.orchestra.run.smithi017.stdout:607 read 0x49efee6 thru 0x49f8bbd (0x8cd8 bytes) 2024-09-18T05:13:58.765 INFO:teuthology.orchestra.run.smithi017.stdout:608 write 0x290f55f thru 0x29156af (0x6151 bytes) 2024-09-18T05:13:58.767 INFO:teuthology.orchestra.run.smithi017.stdout:610 write 0x70a6ed5 thru 0x70b6225 (0xf351 bytes) 2024-09-18T05:13:58.768 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:13:58.762+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:13:58.784 INFO:teuthology.orchestra.run.smithi017.stdout:611 trunc from 0x99099c6 to 0x1c26808 2024-09-18T05:13:58.811 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:58.811 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:58.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:13:58.840 INFO:teuthology.orchestra.run.smithi017.stdout:612 write 0xe2d4de2 thru 0xe2e3e74 (0xf093 bytes) 2024-09-18T05:13:58.851 INFO:teuthology.orchestra.run.smithi017.stdout:613 trunc from 0xe2e3e75 to 0xabf8d8c 2024-09-18T05:13:58.869 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:13:58.867+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:13:58.878 INFO:teuthology.orchestra.run.smithi017.stdout:614 trunc from 0xabf8d8c to 0x516a735 2024-09-18T05:13:58.890 INFO:teuthology.orchestra.run.smithi017.stdout:615 writesame 0x48faf46 thru 0x490663a data_size 0x1(0xb6f5 bytes) 2024-09-18T05:13:58.929 INFO:teuthology.orchestra.run.smithi017.stdout:616 trunc from 0x516a735 to 0x1afb65a 2024-09-18T05:13:58.955 INFO:teuthology.orchestra.run.smithi017.stdout:617 read 0x1151810 thru 0x1157787 (0x5f78 bytes) 2024-09-18T05:13:58.968 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:58.968 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:58.971 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:58.971+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:58.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:13:58.988 INFO:teuthology.orchestra.run.smithi017.stdout:619 write 0x96ff80b thru 0x97044fe (0x4cf4 bytes) 2024-09-18T05:13:58.998 INFO:teuthology.orchestra.run.smithi017.stdout:621 write 0x1241a75 thru 0x124ed3f (0xd2cb bytes) 2024-09-18T05:13:59.002 INFO:teuthology.orchestra.run.smithi017.stdout:622 read 0x452ea0e thru 0x45396b5 (0xaca8 bytes) 2024-09-18T05:13:59.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:13:59.003 INFO:teuthology.orchestra.run.smithi017.stdout:624 writesame 0x2342b7f thru 0x2345de6 data_size 0x4(0x3268 bytes) 2024-09-18T05:13:59.008 INFO:teuthology.orchestra.run.smithi017.stdout:625 read 0x3bc5140 thru 0x3bccc11 (0x7ad2 bytes) 2024-09-18T05:13:59.009 INFO:teuthology.orchestra.run.smithi017.stdout:626 punch from 0x1b8d27b to 0x1b9a5d0, (0xd355 bytes) 2024-09-18T05:13:59.029 INFO:teuthology.orchestra.run.smithi017.stdout:627 write 0xe720d8e thru 0xe7276bc (0x692f bytes) 2024-09-18T05:13:59.035 INFO:teuthology.orchestra.run.smithi017.stdout:628 read 0x4aea7a3 thru 0x4aef3d3 (0x4c31 bytes) 2024-09-18T05:13:59.035 INFO:teuthology.orchestra.run.smithi017.stdout:629 read 0x259d169 thru 0x25a86b8 (0xb550 bytes) 2024-09-18T05:13:59.038 INFO:teuthology.orchestra.run.smithi017.stdout:630 punch from 0xa52e63b to 0xa535025, (0x69ea bytes) 2024-09-18T05:13:59.038 INFO:teuthology.orchestra.run.smithi017.stdout:631 read 0xe37c1e7 thru 0xe380e2e (0x4c48 bytes) 2024-09-18T05:13:59.038 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.038 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.038 INFO:teuthology.orchestra.run.smithi017.stdout:635 punch from 0x71a18e4 to 0x71ad26c, (0xb988 bytes) 2024-09-18T05:13:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:636 read 0x5c877a9 thru 0x5c8d869 (0x60c1 bytes) 2024-09-18T05:13:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:637 write 0x6efa293 thru 0x6f023e4 (0x8152 bytes) 2024-09-18T05:13:59.043 INFO:teuthology.orchestra.run.smithi017.stdout:638 write 0x8497245 thru 0x8499bec (0x29a8 bytes) 2024-09-18T05:13:59.048 INFO:teuthology.orchestra.run.smithi017.stdout:640 read 0x33e6d1b thru 0x33e8fb5 (0x229b bytes) 2024-09-18T05:13:59.057 INFO:teuthology.orchestra.run.smithi017.stdout:641 trunc from 0xe7276bd to 0x8dfe94d 2024-09-18T05:13:59.072 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:59.066+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:59.099 INFO:teuthology.orchestra.run.smithi017.stdout:643 write 0xe5261b4 thru 0xe53493a (0xe787 bytes) 2024-09-18T05:13:59.104 INFO:teuthology.orchestra.run.smithi017.stdout:645 read 0xce31212 thru 0xce3ecd0 (0xdabf bytes) 2024-09-18T05:13:59.105 INFO:teuthology.orchestra.run.smithi017.stdout:646 read 0xb8af51f thru 0xb8bf3bd (0xfe9f bytes) 2024-09-18T05:13:59.123 INFO:teuthology.orchestra.run.smithi017.stdout:647 trunc from 0xe53493b to 0x2cb00a2 2024-09-18T05:13:59.126 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:59.126 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:59.145 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:13:59.147 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.147 INFO:teuthology.orchestra.run.smithi017.stdout:649 read 0xf55e86 thru 0xf65b20 (0xfc9b bytes) 2024-09-18T05:13:59.148 INFO:teuthology.orchestra.run.smithi017.stdout:652 read 0x255fd23 thru 0x2565ef7 (0x61d5 bytes) 2024-09-18T05:13:59.148 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.148 INFO:teuthology.orchestra.run.smithi017.stdout:654 read 0x28d999e thru 0x28e4a66 (0xb0c9 bytes) 2024-09-18T05:13:59.163 INFO:teuthology.orchestra.run.smithi017.stdout:656 trunc from 0x2cb00a2 to 0xaecd7ab 2024-09-18T05:13:59.171 INFO:teuthology.orchestra.run.smithi017.stdout:657 write 0x8d655a2 thru 0x8d6d504 (0x7f63 bytes) 2024-09-18T05:13:59.179 INFO:teuthology.orchestra.run.smithi017.stdout:659 trunc from 0xaecd7ab to 0xdd31dcb 2024-09-18T05:13:59.191 INFO:teuthology.orchestra.run.smithi017.stdout:660 read 0x2e2c89c thru 0x2e3ab02 (0xe267 bytes) 2024-09-18T05:13:59.191 INFO:teuthology.orchestra.run.smithi017.stdout:661 write 0x7139343 thru 0x7143f79 (0xac37 bytes) 2024-09-18T05:13:59.194 INFO:teuthology.orchestra.run.smithi017.stdout:663 trunc from 0xdd31dcb to 0xb8ce89b 2024-09-18T05:13:59.194 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:59.195+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:59.201 INFO:teuthology.orchestra.run.smithi017.stdout:664 read 0xb2973ab thru 0xb2a6468 (0xf0be bytes) 2024-09-18T05:13:59.201 INFO:teuthology.orchestra.run.smithi017.stdout:665 write 0x5891d7d thru 0x5899084 (0x7308 bytes) 2024-09-18T05:13:59.214 INFO:teuthology.orchestra.run.smithi017.stdout:666 trunc from 0xb8ce89b to 0x4a5957c 2024-09-18T05:13:59.244 INFO:teuthology.orchestra.run.smithi017.stdout:667 write 0x93603e0 thru 0x9365835 (0x5456 bytes) 2024-09-18T05:13:59.249 INFO:teuthology.orchestra.run.smithi017.stdout:669 punch from 0x74a0c15 to 0x74aa195, (0x9580 bytes) 2024-09-18T05:13:59.249 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.249 INFO:teuthology.orchestra.run.smithi017.stdout:671 read 0x29d73f5 thru 0x29e652e (0xf13a bytes) 2024-09-18T05:13:59.250 INFO:teuthology.orchestra.run.smithi017.stdout:672 writesame 0x67f9bd4 thru 0x67fb443 data_size 0x22(0x1870 bytes) 2024-09-18T05:13:59.255 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.255 INFO:teuthology.orchestra.run.smithi017.stdout:674 read 0x5ccc833 thru 0x5ccf521 (0x2cef bytes) 2024-09-18T05:13:59.255 INFO:teuthology.orchestra.run.smithi017.stdout:675 writesame 0x63ffb80 thru 0x6406ae6 data_size 0x1(0x6f67 bytes) 2024-09-18T05:13:59.274 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:59.266+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:59.282 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:59.283 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:59.291 INFO:teuthology.orchestra.run.smithi017.stdout:676 read 0x35d5eee thru 0x35e4060 (0xe173 bytes) 2024-09-18T05:13:59.292 INFO:teuthology.orchestra.run.smithi017.stdout:678 read 0xc1b80b thru 0xc21ef6 (0x66ec bytes) 2024-09-18T05:13:59.292 INFO:teuthology.orchestra.run.smithi017.stdout:680 read 0x3993ab thru 0x3a6d75 (0xd9cb bytes) 2024-09-18T05:13:59.293 INFO:teuthology.orchestra.run.smithi017.stdout:681 write 0x83bb968 thru 0x83c8bc0 (0xd259 bytes) 2024-09-18T05:13:59.297 INFO:teuthology.orchestra.run.smithi017.stdout:683 read 0x3a1f36f thru 0x3a2f10a (0xfd9c bytes) 2024-09-18T05:13:59.297 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.298 INFO:teuthology.orchestra.run.smithi017.stdout:686 writesame 0x782e846 thru 0x783b54c data_size 0x1(0xcd07 bytes) 2024-09-18T05:13:59.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:13:59.333 INFO:teuthology.orchestra.run.smithi017.stdout:690 read 0x855b8bf thru 0x8569e03 (0xe545 bytes) 2024-09-18T05:13:59.333 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.346 INFO:teuthology.orchestra.run.smithi017.stdout:692 trunc from 0x9365836 to 0x35c84f6 2024-09-18T05:13:59.365 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.365 INFO:teuthology.orchestra.run.smithi017.stdout:694 write 0x33349e1 thru 0x3337c09 (0x3229 bytes) 2024-09-18T05:13:59.366 INFO:teuthology.orchestra.run.smithi017.stdout:695 read 0x205717a thru 0x205c9f3 (0x587a bytes) 2024-09-18T05:13:59.377 INFO:teuthology.orchestra.run.smithi017.stdout:696 write 0x46b16fa thru 0x46b40db (0x29e2 bytes) 2024-09-18T05:13:59.386 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:59.387+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:59.403 INFO:teuthology.orchestra.run.smithi017.stdout:698 writesame 0xb5f81fc thru 0xb5f9da4 data_size 0x1(0x1ba9 bytes) 2024-09-18T05:13:59.403 INFO:teuthology.orchestra.run.smithi017.stdout:699 read 0xffde5f thru 0x100439f (0x6541 bytes) 2024-09-18T05:13:59.403 INFO:teuthology.orchestra.run.smithi017.stdout:700 write 0x4eaccfc thru 0x4eb5c30 (0x8f35 bytes) 2024-09-18T05:13:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:701 read 0x70fa072 thru 0x71006c5 (0x6654 bytes) 2024-09-18T05:13:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:703 write 0x7511f10 thru 0x75170b8 (0x51a9 bytes) 2024-09-18T05:13:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:704 write 0x29bba82 thru 0x29c9078 (0xd5f7 bytes) 2024-09-18T05:13:59.416 INFO:teuthology.orchestra.run.smithi017.stdout:706 writesame 0x3e225ee thru 0x3e308d0 data_size 0x13(0xe2e3 bytes) 2024-09-18T05:13:59.421 INFO:teuthology.orchestra.run.smithi017.stdout:707 read 0x4acae7c thru 0x4ad97ad (0xe932 bytes) 2024-09-18T05:13:59.421 INFO:teuthology.orchestra.run.smithi017.stdout:708 punch from 0x3e8f66d to 0x3e9db5a, (0xe4ed bytes) 2024-09-18T05:13:59.421 INFO:teuthology.orchestra.run.smithi017.stdout:709 punch from 0x348947a to 0x349836f, (0xeef5 bytes) 2024-09-18T05:13:59.427 INFO:teuthology.orchestra.run.smithi017.stdout:710 trunc from 0xb5f9da5 to 0xe9883fc 2024-09-18T05:13:59.438 INFO:teuthology.orchestra.run.smithi017.stdout:711 writesame 0xa773e65 thru 0xa77c65b data_size 0x1(0x87f7 bytes) 2024-09-18T05:13:59.470 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:59.470 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:59.476 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:13:59.475+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:13:59.481 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.482 INFO:teuthology.orchestra.run.smithi017.stdout:713 read 0x8958fa6 thru 0x8961a6b (0x8ac6 bytes) 2024-09-18T05:13:59.483 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:13:59.499 INFO:teuthology.orchestra.run.smithi017.stdout:716 trunc from 0xe9883fc to 0x80fe098 2024-09-18T05:13:59.502 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T05:13:59.502 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:13:59.502 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-18T05:13:59.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T05:13:59.530 INFO:teuthology.orchestra.run.smithi017.stdout:717 trunc from 0x80fe098 to 0x3fda50e 2024-09-18T05:13:59.548 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.548 INFO:teuthology.orchestra.run.smithi017.stdout:720 punch from 0x34aff2 to 0x34b090, (0x9e bytes) 2024-09-18T05:13:59.557 INFO:teuthology.orchestra.run.smithi017.stdout:721 trunc from 0x3fda50e to 0x974243d 2024-09-18T05:13:59.565 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.565 INFO:teuthology.orchestra.run.smithi017.stdout:724 writesame 0x1d6227d thru 0x1d6d70e data_size 0x2(0xb492 bytes) 2024-09-18T05:13:59.577 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:13:59.570+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:13:59.594 INFO:teuthology.orchestra.run.smithi017.stdout:727 writesame 0xbd3be0c thru 0xbd49c87 data_size 0x3a(0xde7c bytes) 2024-09-18T05:13:59.594 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.594 INFO:teuthology.orchestra.run.smithi017.stdout:732 write 0x45acd98 thru 0x45b31dd (0x6446 bytes) 2024-09-18T05:13:59.595 INFO:teuthology.orchestra.run.smithi017.stdout:733 read 0x4d717a3 thru 0x4d71e2e (0x68c bytes) 2024-09-18T05:13:59.596 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.605 INFO:teuthology.orchestra.run.smithi017.stdout:735 writesame 0xceb4608 thru 0xceb9aec data_size 0x1(0x54e5 bytes) 2024-09-18T05:13:59.605 INFO:teuthology.orchestra.run.smithi017.stdout:736 writesame 0x9db6ad6 thru 0x9dbde4d data_size 0x14(0x7378 bytes) 2024-09-18T05:13:59.612 INFO:teuthology.orchestra.run.smithi017.stdout:737 trunc from 0xceb9aed to 0xba65b64 2024-09-18T05:13:59.627 INFO:teuthology.orchestra.run.smithi017.stdout:738 write 0x625f550 thru 0x62689ad (0x945e bytes) 2024-09-18T05:13:59.630 INFO:teuthology.orchestra.run.smithi017.stdout:739 writesame 0xb20a172 thru 0xb20fff5 data_size 0x4(0x5e84 bytes) 2024-09-18T05:13:59.640 INFO:teuthology.orchestra.run.smithi017.stdout:741 read 0x24538ab thru 0x245593e (0x2094 bytes) 2024-09-18T05:13:59.640 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.648 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:59.649 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:59.654 INFO:teuthology.orchestra.run.smithi017.stdout:743 write 0xe39c935 thru 0xe3a7ed0 (0xb59c bytes) 2024-09-18T05:13:59.657 INFO:teuthology.orchestra.run.smithi017.stdout:744 read 0x37b3965 thru 0x37b9918 (0x5fb4 bytes) 2024-09-18T05:13:59.658 INFO:teuthology.orchestra.run.smithi017.stdout:745 read 0x196b0e6 thru 0x196c4a7 (0x13c2 bytes) 2024-09-18T05:13:59.659 INFO:teuthology.orchestra.run.smithi017.stdout:746 trunc from 0xe3a7ed1 to 0xdfea4be 2024-09-18T05:13:59.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:13:59.669 INFO:teuthology.orchestra.run.smithi017.stdout:747 writesame 0x1f0d847 thru 0x1f161c1 data_size 0x1(0x897b bytes) 2024-09-18T05:13:59.678 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:13:59.670+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:13:59.693 INFO:teuthology.orchestra.run.smithi017.stdout:749 writesame 0x8f4a8ed thru 0x8f57c6d data_size 0x23(0xd381 bytes) 2024-09-18T05:13:59.694 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:13:59.694 INFO:teuthology.orchestra.run.smithi017.stdout:752 writesame 0x12a119c thru 0x12a7289 data_size 0x13(0x60ee bytes) 2024-09-18T05:13:59.697 INFO:teuthology.orchestra.run.smithi017.stdout:753 trunc from 0xdfea4be to 0xd7b7251 2024-09-18T05:13:59.710 INFO:teuthology.orchestra.run.smithi017.stdout:755 write 0xcaa7936 thru 0xcaacd9e (0x5469 bytes) 2024-09-18T05:13:59.713 INFO:teuthology.orchestra.run.smithi017.stdout:756 writesame 0x3222ebd thru 0x322c5f9 data_size 0x1(0x973d bytes) 2024-09-18T05:13:59.741 INFO:teuthology.orchestra.run.smithi017.stdout:758 read 0xb91e6af thru 0xb91f317 (0xc69 bytes) 2024-09-18T05:13:59.741 INFO:teuthology.orchestra.run.smithi017.stdout:759 read 0x290c4a6 thru 0x2919021 (0xcb7c bytes) 2024-09-18T05:13:59.741 INFO:teuthology.orchestra.run.smithi017.stdout:760 punch from 0xb779699 to 0xb780f79, (0x78e0 bytes) 2024-09-18T05:13:59.741 INFO:teuthology.orchestra.run.smithi017.stdout:761 read 0xc8e2480 thru 0xc8e728f (0x4e10 bytes) 2024-09-18T05:13:59.743 INFO:teuthology.orchestra.run.smithi017.stdout:762 trunc from 0xd7b7251 to 0xc9eb0cd 2024-09-18T05:13:59.755 INFO:teuthology.orchestra.run.smithi017.stdout:763 trunc from 0xc9eb0cd to 0xdd9e3f8 2024-09-18T05:13:59.763 INFO:teuthology.orchestra.run.smithi017.stdout:766 punch from 0x90f3e10 to 0x90fb8f0, (0x7ae0 bytes) 2024-09-18T05:13:59.763 INFO:teuthology.orchestra.run.smithi017.stdout:767 read 0xd7d39d3 thru 0xd7e30f8 (0xf726 bytes) 2024-09-18T05:13:59.770 INFO:teuthology.orchestra.run.smithi017.stdout:768 write 0xdeb9639 thru 0xdebe220 (0x4be8 bytes) 2024-09-18T05:13:59.775 INFO:teuthology.orchestra.run.smithi017.stdout:770 clone 5 order 21 su 32768 sc 2 2024-09-18T05:13:59.778 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:13:59.779+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:13:59.784 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:13:59.785 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:13:59.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:13:59.838 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "04ac0d2c-34bd-46ad-a307-a4eb23236eb4", 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-18T05:13:15.193498+0000", 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-18T05:13:57.974275+0000", 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-18T05:13:26.810974+0000", 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-18T05:13:18.221936+0000", 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5801984, 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "noscrub", 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-18T05:13:59.839 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2024-09-18T05:13:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:28.629114+0000", 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:13:59.841 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:13:59.842 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "17", 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-18T05:13:59.843 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:13:59.844 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:13:59.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-18T05:13:59.847 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:34.103981+0000", 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:13:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-18T05:13:59.849 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-18T05:13:59.849 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-18T05:13:59.849 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-18T05:13:59.849 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-18T05:13:59.849 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:13:59.849 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:13:59.849 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:13:59.849 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "21", 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 3, 2024-09-18T05:13:59.850 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 21, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:13:59.851 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:13:59.852 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2024-09-18T05:13:59.853 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:44.114945+0000", 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:13:59.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-18T05:13:59.855 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.856 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "31", 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 7, 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 31, 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:13:59.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:13:59.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:13:59.859 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:13:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:13:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:13:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2024-09-18T05:13:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2024-09-18T05:13:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-18T05:13:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2024-09-18T05:13:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2024-09-18T05:13:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "a2a580f7-2bbc-46c3-b6b5-5a9e93539d27", 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:13:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:13:59.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.863 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-18T05:13:59.863 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:13:59.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.864 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.865 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1558450642", 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1558450642", 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1558450642", 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1558450642", 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:13:59.867 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "260da429-e6eb-446b-95a0-dcf4581bb584", 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:13:59.868 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3444575073", 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3444575073", 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3444575073", 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3444575073", 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "0cf5d53a-552d-4775-8437-86af3465b1bc", 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 18, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:13:59.874 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-18T05:13:59.875 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-18T05:13:59.876 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/467806624", 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/467806624", 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/467806624", 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/467806624", 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "73bc18b6-4972-4164-a294-b6372bcf9f9d", 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:13:59.880 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.884 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/3763834627", 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/3763834627", 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/3763834627", 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/3763834627", 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "536c8ef2-eca6-44b4-a70c-06f191eb5ff1", 2024-09-18T05:13:59.885 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6800", 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6802", 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6804", 2024-09-18T05:13:59.888 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:13:59.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.888 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6806", 2024-09-18T05:13:59.888 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:13:59.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.888 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.889 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:13:59.889 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6815", 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6819", 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6809", 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6812", 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6802/1703780253", 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6806/1703780253", 2024-09-18T05:13:59.891 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6819/1703780253", 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6812/1703780253", 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "4341bba4-2913-4352-89d4-36fa18ee39cb", 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:13:59.892 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6808", 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.894 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6811", 2024-09-18T05:13:59.894 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:13:59.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.894 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.894 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:13:59.894 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6813", 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6816", 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.896 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:13:59.896 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.896 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6822", 2024-09-18T05:13:59.896 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:13:59.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6823", 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6817", 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6820", 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6811/3348904742", 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6816/3348904742", 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6823/3348904742", 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6820/3348904742", 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.899 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:13:59.899 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "e47d4aad-9c4b-43a9-9b32-2db463ec2a20", 2024-09-18T05:13:59.899 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:13:59.899 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:13:59.899 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:13:59.899 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6801", 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:13:59.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6803", 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6805", 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:13:59.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6807", 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6818", 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:13:59.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6821", 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.904 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6810", 2024-09-18T05:13:59.904 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:13:59.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.904 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6814", 2024-09-18T05:13:59.904 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6803/74856761", 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6807/74856761", 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6821/74856761", 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6814/74856761", 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:13:59.905 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:13:59.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.906 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:13:59.906 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "686d275c-e592-44c1-87f9-ac9718f3a112", 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:13:59.907 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6824", 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6825", 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:13:59.908 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6826", 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6827", 2024-09-18T05:13:59.909 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6830", 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6831", 2024-09-18T05:13:59.910 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6828", 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6829", 2024-09-18T05:13:59.911 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6825/1345159853", 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6827/1345159853", 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6831/1345159853", 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6829/1345159853", 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:13:59.912 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.758535+0000", 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:13:59.913 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.800715+0000", 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:13:59.914 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.783374+0000", 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.779519+0000", 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.915 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.893837+0000", 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:13:59.916 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.776852+0000", 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.919808+0000", 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:13:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.883599+0000", 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2024-09-18T05:13:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:13:59.919 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [ 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: "snaps": [ 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: "begin": 2, 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: "length": 1 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2024-09-18T05:13:59.920 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-18T05:13:59.921 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-18T05:13:59.921 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-18T05:13:59.921 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-18T05:13:59.921 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-18T05:13:59.921 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-18T05:13:59.921 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-18T05:13:59.921 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-18T05:13:59.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:13:59.921 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:13:59.923 INFO:tasks.thrashosds.thrasher:j is {'epoch': 31, 'fsid': '04ac0d2c-34bd-46ad-a307-a4eb23236eb4', 'created': '2024-09-18T05:13:15.193498+0000', 'modified': '2024-09-18T05:13:57.974275+0000', 'last_up_change': '2024-09-18T05:13:26.810974+0000', 'last_in_change': '2024-09-18T05:13:18.221936+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T05:13:28.629114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T05:13:34.103981+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T05:13:44.114945+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 31, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'a2a580f7-2bbc-46c3-b6b5-5a9e93539d27', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1558450642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1558450642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1558450642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1558450642}]}, 'public_addr': '172.21.15.17:6801/1558450642', 'cluster_addr': '172.21.15.17:6803/1558450642', 'heartbeat_back_addr': '172.21.15.17:6807/1558450642', 'heartbeat_front_addr': '172.21.15.17:6805/1558450642', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '260da429-e6eb-446b-95a0-dcf4581bb584', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3444575073}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3444575073}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3444575073}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3444575073}]}, 'public_addr': '172.21.15.17:6809/3444575073', 'cluster_addr': '172.21.15.17:6811/3444575073', 'heartbeat_back_addr': '172.21.15.17:6815/3444575073', 'heartbeat_front_addr': '172.21.15.17:6813/3444575073', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0cf5d53a-552d-4775-8437-86af3465b1bc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 467806624}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 467806624}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 467806624}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 467806624}]}, 'public_addr': '172.21.15.17:6817/467806624', 'cluster_addr': '172.21.15.17:6819/467806624', 'heartbeat_back_addr': '172.21.15.17:6823/467806624', 'heartbeat_front_addr': '172.21.15.17:6821/467806624', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '73bc18b6-4972-4164-a294-b6372bcf9f9d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6824', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6825', 'nonce': 3763834627}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6826', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6827', 'nonce': 3763834627}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6830', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6831', 'nonce': 3763834627}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6828', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6829', 'nonce': 3763834627}]}, 'public_addr': '172.21.15.17:6825/3763834627', 'cluster_addr': '172.21.15.17:6827/3763834627', 'heartbeat_back_addr': '172.21.15.17:6831/3763834627', 'heartbeat_front_addr': '172.21.15.17:6829/3763834627', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '536c8ef2-eca6-44b4-a70c-06f191eb5ff1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6802', 'nonce': 1703780253}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6806', 'nonce': 1703780253}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6815', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 1703780253}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6809', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6812', 'nonce': 1703780253}]}, 'public_addr': '172.21.15.86:6802/1703780253', 'cluster_addr': '172.21.15.86:6806/1703780253', 'heartbeat_back_addr': '172.21.15.86:6819/1703780253', 'heartbeat_front_addr': '172.21.15.86:6812/1703780253', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4341bba4-2913-4352-89d4-36fa18ee39cb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 3348904742}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6813', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6816', 'nonce': 3348904742}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6823', 'nonce': 3348904742}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6817', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6820', 'nonce': 3348904742}]}, 'public_addr': '172.21.15.86:6811/3348904742', 'cluster_addr': '172.21.15.86:6816/3348904742', 'heartbeat_back_addr': '172.21.15.86:6823/3348904742', 'heartbeat_front_addr': '172.21.15.86:6820/3348904742', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e47d4aad-9c4b-43a9-9b32-2db463ec2a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6801', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 74856761}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6805', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 74856761}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 74856761}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6814', 'nonce': 74856761}]}, 'public_addr': '172.21.15.86:6803/74856761', 'cluster_addr': '172.21.15.86:6807/74856761', 'heartbeat_back_addr': '172.21.15.86:6821/74856761', 'heartbeat_front_addr': '172.21.15.86:6814/74856761', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '686d275c-e592-44c1-87f9-ac9718f3a112', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 1345159853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6826', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 1345159853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6830', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 1345159853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6829', 'nonce': 1345159853}]}, 'public_addr': '172.21.15.86:6825/1345159853', 'cluster_addr': '172.21.15.86:6827/1345159853', 'heartbeat_back_addr': '172.21.15.86:6831/1345159853', 'heartbeat_front_addr': '172.21.15.86:6829/1345159853', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.758535+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.800715+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.783374+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.779519+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.893837+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.776852+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.919808+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.883599+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T05:13:59.923 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-18T05:13:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:13:59.924 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:13:59.923+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:13:59.993 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone4 from 0xdebe221 (overlap 0x1195935) to 0xe1142a 2024-09-18T05:14:00.023 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:00.023+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:00.049 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:00.049 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:00.064 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:00.151 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:00.151+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:00.197 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-18T05:14:00.226 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:00.223+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:00.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:00.233 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:00.233 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:00.247 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:00.251 INFO:teuthology.orchestra.run.smithi017.stdout:772 read 0x5b972fd thru 0x5ba5497 (0xe19b bytes) 2024-09-18T05:14:00.252 INFO:teuthology.orchestra.run.smithi017.stdout:773 write 0x45694aa thru 0x4572306 (0x8e5d bytes) 2024-09-18T05:14:00.273 INFO:teuthology.orchestra.run.smithi017.stdout:774 read 0x511c42 thru 0x51ca51 (0xae10 bytes) 2024-09-18T05:14:00.273 INFO:teuthology.orchestra.run.smithi017.stdout:775 write 0xeab871 thru 0xeb8b46 (0xd2d6 bytes) 2024-09-18T05:14:00.288 INFO:teuthology.orchestra.run.smithi017.stdout:777 writesame 0xdcd5cf6 thru 0xdcd6ad7 data_size 0x1(0xde2 bytes) 2024-09-18T05:14:00.296 INFO:teuthology.orchestra.run.smithi017.stdout:779 read 0x7f5b765 thru 0x7f5f732 (0x3fce bytes) 2024-09-18T05:14:00.296 INFO:teuthology.orchestra.run.smithi017.stdout:780 write 0x2845a95 thru 0x284acba (0x5226 bytes) 2024-09-18T05:14:00.315 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:00.316 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:00.324 INFO:teuthology.orchestra.run.smithi017.stdout:783 writesame 0xe2b1f2d thru 0xe2c0026 data_size 0x57(0xe0fa bytes) 2024-09-18T05:14:00.324 INFO:teuthology.orchestra.run.smithi017.stdout:784 punch from 0x2046f01 to 0x204cc4e, (0x5d4d bytes) 2024-09-18T05:14:00.324 INFO:teuthology.orchestra.run.smithi017.stdout:785 punch from 0xc05712f to 0xc06340a, (0xc2db bytes) 2024-09-18T05:14:00.331 INFO:teuthology.orchestra.run.smithi017.stdout:786 write 0xe7beea7 thru 0xe7c8593 (0x96ed bytes) 2024-09-18T05:14:00.338 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:00.339+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:00.339 INFO:teuthology.orchestra.run.smithi017.stdout:787 punch from 0xb7f5cb8 to 0xb7fa063, (0x43ab bytes) 2024-09-18T05:14:00.339 INFO:teuthology.orchestra.run.smithi017.stdout:789 writesame 0x909aa14 thru 0x90a2b90 data_size 0x1(0x817d bytes) 2024-09-18T05:14:00.363 INFO:teuthology.orchestra.run.smithi017.stdout:790 read 0x784a302 thru 0x784db6d (0x386c bytes) 2024-09-18T05:14:00.363 INFO:teuthology.orchestra.run.smithi017.stdout:792 writesame 0xa7d9ff6 thru 0xa7dc1bd data_size 0x4(0x21c8 bytes) 2024-09-18T05:14:00.370 INFO:teuthology.orchestra.run.smithi017.stdout:794 read 0x60ce55a thru 0x60d43b3 (0x5e5a bytes) 2024-09-18T05:14:00.371 INFO:teuthology.orchestra.run.smithi017.stdout:795 writesame 0x257f6c4 thru 0x258e03d data_size 0x56(0xe97a bytes) 2024-09-18T05:14:00.388 INFO:teuthology.orchestra.run.smithi017.stdout:796 read 0xc876948 thru 0xc87da46 (0x70ff bytes) 2024-09-18T05:14:00.388 INFO:teuthology.orchestra.run.smithi017.stdout:798 writesame 0x9ed4a71 thru 0x9ed7328 data_size 0x4(0x28b8 bytes) 2024-09-18T05:14:00.397 INFO:teuthology.orchestra.run.smithi017.stdout:799 write 0x3de7e9f thru 0x3de9242 (0x13a4 bytes) 2024-09-18T05:14:00.403 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:00.417 INFO:teuthology.orchestra.run.smithi017.stdout:800 read 0x58ddf1a thru 0x58ec0c4 (0xe1ab bytes) 2024-09-18T05:14:00.417 INFO:teuthology.orchestra.run.smithi017.stdout:803 punch from 0x8e90cf7 to 0x8e92eee, (0x21f7 bytes) 2024-09-18T05:14:00.417 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:00.417 INFO:teuthology.orchestra.run.smithi017.stdout:806 punch from 0x3b9a1e3 to 0x3ba550c, (0xb329 bytes) 2024-09-18T05:14:00.417 INFO:teuthology.orchestra.run.smithi017.stdout:807 write 0x503283b thru 0x5036cd1 (0x4497 bytes) 2024-09-18T05:14:00.422 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:00.424 INFO:teuthology.orchestra.run.smithi017.stdout:808 writesame 0x63d08cd thru 0x63d46bb data_size 0x23(0x3def bytes) 2024-09-18T05:14:00.427 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:00.422+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:00.428 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:00.428 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:00.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:14:00.443 INFO:teuthology.orchestra.run.smithi017.stdout:809 trunc from 0xe7c8594 to 0x703a004 2024-09-18T05:14:00.446 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:00.446 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:00.463 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:00.463 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:00.466 INFO:teuthology.orchestra.run.smithi017.stdout:811 read 0x4fad87d thru 0x4fbbc71 (0xe3f5 bytes) 2024-09-18T05:14:00.466 INFO:teuthology.orchestra.run.smithi017.stdout:814 punch from 0x39ea85c to 0x39f9405, (0xeba9 bytes) 2024-09-18T05:14:00.466 INFO:teuthology.orchestra.run.smithi017.stdout:815 writesame 0x558d866 thru 0x559d0b2 data_size 0x1(0xf84d bytes) 2024-09-18T05:14:00.481 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:00.481 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:00.500 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:00.500 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:00.502 INFO:teuthology.orchestra.run.smithi017.stdout:818 write 0x7405c24 thru 0x740f2ee (0x96cb bytes) 2024-09-18T05:14:00.510 INFO:teuthology.orchestra.run.smithi017.stdout:819 write 0xf51c8a thru 0xf5ef12 (0xd289 bytes) 2024-09-18T05:14:00.512 INFO:teuthology.orchestra.run.smithi017.stdout:820 write 0x1f89816 thru 0x1f8ea97 (0x5282 bytes) 2024-09-18T05:14:00.522 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:00.522 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:00.526 INFO:teuthology.orchestra.run.smithi017.stdout:821 read 0xc4cc08 thru 0xc5a234 (0xd62d bytes) 2024-09-18T05:14:00.526 INFO:teuthology.orchestra.run.smithi017.stdout:822 read 0x5087640 thru 0x50957f8 (0xe1b9 bytes) 2024-09-18T05:14:00.527 INFO:teuthology.orchestra.run.smithi017.stdout:823 writesame 0x12288d4 thru 0x1231ede data_size 0x1(0x960b bytes) 2024-09-18T05:14:00.535 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:00.535+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:00.546 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:00.546 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:00.573 INFO:teuthology.orchestra.run.smithi017.stdout:824 write 0x4c3eae9 thru 0x4c496a6 (0xabbe bytes) 2024-09-18T05:14:00.587 INFO:teuthology.orchestra.run.smithi017.stdout:825 write 0x902e79f thru 0x9033d60 (0x55c2 bytes) 2024-09-18T05:14:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:827 write 0xa146d62 thru 0xa154fd9 (0xe278 bytes) 2024-09-18T05:14:00.618 INFO:teuthology.orchestra.run.smithi017.stdout:828 write 0xbce254f thru 0xbcec2fd (0x9daf bytes) 2024-09-18T05:14:00.621 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:00.621 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:00.621 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:00.621 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:00.621 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:00.622 INFO:teuthology.orchestra.run.smithi017.stdout:829 read 0x44d4d6f thru 0x44dbeef (0x7181 bytes) 2024-09-18T05:14:00.623 INFO:teuthology.orchestra.run.smithi017.stdout:830 read 0x8fb68b9 thru 0x8fc3dea (0xd532 bytes) 2024-09-18T05:14:00.623 INFO:teuthology.orchestra.run.smithi017.stdout:833 punch from 0x3a21980 to 0x3a285ad, (0x6c2d bytes) 2024-09-18T05:14:00.628 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:00.622+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:00.634 INFO:teuthology.orchestra.run.smithi017.stdout:834 write 0xd5c0844 thru 0xd5cb806 (0xafc3 bytes) 2024-09-18T05:14:00.636 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:14:00.639 INFO:teuthology.orchestra.run.smithi017.stdout:835 write 0x47fc9a9 thru 0x47fe447 (0x1a9f bytes) 2024-09-18T05:14:00.642 INFO:teuthology.orchestra.run.smithi017.stdout:836 read 0xc0f2881 thru 0xc0f6793 (0x3f13 bytes) 2024-09-18T05:14:00.652 INFO:teuthology.orchestra.run.smithi017.stdout:837 trunc from 0xd5cb807 to 0x89c2fde 2024-09-18T05:14:00.669 INFO:teuthology.orchestra.run.smithi017.stdout:838 trunc from 0x89c2fde to 0xa075e76 2024-09-18T05:14:00.688 INFO:teuthology.orchestra.run.smithi017.stdout:839 writesame 0xa28d20f thru 0xa29c847 data_size 0x1(0xf639 bytes) 2024-09-18T05:14:00.688 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:00.688 INFO:teuthology.orchestra.run.smithi017.stdout:843 read 0x8e20367 thru 0x8e28461 (0x80fb bytes) 2024-09-18T05:14:00.688 INFO:teuthology.orchestra.run.smithi017.stdout:844 write 0x406b1aa thru 0x407661a (0xb471 bytes) 2024-09-18T05:14:00.729 INFO:teuthology.orchestra.run.smithi017.stdout:845 trunc from 0xa29c848 to 0xb5c3bb1 2024-09-18T05:14:00.729 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:00.722+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:00.739 INFO:teuthology.orchestra.run.smithi017.stdout:847 read 0x3e9fda9 thru 0x3eac014 (0xc26c bytes) 2024-09-18T05:14:00.740 INFO:teuthology.orchestra.run.smithi017.stdout:848 read 0x6034395 thru 0x6042b04 (0xe770 bytes) 2024-09-18T05:14:00.741 INFO:teuthology.orchestra.run.smithi017.stdout:849 write 0x2f80886 thru 0x2f8c876 (0xbff1 bytes) 2024-09-18T05:14:00.763 INFO:teuthology.orchestra.run.smithi017.stdout:850 read 0x980efbc thru 0x981cb1b (0xdb60 bytes) 2024-09-18T05:14:00.763 INFO:teuthology.orchestra.run.smithi017.stdout:851 write 0x517e913 thru 0x518df7a (0xf668 bytes) 2024-09-18T05:14:00.773 INFO:teuthology.orchestra.run.smithi017.stdout:853 write 0x71d6b4c thru 0x71e581b (0xecd0 bytes) 2024-09-18T05:14:00.782 INFO:teuthology.orchestra.run.smithi017.stdout:854 trunc from 0xb5c3bb1 to 0x926b400 2024-09-18T05:14:00.795 INFO:teuthology.orchestra.run.smithi017.stdout:855 read 0x2165479 thru 0x21654c5 (0x4d bytes) 2024-09-18T05:14:00.807 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:00.807 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:00.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:486 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'29, mlcod=26'23)", 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.235361+0000", 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.5708347170000003, 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060318580000000002, 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235361+0000", 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235361+0000", 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235360+0000", 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:00.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235383+0000", 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3467000000000001e-05 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235414+0000", 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0722000000000002e-05 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235426+0000", 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2094e-05 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236284+0000", 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00085829199999999997 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236299+0000", 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4651000000000001e-05 2024-09-18T05:14:00.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241342+0000", 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050436509999999997 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241392+0000", 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9963000000000003e-05 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:487 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'30, mlcod=26'23)", 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.5703288789999998, 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055603570000000001, 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235866+0000", 2024-09-18T05:14:00.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235880+0000", 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4309e-05 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235892+0000", 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1744e-05 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.235899+0000", 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9870000000000002e-06 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236614+0000", 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00071501599999999996 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.236642+0000", 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8013000000000001e-05 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241396+0000", 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047546710000000002 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.241427+0000", 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0460999999999999e-05 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:931 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'59, mlcod=26'55)", 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.397706+0000", 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4084896049999998, 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054888080000000004, 2024-09-18T05:14:00.818 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397706+0000", 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397706+0000", 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397705+0000", 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397711+0000", 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.998e-06 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397722+0000", 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1085e-05 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397728+0000", 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9669999999999998e-06 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397773+0000", 2024-09-18T05:14:00.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5355999999999997e-05 2024-09-18T05:14:00.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.397792+0000", 2024-09-18T05:14:00.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8343999999999999e-05 2024-09-18T05:14:00.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.403085+0000", 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052930920000000001 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.403195+0000", 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000109696 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:1054 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'75, mlcod=26'71)", 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.3172050689999999, 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061130209999999997, 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488989+0000", 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:00.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488997+0000", 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2089999999999999e-06 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489010+0000", 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3845e-05 2024-09-18T05:14:00.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489018+0000", 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2470000000000002e-06 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489045+0000", 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6846e-05 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489064+0000", 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9134e-05 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495073+0000", 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060090760000000003 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495103+0000", 2024-09-18T05:14:00.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0502e-05 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:1474 3.a 3:5343cb89:::rbd_data.118b4598dbfb.0000000000000056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.834668+0000", 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.971527107, 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073003749999999996, 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1474 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834668+0000", 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834668+0000", 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834667+0000", 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834679+0000", 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2397e-05 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834708+0000", 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9339000000000001e-05 2024-09-18T05:14:00.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834729+0000", 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0832999999999999e-05 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834852+0000", 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122939 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834992+0000", 2024-09-18T05:14:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013991900000000001 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.835234+0000", 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024224199999999999 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.837039+0000", 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001804167 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.841864+0000", 2024-09-18T05:14:00.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048259790000000002 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.841925+0000", 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0585999999999999e-05 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.841969+0000", 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3510999999999997e-05 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2316 3.a 3:56bb9c78:::rbd_data.118b4598dbfb.0000000000000055:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.473356+0000", 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.3328394929999998, 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.017501419000000001, 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2316 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.835 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473356+0000", 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473356+0000", 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473355+0000", 2024-09-18T05:14:00.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473361+0000", 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6270000000000002e-06 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473375+0000", 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3378e-05 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473381+0000", 2024-09-18T05:14:00.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6669999999999999e-06 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473429+0000", 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7839000000000001e-05 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473488+0000", 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8817999999999998e-05 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.474466+0000", 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00097748400000000004 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490699+0000", 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016233195999999998 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490722+0000", 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3387000000000002e-05 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490800+0000", 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8279e-05 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490857+0000", 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6807e-05 2024-09-18T05:14:00.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2317 3.a 3:5343cb89:::rbd_data.118b4598dbfb.0000000000000056:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.478386+0000", 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.3278097720000002, 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012680342000000001, 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2317 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478386+0000", 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478386+0000", 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478383+0000", 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478398+0000", 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.454e-05 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478429+0000", 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0895999999999997e-05 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478443+0000", 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4097000000000001e-05 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.480367+0000", 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001923775 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.480496+0000", 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012927199999999999 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.481973+0000", 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001477426 2024-09-18T05:14:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490876+0000", 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0089027010000000007 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490939+0000", 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2440000000000005e-05 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.491013+0000", 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4219000000000002e-05 2024-09-18T05:14:00.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.491066+0000", 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3155999999999997e-05 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4491.0:2316 3.a e26/22 ondisk, result = 0)", 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.479730+0000", 2024-09-18T05:14:00.847 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.3264655489999999, 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010977288999999999, 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479730+0000", 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479730+0000", 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479728+0000", 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479737+0000", 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7629999999999995e-06 2024-09-18T05:14:00.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479762+0000", 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4544000000000001e-05 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479784+0000", 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2180000000000001e-05 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490674+0000", 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010889981999999999 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490687+0000", 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2717e-05 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490707+0000", 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2501 3.a 3:5343cb89:::rbd_data.118b4598dbfb.0000000000000056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.746170+0000", 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.0600248689999994, 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058028919999999996, 2024-09-18T05:14:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2501 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746170+0000", 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746170+0000", 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746169+0000", 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:00.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746178+0000", 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8959999999999992e-06 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746201+0000", 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2915999999999999e-05 2024-09-18T05:14:00.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.746216+0000", 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5136999999999999e-05 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.747427+0000", 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001211071 2024-09-18T05:14:00.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.747645+0000", 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217658 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.747945+0000", 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030051399999999999 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.751177+0000", 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032322760000000001 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.751742+0000", 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056475899999999996 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.751866+0000", 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000123745 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.751973+0000", 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010735599999999999 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2543 3.a 3:565046da:::rbd_data.118b4598dbfb.000000000000018a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.767238+0000", 2024-09-18T05:14:00.859 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.0389575939999993, 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061646319999999998, 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2543 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767238+0000", 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767238+0000", 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767235+0000", 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767248+0000", 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3312999999999999e-05 2024-09-18T05:14:00.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767301+0000", 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2580000000000001e-05 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767321+0000", 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9910000000000001e-05 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767419+0000", 2024-09-18T05:14:00.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8228999999999998e-05 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767647+0000", 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000227405 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767880+0000", 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023299200000000001 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.772085+0000", 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042059039999999999 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.773145+0000", 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001059618 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.773290+0000", 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014529500000000001 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.773402+0000", 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011202 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2611 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'314, mlcod=26'310)", 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.856021+0000", 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.9501743669999998, 2024-09-18T05:14:00.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081837939999999994, 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856021+0000", 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856021+0000", 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856019+0000", 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856034+0000", 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5150000000000001e-05 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856063+0000", 2024-09-18T05:14:00.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9346999999999999e-05 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856082+0000", 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8845999999999999e-05 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856316+0000", 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000234069 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856358+0000", 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1523000000000002e-05 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.864108+0000", 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077500670000000002 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.864205+0000", 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6892000000000007e-05 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2711 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'340, mlcod=26'337)", 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.039084+0000", 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.7671112820000001, 2024-09-18T05:14:00.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068687360000000003, 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039084+0000", 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039084+0000", 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039083+0000", 2024-09-18T05:14:00.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:00.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039092+0000", 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7630000000000006e-06 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039105+0000", 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2999e-05 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039112+0000", 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5800000000000003e-06 2024-09-18T05:14:00.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039625+0000", 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051310600000000004 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039661+0000", 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5633000000000003e-05 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045892+0000", 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0062304889999999996 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045953+0000", 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1218999999999998e-05 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2712 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'341, mlcod=26'337)", 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.039870+0000", 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.7663251349999998, 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061192420000000004, 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039870+0000", 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039870+0000", 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039868+0000", 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:00.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039884+0000", 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6039999999999999e-05 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039919+0000", 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4876000000000003e-05 2024-09-18T05:14:00.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039961+0000", 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2277000000000002e-05 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040662+0000", 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070039799999999997 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040714+0000", 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2062999999999999e-05 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045958+0000", 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052443619999999998 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045989+0000", 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1112999999999998e-05 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2731 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'352, mlcod=26'347)", 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.063327+0000", 2024-09-18T05:14:00.881 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.7428687400000005, 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058073659999999996, 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063327+0000", 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063327+0000", 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063325+0000", 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063338+0000", 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2836999999999999e-05 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063365+0000", 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6783000000000001e-05 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063383+0000", 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8813000000000001e-05 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063490+0000", 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010637 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.063547+0000", 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7618999999999998e-05 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.069043+0000", 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054954009999999996 2024-09-18T05:14:00.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.069134+0000", 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1089999999999997e-05 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2807 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'377, mlcod=26'371)", 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.158054+0000", 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.6481413979999999, 2024-09-18T05:14:00.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006727055, 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158054+0000", 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158054+0000", 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158052+0000", 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158067+0000", 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5073e-05 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158111+0000", 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3463e-05 2024-09-18T05:14:00.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158130+0000", 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9259999999999999e-05 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.159247+0000", 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011168020000000001 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.159316+0000", 2024-09-18T05:14:00.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8821999999999999e-05 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.164692+0000", 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053760459999999998 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.164781+0000", 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9232000000000002e-05 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2868 3.a 3:5376ad2d:::rbd_data.118b4598dbfb.0000000000000094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.235008+0000", 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.5711874249999997, 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064425769999999997, 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2868 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235008+0000", 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235008+0000", 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235004+0000", 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-18T05:14:00.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235043+0000", 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8617e-05 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235091+0000", 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7642999999999998e-05 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235112+0000", 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1290000000000001e-05 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235288+0000", 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176181 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235510+0000", 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221492 2024-09-18T05:14:00.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235714+0000", 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020429199999999999 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.237797+0000", 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020828209999999999 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.241245+0000", 2024-09-18T05:14:00.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034486529999999999 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.241380+0000", 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000134645 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.241450+0000", 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0423e-05 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.896 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:4899 3.10 3:08ede3af:::rbd_data.118b29ff732c.0000000000000113:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:55.891790+0000", 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.9144055760000001, 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091234950000000006, 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 4899 2024-09-18T05:14:00.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.898 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891790+0000", 2024-09-18T05:14:00.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891790+0000", 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891787+0000", 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891802+0000", 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5276000000000001e-05 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891834+0000", 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1575999999999997e-05 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891849+0000", 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5469e-05 2024-09-18T05:14:00.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891913+0000", 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3910000000000003e-05 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.892088+0000", 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017490299999999999 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.893545+0000", 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014572739999999999 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.900849+0000", 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073033539999999997 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.900858+0000", 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9549999999999998e-06 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.900889+0000", 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0877999999999998e-05 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.900913+0000", 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4674000000000001e-05 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:9125 3.a 3:56aee181:::rbd_data.118beb25b049.000000000000002b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:57.061952+0000", 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7442430939999998, 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077378330000000004, 2024-09-18T05:14:00.904 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9125 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.061952+0000", 2024-09-18T05:14:00.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.061952+0000", 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.061949+0000", 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.061965+0000", 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.647e-05 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.062003+0000", 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8206e-05 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.062020+0000", 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7087000000000001e-05 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.062158+0000", 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013803200000000001 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.062170+0000", 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1579999999999999e-05 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.066944+0000", 2024-09-18T05:14:00.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047738609999999999 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.067147+0000", 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020342400000000001 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.067447+0000", 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029934200000000002 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.068903+0000", 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014568420000000001 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.069553+0000", 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00064944099999999995 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.069635+0000", 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2056000000000002e-05 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.069690+0000", 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5056000000000003e-05 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:9569 3.a 3:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:58.093990+0000", 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.7122050230000001, 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059823640000000004, 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9569 2024-09-18T05:14:00.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.093990+0000", 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.093990+0000", 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.093987+0000", 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.094004+0000", 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7646e-05 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.094039+0000", 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4350000000000001e-05 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.094055+0000", 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6552999999999999e-05 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.094154+0000", 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9133000000000001e-05 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.094165+0000", 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0326000000000001e-05 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.097399+0000", 2024-09-18T05:14:00.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003234055 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.097529+0000", 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012980500000000001 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.097841+0000", 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031199199999999998 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.098965+0000", 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011242509999999999 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.099836+0000", 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087163599999999996 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.099917+0000", 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0706999999999998e-05 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.099973+0000", 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5466000000000001e-05 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:9592 3.a 3:55702653:::rbd_data.118beb25b049.0000000000000010:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:58.120855+0000", 2024-09-18T05:14:00.919 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.6853406829999997, 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012271321999999999, 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9592 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120855+0000", 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120855+0000", 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120853+0000", 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120870+0000", 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7125999999999998e-05 2024-09-18T05:14:00.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120911+0000", 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1106000000000003e-05 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120934+0000", 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3377e-05 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.121067+0000", 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013296599999999999 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.121262+0000", 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019531400000000001 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.121740+0000", 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000477407 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.124314+0000", 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025740300000000002 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.132872+0000", 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085581979999999995 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:00.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.133029+0000", 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015696199999999999 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.133126+0000", 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6955999999999998e-05 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:00.925 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:00.927 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:00.928 INFO:teuthology.orchestra.run.smithi017.stdout:856 trunc from 0x926b400 to 0x27ab4b6 2024-09-18T05:14:00.928 INFO:teuthology.orchestra.run.smithi017.stdout:857 punch from 0x20861bd to 0x20879ab, (0x17ee bytes) 2024-09-18T05:14:00.928 INFO:teuthology.orchestra.run.smithi017.stdout:858 punch from 0x146d167 to 0x1477954, (0xa7ed bytes) 2024-09-18T05:14:00.928 INFO:teuthology.orchestra.run.smithi017.stdout:859 trunc from 0x27ab4b6 to 0x50b651a 2024-09-18T05:14:00.928 INFO:teuthology.orchestra.run.smithi017.stdout:860 write 0x87fcff1 thru 0x8804948 (0x7958 bytes) 2024-09-18T05:14:00.928 INFO:teuthology.orchestra.run.smithi017.stdout:861 read 0x1b399d4 thru 0x1b3b5a8 (0x1bd5 bytes) 2024-09-18T05:14:00.929 INFO:teuthology.orchestra.run.smithi017.stdout:862 write 0x33565a4 thru 0x335e0a4 (0x7b01 bytes) 2024-09-18T05:14:00.929 INFO:teuthology.orchestra.run.smithi017.stdout:863 clone 6 order 24 su 262144 sc 9 2024-09-18T05:14:00.929 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:00.922+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:01.027 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:01.027+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:01.063 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:01.064 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:01.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:01.167 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:01.167+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:01.211 INFO:teuthology.orchestra.run.smithi017.stdout:flattening image image_client.0-clone5 2024-09-18T05:14:01.230 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:01.227+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:01.262 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:01.262 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:01.262 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:01.283 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:01.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:01.322+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:01.431 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:01.426+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17095 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247012+0000", 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19801179799999999, 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026804163999999998, 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.448 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17095 2024-09-18T05:14:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247012+0000", 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247012+0000", 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247011+0000", 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247016+0000", 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9860000000000002e-06 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247039+0000", 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2484999999999999e-05 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247065+0000", 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6074000000000001e-05 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273624+0000", 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026558509000000001 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273713+0000", 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9207000000000002e-05 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273817+0000", 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010378300000000001 2024-09-18T05:14:01.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17096 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247077+0000", 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19794732400000001, 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026966496999999999, 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.453 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17096 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247077+0000", 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247077+0000", 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247076+0000", 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247084+0000", 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9859999999999994e-06 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247100+0000", 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5917e-05 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247115+0000", 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5480000000000001e-05 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273848+0000", 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026732318000000001 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273938+0000", 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0600999999999995e-05 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274043+0000", 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010507 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17097 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247126+0000", 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.197897662, 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027162054000000001, 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17097 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.458 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247126+0000", 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247126+0000", 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247125+0000", 2024-09-18T05:14:01.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247131+0000", 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3920000000000002e-06 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247161+0000", 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0508e-05 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247174+0000", 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2734e-05 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274093+0000", 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026919307 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274185+0000", 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1525000000000002e-05 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274289+0000", 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010368499999999999 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17098 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247185+0000", 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.197838982, 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027333804999999999, 2024-09-18T05:14:01.462 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17098 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247185+0000", 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247185+0000", 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247184+0000", 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247190+0000", 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5570000000000003e-06 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247206+0000", 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.632e-05 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247218+0000", 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1848000000000001e-05 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274339+0000", 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027121301 2024-09-18T05:14:01.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274425+0000", 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5570999999999998e-05 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274519+0000", 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4245000000000003e-05 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17139 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19745565700000001, 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027184, 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17139 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247571+0000", 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1200000000000002e-06 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247580+0000", 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7190000000000007e-06 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247586+0000", 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1689999999999997e-06 2024-09-18T05:14:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274556+0000", 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026969961000000001 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274654+0000", 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8418999999999994e-05 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274752+0000", 2024-09-18T05:14:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8173999999999999e-05 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17140 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247592+0000", 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19743255100000001, 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027313189000000002, 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17140 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247592+0000", 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247592+0000", 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247591+0000", 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247594+0000", 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0139999999999999e-06 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247603+0000", 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6049999999999998e-06 2024-09-18T05:14:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247609+0000", 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0630000000000002e-06 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274793+0000", 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027184090000000001 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274845+0000", 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1721999999999997e-05 2024-09-18T05:14:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274905+0000", 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0266000000000002e-05 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17141 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.197410008, 2024-09-18T05:14:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027536620000000001, 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17141 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247616+0000", 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.88e-06 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247625+0000", 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5920000000000001e-06 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247631+0000", 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9540000000000001e-06 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274940+0000", 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027308534999999998 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275011+0000", 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1077999999999999e-05 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275151+0000", 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014013299999999999 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17142 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.197387743, 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027675153000000001, 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17142 2024-09-18T05:14:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247639+0000", 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9739999999999998e-06 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247648+0000", 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8519999999999993e-06 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247654+0000", 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9540000000000001e-06 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275168+0000", 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027514732 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275229+0000", 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0924000000000001e-05 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275312+0000", 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2293999999999995e-05 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17143 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19736496000000001, 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027847998999999998, 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17143 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247661+0000", 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8169999999999999e-06 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247672+0000", 2024-09-18T05:14:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0909e-05 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247679+0000", 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1680000000000001e-06 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275351+0000", 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027672703999999999 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275426+0000", 2024-09-18T05:14:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4963999999999996e-05 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275507+0000", 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1006000000000003e-05 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17144 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247684+0000", 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19734026299999999, 2024-09-18T05:14:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028012624999999999, 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17144 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247684+0000", 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247684+0000", 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247683+0000", 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247686+0000", 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:14:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247695+0000", 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4540000000000007e-06 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247704+0000", 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0259999999999996e-06 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275550+0000", 2024-09-18T05:14:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027846063000000001 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275617+0000", 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7797000000000002e-05 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275697+0000", 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9104999999999996e-05 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17145 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247709+0000", 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19731511199999999, 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028149608, 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17145 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247709+0000", 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247709+0000", 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247708+0000", 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247711+0000", 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8600000000000001e-06 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247722+0000", 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0237e-05 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247735+0000", 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3766e-05 2024-09-18T05:14:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275733+0000", 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027997226 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275788+0000", 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5896000000000002e-05 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275859+0000", 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0220000000000002e-05 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17146 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247743+0000", 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19728111500000001, 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028277204, 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17146 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247743+0000", 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247743+0000", 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247742+0000", 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247746+0000", 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2480000000000001e-06 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247754+0000", 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9120000000000004e-06 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247763+0000", 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9679999999999995e-06 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275894+0000", 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028131008999999998 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275950+0000", 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5822000000000002e-05 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276020+0000", 2024-09-18T05:14:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9999000000000005e-05 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17155 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247769+0000", 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.197255292, 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028435576000000001, 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17155 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247769+0000", 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247769+0000", 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247768+0000", 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247777+0000", 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6819999999999992e-06 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247787+0000", 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.004e-05 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247798+0000", 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1060000000000001e-05 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276054+0000", 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028256165999999999 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276124+0000", 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9923000000000001e-05 2024-09-18T05:14:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276204+0000", 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0265000000000005e-05 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17156 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247810+0000", 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19721371600000001, 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028629623, 2024-09-18T05:14:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17156 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247810+0000", 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247810+0000", 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247809+0000", 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247830+0000", 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0060000000000001e-05 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247846+0000", 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6191000000000001e-05 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247863+0000", 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7649e-05 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276253+0000", 2024-09-18T05:14:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028390049000000001 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276339+0000", 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5741999999999993e-05 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276440+0000", 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010090300000000001 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17157 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19714871, 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028768309999999998, 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17157 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247880+0000", 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2630000000000003e-06 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247897+0000", 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7465e-05 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247912+0000", 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4983e-05 2024-09-18T05:14:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276487+0000", 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028574835 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276555+0000", 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7849999999999996e-05 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276644+0000", 2024-09-18T05:14:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8702999999999994e-05 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17158 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19710171400000001, 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028929555999999999, 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17158 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247927+0000", 2024-09-18T05:14:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-18T05:14:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247942+0000", 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5591999999999999e-05 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247954+0000", 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1839e-05 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276665+0000", 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028710497000000001 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276750+0000", 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4789000000000004e-05 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276852+0000", 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102456 2024-09-18T05:14:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17159 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247964+0000", 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19706006000000001, 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029089349, 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17159 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247964+0000", 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247964+0000", 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247963+0000", 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247969+0000", 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.502e-06 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247985+0000", 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6303e-05 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247999+0000", 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4011e-05 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276894+0000", 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028894676000000001 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276973+0000", 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9246999999999995e-05 2024-09-18T05:14:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277053+0000", 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0535000000000001e-05 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17160 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.248010+0000", 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.197014154, 2024-09-18T05:14:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029267069999999999, 2024-09-18T05:14:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17160 2024-09-18T05:14:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248010+0000", 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248010+0000", 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248009+0000", 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248014+0000", 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.169e-06 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248030+0000", 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5481999999999998e-05 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248041+0000", 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1592e-05 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277098+0000", 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029056826000000001 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277182+0000", 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4457999999999997e-05 2024-09-18T05:14:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277277+0000", 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4572000000000002e-05 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17161 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.248052+0000", 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19697250899999999, 2024-09-18T05:14:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029413175999999999, 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17161 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248052+0000", 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248052+0000", 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248051+0000", 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248056+0000", 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1830000000000002e-06 2024-09-18T05:14:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248086+0000", 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0620000000000002e-05 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248099+0000", 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2434e-05 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277318+0000", 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029218896000000001 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277385+0000", 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6926000000000003e-05 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277465+0000", 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0154000000000005e-05 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17162 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.248123+0000", 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19690079799999999, 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029517900999999999, 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17162 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248123+0000", 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248123+0000", 2024-09-18T05:14:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248122+0000", 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248129+0000", 2024-09-18T05:14:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2199999999999997e-06 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248148+0000", 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9660000000000002e-05 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248171+0000", 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2388e-05 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277490+0000", 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029319633000000001 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277572+0000", 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1160000000000002e-05 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277641+0000", 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9740000000000007e-05 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:01.539 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:01.539 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-18T05:14:01.540 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:01.539+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:01.541 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:01.547 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:01.547 INFO:teuthology.orchestra.run.smithi017.stdout:866 read 0x22f3662 thru 0x22f85d5 (0x4f74 bytes) 2024-09-18T05:14:01.567 INFO:teuthology.orchestra.run.smithi017.stdout:867 write 0x9d48bd2 thru 0x9d4c529 (0x3958 bytes) 2024-09-18T05:14:01.573 INFO:teuthology.orchestra.run.smithi017.stdout:868 read 0x80340aa thru 0x803db9c (0x9af3 bytes) 2024-09-18T05:14:01.576 INFO:teuthology.orchestra.run.smithi017.stdout:869 trunc from 0x9d4c52a to 0x8e7a375 2024-09-18T05:14:01.641 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:01.639+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:01.661 INFO:teuthology.orchestra.run.smithi017.stdout:871 write 0xd0a3882 thru 0xd0b0187 (0xc906 bytes) 2024-09-18T05:14:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:872 trunc from 0xd0b0188 to 0xea64f4b 2024-09-18T05:14:01.678 INFO:teuthology.orchestra.run.smithi017.stdout:873 write 0x1862803 thru 0x1866132 (0x3930 bytes) 2024-09-18T05:14:01.680 INFO:teuthology.orchestra.run.smithi017.stdout:876 write 0x5dd0a69 thru 0x5dd6f09 (0x64a1 bytes) 2024-09-18T05:14:01.683 INFO:teuthology.orchestra.run.smithi017.stdout:877 punch from 0x913320d to 0x9137e88, (0x4c7b bytes) 2024-09-18T05:14:01.683 INFO:teuthology.orchestra.run.smithi017.stdout:878 read 0x70b9bb7 thru 0x70c1cc8 (0x8112 bytes) 2024-09-18T05:14:01.683 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:880 trunc from 0xea64f4b to 0x8b3fbc5 2024-09-18T05:14:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17707 3.10 e33/22 3:0a264e7d:::rbd_object_map.118b63cee443:head v 33'70, mlcod=33'68)", 2024-09-18T05:14:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.692947+0000", 2024-09-18T05:14:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.00020790199999999999, 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025408599999999999, 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.692947+0000", 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.692947+0000", 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.692945+0000", 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.692968+0000", 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3136e-05 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.692998+0000", 2024-09-18T05:14:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0642999999999998e-05 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.693017+0000", 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8227999999999999e-05 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.693067+0000", 2024-09-18T05:14:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0766000000000001e-05 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.693089+0000", 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1784999999999999e-05 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 1 2024-09-18T05:14:01.700 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:01.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:01.742 INFO:teuthology.orchestra.run.smithi017.stdout:882 write 0x2d2cfe9 thru 0x2d3b3e2 (0xe3fa bytes) 2024-09-18T05:14:01.742 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:01.734+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:01.744 INFO:teuthology.orchestra.run.smithi017.stdout:883 write 0x7b87eff thru 0x7b8ca21 (0x4b23 bytes) 2024-09-18T05:14:01.747 INFO:teuthology.orchestra.run.smithi017.stdout:884 read 0x46a0844 thru 0x46a676d (0x5f2a bytes) 2024-09-18T05:14:01.748 INFO:teuthology.orchestra.run.smithi017.stdout:885 read 0x39abed1 thru 0x39b884a (0xc97a bytes) 2024-09-18T05:14:01.749 INFO:teuthology.orchestra.run.smithi017.stdout:886 write 0x5e7f24b thru 0x5e8bcaf (0xca65 bytes) 2024-09-18T05:14:01.763 INFO:teuthology.orchestra.run.smithi017.stdout:887 write 0xb407bce thru 0xb41760a (0xfa3d bytes) 2024-09-18T05:14:01.769 INFO:teuthology.orchestra.run.smithi017.stdout:888 punch from 0xfb03ed to 0xfb84fd, (0x8110 bytes) 2024-09-18T05:14:01.769 INFO:teuthology.orchestra.run.smithi017.stdout:889 punch from 0x7cab9a4 to 0x7cb30b4, (0x7710 bytes) 2024-09-18T05:14:01.786 INFO:teuthology.orchestra.run.smithi017.stdout:892 writesame 0xea278e0 thru 0xea31ef9 data_size 0x39(0xa61a bytes) 2024-09-18T05:14:01.788 INFO:teuthology.orchestra.run.smithi017.stdout:893 read 0xd34bed1 thru 0xd353e0f (0x7f3f bytes) 2024-09-18T05:14:01.788 INFO:teuthology.orchestra.run.smithi017.stdout:894 punch from 0x17c00ac to 0x17cbe54, (0xbda8 bytes) 2024-09-18T05:14:01.788 INFO:teuthology.orchestra.run.smithi017.stdout:896 punch from 0x76df515 to 0x76e7ffa, (0x8ae5 bytes) 2024-09-18T05:14:01.788 INFO:teuthology.orchestra.run.smithi017.stdout:897 read 0x595c913 thru 0x596588d (0x8f7b bytes) 2024-09-18T05:14:01.803 INFO:teuthology.orchestra.run.smithi017.stdout:898 trunc from 0xea31efa to 0x8620887 2024-09-18T05:14:01.825 INFO:teuthology.orchestra.run.smithi017.stdout:899 read 0x8d38f6 thru 0x8db362 (0x7a6d bytes) 2024-09-18T05:14:01.826 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:01.835 INFO:teuthology.orchestra.run.smithi017.stdout:901 trunc from 0x8620887 to 0x418fd2e 2024-09-18T05:14:01.843 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:01.843+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:01.864 INFO:teuthology.orchestra.run.smithi017.stdout:903 write 0x5829c88 thru 0x583186f (0x7be8 bytes) 2024-09-18T05:14:01.867 INFO:teuthology.orchestra.run.smithi017.stdout:904 writesame 0x48e93be thru 0x48f5774 data_size 0x3(0xc3b7 bytes) 2024-09-18T05:14:01.875 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:01.875 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:01.889 INFO:teuthology.orchestra.run.smithi017.stdout:905 punch from 0x400fd9f to 0x401e252, (0xe4b3 bytes) 2024-09-18T05:14:01.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:01.904 INFO:teuthology.orchestra.run.smithi017.stdout:906 trunc from 0x5831870 to 0xc4d5fd8 2024-09-18T05:14:01.914 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:01.914 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:01.914 INFO:teuthology.orchestra.run.smithi017.stdout:911 read 0x804d760 thru 0x8057f3e (0xa7df bytes) 2024-09-18T05:14:01.915 INFO:teuthology.orchestra.run.smithi017.stdout:912 writesame 0x7b247af thru 0x7b2526d data_size 0x15(0xabf bytes) 2024-09-18T05:14:01.917 INFO:teuthology.orchestra.run.smithi017.stdout:913 punch from 0xafd6d69 to 0xafe470e, (0xd9a5 bytes) 2024-09-18T05:14:01.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:14:01.933 INFO:teuthology.orchestra.run.smithi017.stdout:914 trunc from 0xc4d5fd8 to 0x3432191 2024-09-18T05:14:01.944 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:01.938+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:01.945 INFO:teuthology.orchestra.run.smithi017.stdout:915 read 0x26c6f67 thru 0x26d04e1 (0x957b bytes) 2024-09-18T05:14:01.961 INFO:teuthology.orchestra.run.smithi017.stdout:916 write 0x7991d40 thru 0x799c6b9 (0xa97a bytes) 2024-09-18T05:14:01.964 INFO:teuthology.orchestra.run.smithi017.stdout:917 write 0x1c76b93 thru 0x1c84f89 (0xe3f7 bytes) 2024-09-18T05:14:01.967 INFO:teuthology.orchestra.run.smithi017.stdout:918 read 0x45835c3 thru 0x4591067 (0xdaa5 bytes) 2024-09-18T05:14:01.967 INFO:teuthology.orchestra.run.smithi017.stdout:919 read 0x386c9f8 thru 0x3876ef9 (0xa502 bytes) 2024-09-18T05:14:01.968 INFO:teuthology.orchestra.run.smithi017.stdout:920 write 0x6ddae9 thru 0x6e0f50 (0x3468 bytes) 2024-09-18T05:14:01.971 INFO:teuthology.orchestra.run.smithi017.stdout:922 read 0x3e8d728 thru 0x3e953b4 (0x7c8d bytes) 2024-09-18T05:14:01.972 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:01.972 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:01.981 INFO:teuthology.orchestra.run.smithi017.stdout:925 trunc from 0x799c6ba to 0x27d494a 2024-09-18T05:14:02.007 INFO:teuthology.orchestra.run.smithi017.stdout:926 write 0x52c2026 thru 0x52ce2ea (0xc2c5 bytes) 2024-09-18T05:14:02.017 INFO:teuthology.orchestra.run.smithi017.stdout:927 trunc from 0x52ce2eb to 0xa453b05 2024-09-18T05:14:02.025 INFO:teuthology.orchestra.run.smithi017.stdout:928 punch from 0x7a02917 to 0x7a11c91, (0xf37a bytes) 2024-09-18T05:14:02.026 INFO:teuthology.orchestra.run.smithi017.stdout:929 punch from 0x3505603 to 0x3509132, (0x3b2f bytes) 2024-09-18T05:14:02.026 INFO:teuthology.orchestra.run.smithi017.stdout:931 punch from 0x478d32a to 0x4795064, (0x7d3a bytes) 2024-09-18T05:14:02.026 INFO:teuthology.orchestra.run.smithi017.stdout:932 trunc from 0xa453b05 to 0x97548c6 2024-09-18T05:14:02.034 INFO:teuthology.orchestra.run.smithi017.stdout:933 write 0x12f3966 thru 0x12f80cc (0x4767 bytes) 2024-09-18T05:14:02.037 INFO:teuthology.orchestra.run.smithi017.stdout:934 write 0x124cca7 thru 0x12512b6 (0x4610 bytes) 2024-09-18T05:14:02.042 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:02.042 INFO:teuthology.orchestra.run.smithi017.stdout:936 write 0x8875cbd thru 0x887fdb6 (0xa0fa bytes) 2024-09-18T05:14:02.045 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:02.043+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:02.046 INFO:teuthology.orchestra.run.smithi017.stdout:937 write 0x35fb87f thru 0x360a939 (0xf0bb bytes) 2024-09-18T05:14:02.049 INFO:teuthology.orchestra.run.smithi017.stdout:939 read 0x8f73da4 thru 0x8f79edb (0x6138 bytes) 2024-09-18T05:14:02.049 INFO:teuthology.orchestra.run.smithi017.stdout:940 clone 7 order 23 su 4194304 sc 12 2024-09-18T05:14:02.061 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16825 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1474560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83670232499999997, 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026210823000000001, 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16825 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219596+0000", 2024-09-18T05:14:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219602+0000", 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999999e-06 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219620+0000", 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7920000000000001e-05 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219633+0000", 2024-09-18T05:14:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3113e-05 2024-09-18T05:14:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245513+0000", 2024-09-18T05:14:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025879669000000001 2024-09-18T05:14:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245662+0000", 2024-09-18T05:14:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149009 2024-09-18T05:14:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245807+0000", 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145589 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16826 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83665296899999997, 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026570620999999999, 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16826 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219645+0000", 2024-09-18T05:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219652+0000", 2024-09-18T05:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4570000000000002e-06 2024-09-18T05:14:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219670+0000", 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8295999999999999e-05 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219704+0000", 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4536000000000003e-05 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245864+0000", 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026159953 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246030+0000", 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016550899999999999 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246217+0000", 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018675300000000001 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16885 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2752512~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83490423599999997, 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026057257, 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16885 2024-09-18T05:14:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221394+0000", 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221400+0000", 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.533e-06 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221418+0000", 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8029999999999998e-05 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221432+0000", 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3453e-05 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247088+0000", 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025655971999999999 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247255+0000", 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167066 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247452+0000", 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019720600000000001 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16886 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.834855456, 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026360268999999999, 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16886 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221442+0000", 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221455+0000", 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2116000000000001e-05 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221472+0000", 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.787e-05 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221486+0000", 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3573e-05 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247512+0000", 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026025942999999999 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247647+0000", 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000134859 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247804+0000", 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015688099999999999 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16887 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83480069700000004, 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026704731999999998, 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16887 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221497+0000", 2024-09-18T05:14:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221503+0000", 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2700000000000001e-06 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221522+0000", 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221535+0000", 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3556e-05 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247862+0000", 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026326385000000001 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248014+0000", 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152168 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248203+0000", 2024-09-18T05:14:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000189276 2024-09-18T05:14:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16888 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83475067000000003, 2024-09-18T05:14:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027263773000000002, 2024-09-18T05:14:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16888 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221547+0000", 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221554+0000", 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1430000000000001e-06 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221572+0000", 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7609999999999999e-05 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221585+0000", 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2639999999999999e-05 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248308+0000", 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026723558000000001 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248546+0000", 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000237741 2024-09-18T05:14:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248812+0000", 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026612100000000002 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16889 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83470235999999998, 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027689516000000001, 2024-09-18T05:14:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16889 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221595+0000", 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221602+0000", 2024-09-18T05:14:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0169999999999999e-06 2024-09-18T05:14:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221621+0000", 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8386e-05 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221634+0000", 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.341e-05 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248882+0000", 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027247771 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249066+0000", 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018403000000000001 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249286+0000", 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219986 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16890 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83465331499999995, 2024-09-18T05:14:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028101418999999999, 2024-09-18T05:14:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16890 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221645+0000", 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221650+0000", 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7939999999999999e-06 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221667+0000", 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6616000000000002e-05 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221680+0000", 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2663999999999999e-05 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249351+0000", 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027670808000000002 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249539+0000", 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000188505 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249747+0000", 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020795199999999999 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16947 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2654208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83347462400000005, 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027363044999999999, 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16947 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222822+0000", 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222856+0000", 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316999999999997e-05 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222891+0000", 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4273000000000002e-05 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222914+0000", 2024-09-18T05:14:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3119e-05 2024-09-18T05:14:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249808+0000", 2024-09-18T05:14:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026894668 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249979+0000", 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017036699999999999 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250187+0000", 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020850400000000001 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16948 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83336487800000003, 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027712835000000002, 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16948 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222933+0000", 2024-09-18T05:14:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222941+0000", 2024-09-18T05:14:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2330000000000006e-06 2024-09-18T05:14:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222961+0000", 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9933999999999999e-05 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222976+0000", 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5486e-05 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250249+0000", 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027272951 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250424+0000", 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017490999999999999 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250647+0000", 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000222761 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16949 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83330964500000004, 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028222578000000002, 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16949 2024-09-18T05:14:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222988+0000", 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222995+0000", 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7059999999999998e-06 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223013+0000", 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8267e-05 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223027+0000", 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3852999999999999e-05 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250733+0000", 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027705456 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250935+0000", 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020255800000000001 2024-09-18T05:14:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251212+0000", 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027678400000000003 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16950 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83325930500000001, 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028659265999999999, 2024-09-18T05:14:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16950 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223039+0000", 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223045+0000", 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1500000000000004e-06 2024-09-18T05:14:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223062+0000", 2024-09-18T05:14:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223076+0000", 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3495999999999999e-05 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251277+0000", 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028201066 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251460+0000", 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018261199999999999 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251699+0000", 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000239359 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16951 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83321091199999997, 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029073671999999998, 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16951 2024-09-18T05:14:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223087+0000", 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223093+0000", 2024-09-18T05:14:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.003e-06 2024-09-18T05:14:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223110+0000", 2024-09-18T05:14:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7024000000000002e-05 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223124+0000", 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3682999999999999e-05 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251760+0000", 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028636582000000001 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251957+0000", 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019702399999999999 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252162+0000", 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020431299999999999 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16952 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.833161229, 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029652123999999998, 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16952 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223136+0000", 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223143+0000", 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9600000000000003e-06 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223160+0000", 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.721e-05 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223173+0000", 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2486e-05 2024-09-18T05:14:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252238+0000", 2024-09-18T05:14:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029065160999999999 2024-09-18T05:14:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252459+0000", 2024-09-18T05:14:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022082100000000001 2024-09-18T05:14:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252790+0000", 2024-09-18T05:14:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033094299999999999 2024-09-18T05:14:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16953 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83311516600000002, 2024-09-18T05:14:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030055742999999999, 2024-09-18T05:14:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16953 2024-09-18T05:14:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223183+0000", 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223188+0000", 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223205+0000", 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6359999999999999e-05 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223217+0000", 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2296000000000001e-05 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252853+0000", 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029636077 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253035+0000", 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018143900000000001 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253239+0000", 2024-09-18T05:14:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000204878 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16954 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83307198999999998, 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030518435, 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16954 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223226+0000", 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223231+0000", 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9529999999999998e-06 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223249+0000", 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7754e-05 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223261+0000", 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.198e-05 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253312+0000", 2024-09-18T05:14:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030051123999999999 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253507+0000", 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019456700000000001 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253745+0000", 2024-09-18T05:14:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023878699999999999 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17135 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.82662190300000005, 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026407401, 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17135 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229676+0000", 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229683+0000", 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0400000000000004e-06 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229701+0000", 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8182999999999999e-05 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229714+0000", 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3193000000000001e-05 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255689+0000", 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025974962000000001 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255873+0000", 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018339300000000001 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256084+0000", 2024-09-18T05:14:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021176999999999999 2024-09-18T05:14:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17136 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.82657360700000004, 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026860747000000001, 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17136 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229724+0000", 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229730+0000", 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6629999999999998e-06 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229746+0000", 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6293000000000001e-05 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229759+0000", 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2747e-05 2024-09-18T05:14:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256148+0000", 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026389072999999999 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256345+0000", 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019683799999999999 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256586+0000", 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024106999999999999 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17137 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.82652913800000005, 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027322796999999999, 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17137 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229769+0000", 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229775+0000", 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6169999999999998e-06 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229791+0000", 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6126000000000001e-05 2024-09-18T05:14:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229804+0000", 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2917e-05 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256654+0000", 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026850816 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256857+0000", 2024-09-18T05:14:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020282399999999999 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257093+0000", 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023535 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17138 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.82648329399999998, 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027760476999999999, 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17138 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229815+0000", 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229820+0000", 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7729999999999996e-06 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229838+0000", 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7113e-05 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229850+0000", 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2320000000000001e-05 2024-09-18T05:14:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257154+0000", 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027304357000000001 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257348+0000", 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000193322 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257576+0000", 2024-09-18T05:14:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000228569 2024-09-18T05:14:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:02.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:02.170 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:02.167+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:02.270 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:02.262+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:02.333 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:02.334 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:02.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:02.392 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:02.386+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:02.473 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:02.466+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:02.515 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:02.515 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:02.515 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:02.515 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:02.515 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:02.529 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:02.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:02.573 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:02.571+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:02.677 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:02.671+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:02.704 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:02.704 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:02.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.470837516, 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4707699060000001, 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:02.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.47072252, 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:02.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:02.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:02.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4706771139999999, 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.470631824, 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:02.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.468997273, 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:02.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:02.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:02.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4689449539999999, 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:02.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.736 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4688273110000001, 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:02.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4687653919999999, 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:02.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:02.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:02.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.745 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4687069720000001, 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:02.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.468653346, 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.468606283, 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4685462039999999, 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.468485917, 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.468418601, 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.468369998, 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4682963789999999, 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4682228959999999, 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4681663060000001, 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4681201740000001, 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:02.794 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:02.796 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:02.796 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:02.796 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:02.797 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:02.797 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:02.797 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:02.798 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:02.798 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:02.798 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:02.798 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:02.799 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:02.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:02.790+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:02.809 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:02.830 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:02.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:02.853 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:02.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:02.914+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:02.939 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:02.940 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:02.954 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:02.997 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:02.995+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:03.017 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:14:03.099 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:03.099+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:03.104 INFO:teuthology.orchestra.run.smithi017.stdout:leaving image image_client.0-clone6 intact 2024-09-18T05:14:03.143 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:03.144 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:03.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:03.199 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:03.199+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:03.241 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-18T05:14:03.300 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:03.294+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:03.300 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:03.300 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:03.323 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:03.401 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:03.399+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:943 writesame 0x648c1ec thru 0x6491849 data_size 0x6e(0x565e bytes) 2024-09-18T05:14:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:03.502 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:03.503+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:03.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:944 write 0xe6f7c9d thru 0xe7052bd (0xd621 bytes) 2024-09-18T05:14:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:945 read 0x8ff19a2 thru 0x8ff2a87 (0x10e6 bytes) 2024-09-18T05:14:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:946 read 0x8d2a042 thru 0x8d33f60 (0x9f1f bytes) 2024-09-18T05:14:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:947 punch from 0x1577843 to 0x157c156, (0x4913 bytes) 2024-09-18T05:14:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:948 write 0x285a1be thru 0x285ee5c (0x4c9f bytes) 2024-09-18T05:14:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:949 punch from 0x59ccefc to 0x59ce0da, (0x11de bytes) 2024-09-18T05:14:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:951 writesame 0xc3eec7e thru 0xc3f5762 data_size 0xd(0x6ae5 bytes) 2024-09-18T05:14:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:952 punch from 0x3568f43 to 0x3577961, (0xea1e bytes) 2024-09-18T05:14:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:955 read 0xbfe7769 thru 0xbfed4bf (0x5d57 bytes) 2024-09-18T05:14:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:956 read 0x17a4777 thru 0x17a9624 (0x4eae bytes) 2024-09-18T05:14:03.551 INFO:teuthology.orchestra.run.smithi017.stdout:957 read 0x464abe5 thru 0x464c23f (0x165b bytes) 2024-09-18T05:14:03.551 INFO:teuthology.orchestra.run.smithi017.stdout:959 write 0x4f87ada thru 0x4f922d6 (0xa7fd bytes) 2024-09-18T05:14:03.583 INFO:teuthology.orchestra.run.smithi017.stdout:960 write 0x4e96f83 thru 0x4e973ae (0x42c bytes) 2024-09-18T05:14:03.586 INFO:teuthology.orchestra.run.smithi017.stdout:961 write 0xd9d929d thru 0xd9e22dd (0x9041 bytes) 2024-09-18T05:14:03.591 INFO:teuthology.orchestra.run.smithi017.stdout:964 read 0xd1b4181 thru 0xd1bd591 (0x9411 bytes) 2024-09-18T05:14:03.592 INFO:teuthology.orchestra.run.smithi017.stdout:966 write 0x9d7f4a9 thru 0x9d8c32e (0xce86 bytes) 2024-09-18T05:14:03.601 INFO:teuthology.orchestra.run.smithi017.stdout:967 punch from 0x8bf8019 to 0x8bf89f6, (0x9dd bytes) 2024-09-18T05:14:03.602 INFO:teuthology.orchestra.run.smithi017.stdout:968 write 0x223f9fc thru 0x2245008 (0x560d bytes) 2024-09-18T05:14:03.603 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:03.598+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:03.623 INFO:teuthology.orchestra.run.smithi017.stdout:969 write 0x7f085fe thru 0x7f110ac (0x8aaf bytes) 2024-09-18T05:14:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:970 writesame 0x5271a42 thru 0x5277fec data_size 0x1(0x65ab bytes) 2024-09-18T05:14:03.652 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:03.652 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:971 write 0x83c7ef9 thru 0x83d58ce (0xd9d6 bytes) 2024-09-18T05:14:03.668 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:03.696 INFO:teuthology.orchestra.run.smithi017.stdout:974 trunc from 0xe7052be to 0x1e777cc 2024-09-18T05:14:03.704 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:03.703+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:03.783 INFO:teuthology.orchestra.run.smithi017.stdout:975 write 0x5ffb6a5 thru 0x6007a90 (0xc3ec bytes) 2024-09-18T05:14:03.791 INFO:teuthology.orchestra.run.smithi017.stdout:976 write 0x4851e9c thru 0x485c9a7 (0xab0c bytes) 2024-09-18T05:14:03.803 INFO:teuthology.orchestra.run.smithi017.stdout:978 trunc from 0x6007a91 to 0xc5b4b58 2024-09-18T05:14:03.804 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:03.803+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:03.816 INFO:teuthology.orchestra.run.smithi017.stdout:979 write 0xff9f3 thru 0xffaf8 (0x106 bytes) 2024-09-18T05:14:03.828 INFO:teuthology.orchestra.run.smithi017.stdout:980 trunc from 0xc5b4b58 to 0x60dcc5f 2024-09-18T05:14:03.832 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:03.832 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:03.841 INFO:teuthology.orchestra.run.smithi017.stdout:981 write 0x1b5cbbf thru 0x1b6849b (0xb8dd bytes) 2024-09-18T05:14:03.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:03.868 INFO:teuthology.orchestra.run.smithi017.stdout:982 write 0xc4ab3f5 thru 0xc4ae628 (0x3234 bytes) 2024-09-18T05:14:03.875 INFO:teuthology.orchestra.run.smithi017.stdout:983 write 0x5271a3b thru 0x527ffb2 (0xe578 bytes) 2024-09-18T05:14:03.880 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:03.880 INFO:teuthology.orchestra.run.smithi017.stdout:986 write 0x1250c2c thru 0x1251049 (0x41e bytes) 2024-09-18T05:14:03.883 INFO:teuthology.orchestra.run.smithi017.stdout:988 read 0x781f891 thru 0x7829980 (0xa0f0 bytes) 2024-09-18T05:14:03.883 INFO:teuthology.orchestra.run.smithi017.stdout:989 read 0x8dd805f thru 0x8ddb158 (0x30fa bytes) 2024-09-18T05:14:03.883 INFO:teuthology.orchestra.run.smithi017.stdout:991 read 0x645a2ba thru 0x64676fb (0xd442 bytes) 2024-09-18T05:14:03.883 INFO:teuthology.orchestra.run.smithi017.stdout:992 punch from 0x72c818f to 0x72d023e, (0x80af bytes) 2024-09-18T05:14:03.883 INFO:teuthology.orchestra.run.smithi017.stdout:993 writesame 0x12a4fe8 thru 0x12ac88f data_size 0x84(0x78a8 bytes) 2024-09-18T05:14:03.886 INFO:teuthology.orchestra.run.smithi017.stdout:994 writesame 0x3bd7175 thru 0x3be4b92 data_size 0x1(0xda1e bytes) 2024-09-18T05:14:03.905 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:03.903+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:03.922 INFO:teuthology.orchestra.run.smithi017.stdout:995 punch from 0x7b67da9 to 0x7b73fd6, (0xc22d bytes) 2024-09-18T05:14:03.922 INFO:teuthology.orchestra.run.smithi017.stdout:996 read 0x1f0da07 thru 0x1f19317 (0xb911 bytes) 2024-09-18T05:14:03.941 INFO:teuthology.orchestra.run.smithi017.stdout:997 trunc from 0xc4ae629 to 0x543797b 2024-09-18T05:14:03.965 INFO:teuthology.orchestra.run.smithi017.stdout:998 read 0x7fb416 thru 0x80885f (0xd44a bytes) 2024-09-18T05:14:03.966 INFO:teuthology.orchestra.run.smithi017.stdout:999 read 0xee8c7c thru 0xef58d8 (0xcc5d bytes) 2024-09-18T05:14:03.967 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:03.980 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:03.980 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:03.982 INFO:teuthology.orchestra.run.smithi017.stdout:1002 write 0x5760cdc thru 0x5770ba7 (0xfecc bytes) 2024-09-18T05:14:03.989 INFO:teuthology.orchestra.run.smithi017.stdout:1003 clone 8 order 23 su 65536 sc 8 2024-09-18T05:14:03.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:04.007 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:04.002+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:04.110 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:04.102+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:04.163 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:04.163 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:04.175 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone7 from 0x5770ba8 (overlap 0x1e777cc) to 0x1553a42 2024-09-18T05:14:04.177 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:04.211 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:04.206+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:04.305 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:04.306 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:04.314 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:04.311+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:04.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:04.374 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-18T05:14:04.412 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:04.411+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:04.484 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:04.485 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:04.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:04.543 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:04.543+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:04.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:04.606+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:04.667 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:04.667 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:04.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:04.731 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:04.731+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:04.753 INFO:teuthology.orchestra.run.smithi017.stdout:1005 punch from 0x22507f9 to 0x2257292, (0x6a99 bytes) 2024-09-18T05:14:04.758 INFO:teuthology.orchestra.run.smithi017.stdout:1006 writesame 0x3bfb655 thru 0x3c0499b data_size 0x1(0x9347 bytes) 2024-09-18T05:14:04.814 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:04.814 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:04.814 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:04.815+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:04.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:04.833 INFO:teuthology.orchestra.run.smithi017.stdout:1007 write 0xdea324f thru 0xdeac3a0 (0x9152 bytes) 2024-09-18T05:14:04.838 INFO:teuthology.orchestra.run.smithi017.stdout:1008 read 0xc579fb7 thru 0xc582c19 (0x8c63 bytes) 2024-09-18T05:14:04.839 INFO:teuthology.orchestra.run.smithi017.stdout:1009 trunc from 0xdeac3a1 to 0xe799e49 2024-09-18T05:14:04.849 INFO:teuthology.orchestra.run.smithi017.stdout:1012 punch from 0xac6066c to 0xac6d8e7, (0xd27b bytes) 2024-09-18T05:14:04.850 INFO:teuthology.orchestra.run.smithi017.stdout:1014 writesame 0x4f4c82 thru 0x4fe099 data_size 0x1c(0x9418 bytes) 2024-09-18T05:14:04.864 INFO:teuthology.orchestra.run.smithi017.stdout:1017 write 0xed65a8d thru 0xed6f71b (0x9c8f bytes) 2024-09-18T05:14:04.869 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:04.870 INFO:teuthology.orchestra.run.smithi017.stdout:1019 write 0x243a4b9 thru 0x243bffa (0x1b42 bytes) 2024-09-18T05:14:04.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:04.915 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:04.915+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:04.922 INFO:teuthology.orchestra.run.smithi017.stdout:1020 trunc from 0xed6f71c to 0x10af66f 2024-09-18T05:14:04.925 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T05:14:04.925 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:14:04.925 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-18T05:14:04.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T05:14:04.986 INFO:teuthology.orchestra.run.smithi017.stdout:1021 punch from 0x866e11 to 0x86cd7b, (0x5f6a bytes) 2024-09-18T05:14:04.987 INFO:teuthology.orchestra.run.smithi017.stdout:1022 trunc from 0x10af66f to 0x47c245 2024-09-18T05:14:04.996 INFO:teuthology.orchestra.run.smithi017.stdout:1023 punch from 0x65fd8 to 0x6e734, (0x875c bytes) 2024-09-18T05:14:04.996 INFO:teuthology.orchestra.run.smithi017.stdout:1024 read 0x228923 thru 0x2359f9 (0xd0d7 bytes) 2024-09-18T05:14:05.009 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:05.009 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:05.012 INFO:teuthology.orchestra.run.smithi017.stdout:1025 write 0x620f9d7 thru 0x62174d3 (0x7afd bytes) 2024-09-18T05:14:05.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:05.010+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:05.024 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:14:05.036 INFO:teuthology.orchestra.run.smithi017.stdout:1028 write 0xcb50fae thru 0xcb53cef (0x2d42 bytes) 2024-09-18T05:14:05.041 INFO:teuthology.orchestra.run.smithi017.stdout:1029 punch from 0xcae9f90 to 0xcaed6f1, (0x3761 bytes) 2024-09-18T05:14:05.041 INFO:teuthology.orchestra.run.smithi017.stdout:1032 punch from 0x46c4d24 to 0x46c93e8, (0x46c4 bytes) 2024-09-18T05:14:05.041 INFO:teuthology.orchestra.run.smithi017.stdout:1036 punch from 0x6a979fc to 0x6a9e33b, (0x693f bytes) 2024-09-18T05:14:05.041 INFO:teuthology.orchestra.run.smithi017.stdout:1037 read 0x167f420 thru 0x168dc74 (0xe855 bytes) 2024-09-18T05:14:05.041 INFO:teuthology.orchestra.run.smithi017.stdout:1038 writesame 0xc41346b thru 0xc41d8bb data_size 0x2f(0xa451 bytes) 2024-09-18T05:14:05.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:14:05.044 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:05.044 INFO:teuthology.orchestra.run.smithi017.stdout:1041 write 0x9ef3de8 thru 0x9efaba1 (0x6dba bytes) 2024-09-18T05:14:05.048 INFO:teuthology.orchestra.run.smithi017.stdout:1043 write 0x4b21811 thru 0x4b2d927 (0xc117 bytes) 2024-09-18T05:14:05.052 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:05.052 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:05.052 INFO:teuthology.orchestra.run.smithi017.stdout:1046 punch from 0xb9dde5d to 0xb9ec10f, (0xe2b2 bytes) 2024-09-18T05:14:05.052 INFO:teuthology.orchestra.run.smithi017.stdout:1049 read 0x5982df5 thru 0x598a103 (0x730f bytes) 2024-09-18T05:14:05.052 INFO:teuthology.orchestra.run.smithi017.stdout:1050 writesame 0xbe30ec5 thru 0xbe3bd74 data_size 0x34(0xaeb0 bytes) 2024-09-18T05:14:05.066 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:05.066 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:05.072 INFO:teuthology.orchestra.run.smithi017.stdout:1051 trunc from 0xcb53cf0 to 0x2ab7ee0 2024-09-18T05:14:05.090 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:05.090 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:05.090 INFO:teuthology.orchestra.run.smithi017.stdout:1052 punch from 0x114068d to 0x1146d02, (0x6675 bytes) 2024-09-18T05:14:05.108 INFO:teuthology.orchestra.run.smithi017.stdout:1053 writesame 0x9c8fcad thru 0x9c90fe2 data_size 0x1(0x1336 bytes) 2024-09-18T05:14:05.116 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:05.110+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:05.119 INFO:teuthology.orchestra.run.smithi017.stdout:1054 trunc from 0x9c90fe3 to 0x13f29b0 2024-09-18T05:14:05.123 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:05.123 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:05.143 INFO:teuthology.orchestra.run.smithi017.stdout:1055 trunc from 0x13f29b0 to 0x921f8a6 2024-09-18T05:14:05.149 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:05.150 INFO:teuthology.orchestra.run.smithi017.stdout:1056 read 0x723d0e5 thru 0x723d125 (0x41 bytes) 2024-09-18T05:14:05.150 INFO:teuthology.orchestra.run.smithi017.stdout:1057 read 0x6a3179b thru 0x6a37aa4 (0x630a bytes) 2024-09-18T05:14:05.150 INFO:teuthology.orchestra.run.smithi017.stdout:1059 read 0x6b5ccd3 thru 0x6b6c31f (0xf64d bytes) 2024-09-18T05:14:05.150 INFO:teuthology.orchestra.run.smithi017.stdout:1060 writesame 0xff5617 thru 0xff9021 data_size 0x27(0x3a0b bytes) 2024-09-18T05:14:05.166 INFO:teuthology.orchestra.run.smithi017.stdout:1061 writesame 0xdef33e0 thru 0xdef5101 data_size 0x21(0x1d22 bytes) 2024-09-18T05:14:05.166 INFO:teuthology.orchestra.run.smithi017.stdout:1062 writesame 0x4948664 thru 0x49498f4 data_size 0x1(0x1291 bytes) 2024-09-18T05:14:05.184 INFO:teuthology.orchestra.run.smithi017.stdout:1063 trunc from 0xdef5102 to 0x4c5df19 2024-09-18T05:14:05.185 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:05.185 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:05.194 INFO:teuthology.orchestra.run.smithi017.stdout:1065 read 0xa8cebf thru 0xa9af82 (0xe0c4 bytes) 2024-09-18T05:14:05.197 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:05.197 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:05.211 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:14:05.213 INFO:teuthology.orchestra.run.smithi017.stdout:1066 write 0xc0b843b thru 0xc0c16b9 (0x927f bytes) 2024-09-18T05:14:05.220 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:05.220 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:05.220 INFO:teuthology.orchestra.run.smithi017.stdout:1067 trunc from 0xc0c16ba to 0xa7e051f 2024-09-18T05:14:05.233 INFO:teuthology.orchestra.run.smithi017.stdout:1070 punch from 0x8eda2b6 to 0x8ee558b, (0xb2d5 bytes) 2024-09-18T05:14:05.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:05.253 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:05.259 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:05.259+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:05.274 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:05.274 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:05.329 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:14:05.329 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:05.329 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 35, 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "04ac0d2c-34bd-46ad-a307-a4eb23236eb4", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-18T05:13:15.193498+0000", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-18T05:14:04.008596+0000", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-18T05:13:26.810974+0000", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-18T05:13:18.221936+0000", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5804032, 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "nodeep-scrub", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-18T05:14:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-18T05:14:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:28.629114+0000", 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:14:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:14:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:14:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:14:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-18T05:14:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-18T05:14:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-18T05:14:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-18T05:14:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-18T05:14:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:14:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "17", 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:14:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:14:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:14:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:14:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-18T05:14:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2024-09-18T05:14:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2024-09-18T05:14:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2024-09-18T05:14:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-18T05:14:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-18T05:14:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:34.103981+0000", 2024-09-18T05:14:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:14:05.343 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:14:05.344 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "21", 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 3, 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 21, 2024-09-18T05:14:05.345 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:14:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:14:05.347 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:14:05.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:44.114945+0000", 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:14:05.350 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:14:05.351 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:14:05.352 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:14:05.352 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:14:05.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.352 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "35", 2024-09-18T05:14:05.352 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:14:05.352 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:14:05.352 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:14:05.352 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 11, 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 35, 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:14:05.353 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:14:05.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:14:05.355 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2024-09-18T05:14:05.356 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "a2a580f7-2bbc-46c3-b6b5-5a9e93539d27", 2024-09-18T05:14:05.357 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:05.359 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.360 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.361 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.362 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1558450642", 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1558450642", 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1558450642", 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1558450642", 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "260da429-e6eb-446b-95a0-dcf4581bb584", 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-18T05:14:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-18T05:14:05.365 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-18T05:14:05.366 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-18T05:14:05.367 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3444575073", 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3444575073", 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3444575073", 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3444575073", 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:05.368 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "0cf5d53a-552d-4775-8437-86af3465b1bc", 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:05.369 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 18, 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.370 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-18T05:14:05.372 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-18T05:14:05.373 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/467806624", 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/467806624", 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/467806624", 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/467806624", 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.374 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "73bc18b6-4972-4164-a294-b6372bcf9f9d", 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:05.376 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:05.377 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:05.378 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/3763834627", 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/3763834627", 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/3763834627", 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/3763834627", 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "536c8ef2-eca6-44b4-a70c-06f191eb5ff1", 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.381 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6800", 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6802", 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6804", 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6806", 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6815", 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6819", 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6809", 2024-09-18T05:14:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6812", 2024-09-18T05:14:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6802/1703780253", 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6806/1703780253", 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6819/1703780253", 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6812/1703780253", 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.386 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "4341bba4-2913-4352-89d4-36fa18ee39cb", 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6808", 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6811", 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.388 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6813", 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6816", 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6822", 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6823", 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6817", 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:05.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6820", 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6811/3348904742", 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6816/3348904742", 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6823/3348904742", 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6820/3348904742", 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:05.392 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "e47d4aad-9c4b-43a9-9b32-2db463ec2a20", 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:05.393 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6801", 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6803", 2024-09-18T05:14:05.394 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6805", 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6807", 2024-09-18T05:14:05.395 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6818", 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6821", 2024-09-18T05:14:05.396 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6810", 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6814", 2024-09-18T05:14:05.397 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6803/74856761", 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6807/74856761", 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6821/74856761", 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6814/74856761", 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "686d275c-e592-44c1-87f9-ac9718f3a112", 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:05.399 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6824", 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6825", 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:05.400 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6826", 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6827", 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:05.401 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6830", 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6831", 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:05.402 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6828", 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6829", 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6825/1345159853", 2024-09-18T05:14:05.403 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6827/1345159853", 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6831/1345159853", 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6829/1345159853", 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.404 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.758535+0000", 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:05.405 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.800715+0000", 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:05.406 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.783374+0000", 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:05.407 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.779519+0000", 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.893837+0000", 2024-09-18T05:14:05.408 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.776852+0000", 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:14:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.919808+0000", 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:05.410 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.883599+0000", 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-18T05:14:05.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-18T05:14:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-18T05:14:05.413 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-18T05:14:05.413 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-18T05:14:05.413 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-18T05:14:05.413 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-18T05:14:05.413 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-18T05:14:05.413 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-18T05:14:05.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:05.413 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:05.414 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:05.322+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:05.415 INFO:tasks.thrashosds.thrasher:j is {'epoch': 35, 'fsid': '04ac0d2c-34bd-46ad-a307-a4eb23236eb4', 'created': '2024-09-18T05:13:15.193498+0000', 'modified': '2024-09-18T05:14:04.008596+0000', 'last_up_change': '2024-09-18T05:13:26.810974+0000', 'last_in_change': '2024-09-18T05:13:18.221936+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T05:13:28.629114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T05:13:34.103981+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T05:13:44.114945+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 11, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'a2a580f7-2bbc-46c3-b6b5-5a9e93539d27', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1558450642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1558450642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1558450642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1558450642}]}, 'public_addr': '172.21.15.17:6801/1558450642', 'cluster_addr': '172.21.15.17:6803/1558450642', 'heartbeat_back_addr': '172.21.15.17:6807/1558450642', 'heartbeat_front_addr': '172.21.15.17:6805/1558450642', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '260da429-e6eb-446b-95a0-dcf4581bb584', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3444575073}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3444575073}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3444575073}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3444575073}]}, 'public_addr': '172.21.15.17:6809/3444575073', 'cluster_addr': '172.21.15.17:6811/3444575073', 'heartbeat_back_addr': '172.21.15.17:6815/3444575073', 'heartbeat_front_addr': '172.21.15.17:6813/3444575073', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0cf5d53a-552d-4775-8437-86af3465b1bc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 467806624}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 467806624}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 467806624}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 467806624}]}, 'public_addr': '172.21.15.17:6817/467806624', 'cluster_addr': '172.21.15.17:6819/467806624', 'heartbeat_back_addr': '172.21.15.17:6823/467806624', 'heartbeat_front_addr': '172.21.15.17:6821/467806624', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '73bc18b6-4972-4164-a294-b6372bcf9f9d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6824', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6825', 'nonce': 3763834627}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6826', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6827', 'nonce': 3763834627}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6830', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6831', 'nonce': 3763834627}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6828', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6829', 'nonce': 3763834627}]}, 'public_addr': '172.21.15.17:6825/3763834627', 'cluster_addr': '172.21.15.17:6827/3763834627', 'heartbeat_back_addr': '172.21.15.17:6831/3763834627', 'heartbeat_front_addr': '172.21.15.17:6829/3763834627', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '536c8ef2-eca6-44b4-a70c-06f191eb5ff1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6802', 'nonce': 1703780253}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6806', 'nonce': 1703780253}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6815', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 1703780253}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6809', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6812', 'nonce': 1703780253}]}, 'public_addr': '172.21.15.86:6802/1703780253', 'cluster_addr': '172.21.15.86:6806/1703780253', 'heartbeat_back_addr': '172.21.15.86:6819/1703780253', 'heartbeat_front_addr': '172.21.15.86:6812/1703780253', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4341bba4-2913-4352-89d4-36fa18ee39cb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 3348904742}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6813', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6816', 'nonce': 3348904742}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6823', 'nonce': 3348904742}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6817', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6820', 'nonce': 3348904742}]}, 'public_addr': '172.21.15.86:6811/3348904742', 'cluster_addr': '172.21.15.86:6816/3348904742', 'heartbeat_back_addr': '172.21.15.86:6823/3348904742', 'heartbeat_front_addr': '172.21.15.86:6820/3348904742', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e47d4aad-9c4b-43a9-9b32-2db463ec2a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6801', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 74856761}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6805', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 74856761}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 74856761}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6814', 'nonce': 74856761}]}, 'public_addr': '172.21.15.86:6803/74856761', 'cluster_addr': '172.21.15.86:6807/74856761', 'heartbeat_back_addr': '172.21.15.86:6821/74856761', 'heartbeat_front_addr': '172.21.15.86:6814/74856761', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '686d275c-e592-44c1-87f9-ac9718f3a112', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 1345159853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6826', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 1345159853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6830', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 1345159853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6829', 'nonce': 1345159853}]}, 'public_addr': '172.21.15.86:6825/1345159853', 'cluster_addr': '172.21.15.86:6827/1345159853', 'heartbeat_back_addr': '172.21.15.86:6831/1345159853', 'heartbeat_front_addr': '172.21.15.86:6829/1345159853', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.758535+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.800715+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.783374+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.779519+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.893837+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.776852+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.919808+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.883599+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T05:14:05.415 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:1054 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'75, mlcod=26'71)", 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.846751454, 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061130209999999997, 2024-09-18T05:14:05.417 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488990+0000", 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488989+0000", 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.488997+0000", 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2089999999999999e-06 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489010+0000", 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3845e-05 2024-09-18T05:14:05.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489018+0000", 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2470000000000002e-06 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489045+0000", 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6846e-05 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.489064+0000", 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9134e-05 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495073+0000", 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060090760000000003 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.495103+0000", 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0502e-05 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.421 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:1474 3.a 3:5343cb89:::rbd_data.118b4598dbfb.0000000000000056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:51.834668+0000", 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.501073492, 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073003749999999996, 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.422 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1474 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834668+0000", 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834668+0000", 2024-09-18T05:14:05.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834667+0000", 2024-09-18T05:14:05.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:05.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834679+0000", 2024-09-18T05:14:05.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2397e-05 2024-09-18T05:14:05.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834708+0000", 2024-09-18T05:14:05.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9339000000000001e-05 2024-09-18T05:14:05.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834729+0000", 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0832999999999999e-05 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834852+0000", 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122939 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.834992+0000", 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013991900000000001 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.835234+0000", 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024224199999999999 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.837039+0000", 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001804167 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.841864+0000", 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048259790000000002 2024-09-18T05:14:05.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.841925+0000", 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0585999999999999e-05 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:51.841969+0000", 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3510999999999997e-05 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2316 3.a 3:56bb9c78:::rbd_data.118b4598dbfb.0000000000000055:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.473356+0000", 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.862385878, 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.017501419000000001, 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2316 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.430 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473356+0000", 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473356+0000", 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473355+0000", 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473361+0000", 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6270000000000002e-06 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473375+0000", 2024-09-18T05:14:05.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3378e-05 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473381+0000", 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6669999999999999e-06 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473429+0000", 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7839000000000001e-05 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.473488+0000", 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8817999999999998e-05 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.474466+0000", 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00097748400000000004 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490699+0000", 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016233195999999998 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490722+0000", 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3387000000000002e-05 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490800+0000", 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8279e-05 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490857+0000", 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6807e-05 2024-09-18T05:14:05.435 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2317 3.a 3:5343cb89:::rbd_data.118b4598dbfb.0000000000000056:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.478386+0000", 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.857356157, 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012680342000000001, 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.436 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2317 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478386+0000", 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478386+0000", 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478383+0000", 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478398+0000", 2024-09-18T05:14:05.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.454e-05 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478429+0000", 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0895999999999997e-05 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.478443+0000", 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4097000000000001e-05 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.480367+0000", 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001923775 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.480496+0000", 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012927199999999999 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.481973+0000", 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001477426 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490876+0000", 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0089027010000000007 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490939+0000", 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2440000000000005e-05 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.491013+0000", 2024-09-18T05:14:05.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4219000000000002e-05 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.491066+0000", 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3155999999999997e-05 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4491.0:2316 3.a e26/22 ondisk, result = 0)", 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.479730+0000", 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.856011934, 2024-09-18T05:14:05.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010977288999999999, 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479730+0000", 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479730+0000", 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479728+0000", 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479737+0000", 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7629999999999995e-06 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479762+0000", 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4544000000000001e-05 2024-09-18T05:14:05.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.479784+0000", 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2180000000000001e-05 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490674+0000", 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010889981999999999 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490687+0000", 2024-09-18T05:14:05.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2717e-05 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.490707+0000", 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2543 3.a 3:565046da:::rbd_data.118b4598dbfb.000000000000018a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.767238+0000", 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.568503979000001, 2024-09-18T05:14:05.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061646319999999998, 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2543 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767238+0000", 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767238+0000", 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767235+0000", 2024-09-18T05:14:05.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767248+0000", 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3312999999999999e-05 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767301+0000", 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2580000000000001e-05 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767321+0000", 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9910000000000001e-05 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767419+0000", 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8228999999999998e-05 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767647+0000", 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000227405 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.767880+0000", 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023299200000000001 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.772085+0000", 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042059039999999999 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.773145+0000", 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001059618 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.773290+0000", 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014529500000000001 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.773402+0000", 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011202 2024-09-18T05:14:05.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2611 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'314, mlcod=26'310)", 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:52.856021+0000", 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.479720752, 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081837939999999994, 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856021+0000", 2024-09-18T05:14:05.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856021+0000", 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856019+0000", 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856034+0000", 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5150000000000001e-05 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856063+0000", 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9346999999999999e-05 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856082+0000", 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8845999999999999e-05 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856316+0000", 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000234069 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.856358+0000", 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1523000000000002e-05 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.864108+0000", 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077500670000000002 2024-09-18T05:14:05.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:52.864205+0000", 2024-09-18T05:14:05.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6892000000000007e-05 2024-09-18T05:14:05.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.457 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2711 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'340, mlcod=26'337)", 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.039084+0000", 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.296657667, 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068687360000000003, 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039084+0000", 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039084+0000", 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039083+0000", 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039092+0000", 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7630000000000006e-06 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039105+0000", 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2999e-05 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039112+0000", 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5800000000000003e-06 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039625+0000", 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051310600000000004 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039661+0000", 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5633000000000003e-05 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045892+0000", 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0062304889999999996 2024-09-18T05:14:05.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045953+0000", 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1218999999999998e-05 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2712 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'341, mlcod=26'337)", 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.039870+0000", 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.29587152, 2024-09-18T05:14:05.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061192420000000004, 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039870+0000", 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039870+0000", 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039868+0000", 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039884+0000", 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6039999999999999e-05 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039919+0000", 2024-09-18T05:14:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4876000000000003e-05 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.039961+0000", 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2277000000000002e-05 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040662+0000", 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070039799999999997 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.040714+0000", 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2062999999999999e-05 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045958+0000", 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052443619999999998 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.045989+0000", 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1112999999999998e-05 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:2807 3.1e e26/22 3:78a38714:::rbd_object_map.118b4598dbfb:head v 26'377, mlcod=26'371)", 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.158054+0000", 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.177687783, 2024-09-18T05:14:05.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006727055, 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158054+0000", 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158054+0000", 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158052+0000", 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158067+0000", 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5073e-05 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158111+0000", 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3463e-05 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.158130+0000", 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9259999999999999e-05 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.159247+0000", 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011168020000000001 2024-09-18T05:14:05.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.159316+0000", 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8821999999999999e-05 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.164692+0000", 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053760459999999998 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.164781+0000", 2024-09-18T05:14:05.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9232000000000002e-05 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:2868 3.a 3:5376ad2d:::rbd_data.118b4598dbfb.0000000000000094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:53.235008+0000", 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.100733809999999, 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064425769999999997, 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.472 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2868 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235008+0000", 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235008+0000", 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235004+0000", 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235043+0000", 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8617e-05 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235091+0000", 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7642999999999998e-05 2024-09-18T05:14:05.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235112+0000", 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1290000000000001e-05 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235288+0000", 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176181 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235510+0000", 2024-09-18T05:14:05.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221492 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.235714+0000", 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020429199999999999 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.237797+0000", 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020828209999999999 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.241245+0000", 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034486529999999999 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.241380+0000", 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000134645 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:53.241450+0000", 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0423e-05 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.478 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:4899 3.10 3:08ede3af:::rbd_data.118b29ff732c.0000000000000113:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-18T05:14:05.478 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:55.891790+0000", 2024-09-18T05:14:05.478 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4439519609999998, 2024-09-18T05:14:05.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091234950000000006, 2024-09-18T05:14:05.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 4899 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891790+0000", 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891790+0000", 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891787+0000", 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891802+0000", 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5276000000000001e-05 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891834+0000", 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1575999999999997e-05 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891849+0000", 2024-09-18T05:14:05.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5469e-05 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.891913+0000", 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3910000000000003e-05 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.892088+0000", 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017490299999999999 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.893545+0000", 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014572739999999999 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.900849+0000", 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073033539999999997 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.900858+0000", 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9549999999999998e-06 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.900889+0000", 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0877999999999998e-05 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:55.900913+0000", 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4674000000000001e-05 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:9125 3.a 3:56aee181:::rbd_data.118beb25b049.000000000000002b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:57.061952+0000", 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.2737894789999995, 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077378330000000004, 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.485 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9125 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.061952+0000", 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.061952+0000", 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.061949+0000", 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.061965+0000", 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.647e-05 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.062003+0000", 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8206e-05 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.062020+0000", 2024-09-18T05:14:05.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7087000000000001e-05 2024-09-18T05:14:05.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.062158+0000", 2024-09-18T05:14:05.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013803200000000001 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.062170+0000", 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1579999999999999e-05 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.066944+0000", 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047738609999999999 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.067147+0000", 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020342400000000001 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.067447+0000", 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029934200000000002 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.068903+0000", 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014568420000000001 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.069553+0000", 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00064944099999999995 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.069635+0000", 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2056000000000002e-05 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:57.069690+0000", 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5056000000000003e-05 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.491 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:9592 3.a 3:55702653:::rbd_data.118beb25b049.0000000000000010:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:13:58.120855+0000", 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.2148870680000003, 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012271321999999999, 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9592 2024-09-18T05:14:05.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120855+0000", 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120855+0000", 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120853+0000", 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120870+0000", 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7125999999999998e-05 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120911+0000", 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1106000000000003e-05 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.120934+0000", 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3377e-05 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.121067+0000", 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013296599999999999 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.121262+0000", 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019531400000000001 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.121740+0000", 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000477407 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.124314+0000", 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025740300000000002 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.132872+0000", 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085581979999999995 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.133029+0000", 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015696199999999999 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:13:58.133126+0000", 2024-09-18T05:14:05.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6955999999999998e-05 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17178 3.10 3:097d2206:::rbd_data.118bd6f23a9d.0000000000000007:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.232017+0000", 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.1037248589999997, 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060800730000000001, 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17178 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.232017+0000", 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.232017+0000", 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.232016+0000", 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.232021+0000", 2024-09-18T05:14:05.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0259999999999998e-06 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.232035+0000", 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4508000000000001e-05 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.232046+0000", 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0971e-05 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.237622+0000", 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055756690000000001 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.237865+0000", 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024291199999999999 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.238097+0000", 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023193000000000001 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.502 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17663 3.10 3:0a264e7d:::rbd_object_map.118b63cee443:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.598923+0000", 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7368182349999999, 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083343549999999999, 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17663 2024-09-18T05:14:05.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.598923+0000", 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.598923+0000", 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.598922+0000", 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.598933+0000", 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.095e-05 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.598955+0000", 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2476999999999998e-05 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.598970+0000", 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5073e-05 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.601492+0000", 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025220279999999999 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.601605+0000", 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011231 2024-09-18T05:14:05.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.602056+0000", 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00045164100000000002 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.603562+0000", 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001505775 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.607149+0000", 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035874750000000001 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.607212+0000", 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2324999999999997e-05 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.607258+0000", 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6075000000000002e-05 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.508 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.509 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.509 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17668 3.10 3:09b46f12:::rbd_data.118b63cee443.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 16515072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:05.509 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.608404+0000", 2024-09-18T05:14:05.509 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7273376489999999, 2024-09-18T05:14:05.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.018423361999999999, 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17668 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.608404+0000", 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.608404+0000", 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.608403+0000", 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614783+0000", 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063802160000000002 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614835+0000", 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2265999999999997e-05 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614861+0000", 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5429999999999999e-05 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614968+0000", 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010706500000000001 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.615168+0000", 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000200686 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.615897+0000", 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072894400000000003 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.626600+0000", 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010702784 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.626630+0000", 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0187000000000001e-05 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.626722+0000", 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1983000000000003e-05 2024-09-18T05:14:05.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.626827+0000", 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010508199999999999 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17670 3.10 3:0a264e7d:::rbd_object_map.118b63cee443:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.614911+0000", 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7208311219999999, 2024-09-18T05:14:05.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012207930000000001, 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17670 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614911+0000", 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614911+0000", 2024-09-18T05:14:05.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614908+0000", 2024-09-18T05:14:05.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:05.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614921+0000", 2024-09-18T05:14:05.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.327e-05 2024-09-18T05:14:05.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614941+0000", 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0489999999999999e-05 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614957+0000", 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5130000000000001e-05 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.621515+0000", 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065587609999999998 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.621614+0000", 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8972e-05 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.622112+0000", 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00049744600000000002 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.626848+0000", 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047360960000000004 2024-09-18T05:14:05.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.626924+0000", 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6626999999999997e-05 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627001+0000", 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6493000000000001e-05 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627119+0000", 2024-09-18T05:14:05.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117525 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17671 3.10 3:0a264e7d:::rbd_object_map.118b63cee443:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.614971+0000", 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7207705359999999, 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012411391000000001, 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.522 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17671 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614971+0000", 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614971+0000", 2024-09-18T05:14:05.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614970+0000", 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.614996+0000", 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6126999999999999e-05 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.615015+0000", 2024-09-18T05:14:05.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8770000000000002e-05 2024-09-18T05:14:05.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.615029+0000", 2024-09-18T05:14:05.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3763e-05 2024-09-18T05:14:05.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.622781+0000", 2024-09-18T05:14:05.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077519099999999999 2024-09-18T05:14:05.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.623046+0000", 2024-09-18T05:14:05.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026500500000000001 2024-09-18T05:14:05.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.624103+0000", 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010575750000000001 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627210+0000", 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031065860000000002 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627224+0000", 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4657e-05 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627326+0000", 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101229 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627383+0000", 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6988999999999999e-05 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17672 3.10 3:0a264e7d:::rbd_object_map.118b63cee443:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.616993+0000", 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7187488010000003, 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010616545, 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:05.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:05.530 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:05.530 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17672 2024-09-18T05:14:05.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.530 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:05.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:05.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.616993+0000", 2024-09-18T05:14:05.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.616993+0000", 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.616990+0000", 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:05.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.617010+0000", 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0953000000000001e-05 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.617048+0000", 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7503000000000003e-05 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.617072+0000", 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4283000000000001e-05 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.625105+0000", 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080325710000000005 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.625285+0000", 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018038599999999999 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:14:05.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.625897+0000", 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061170099999999998 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627402+0000", 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001505202 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627457+0000", 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5012000000000001e-05 2024-09-18T05:14:05.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627525+0000", 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7615999999999998e-05 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.627609+0000", 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4688e-05 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.535 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.536 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.536 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:05.536 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:05.536 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:05.536 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:05.538 INFO:teuthology.orchestra.run.smithi017.stdout:1071 writesame 0xd39125d thru 0xd39efd8 data_size 0xa2(0xdd7c bytes) 2024-09-18T05:14:05.538 INFO:teuthology.orchestra.run.smithi017.stdout:1072 write 0x654c666 thru 0x654feb2 (0x384d bytes) 2024-09-18T05:14:05.538 INFO:teuthology.orchestra.run.smithi017.stdout:1074 flatten 2024-09-18T05:14:05.541 INFO:teuthology.orchestra.run.smithi017.stdout:1075 write 0xb41458b thru 0xb41ee02 (0xa878 bytes) 2024-09-18T05:14:05.541 INFO:teuthology.orchestra.run.smithi017.stdout:1076 read 0xaae224e thru 0xaae4d59 (0x2b0c bytes) 2024-09-18T05:14:05.541 INFO:teuthology.orchestra.run.smithi017.stdout:1078 writesame 0xd0dd2b9 thru 0xd0e8d0a data_size 0x7(0xba52 bytes) 2024-09-18T05:14:05.542 INFO:teuthology.orchestra.run.smithi017.stdout:1079 trunc from 0xd39efd9 to 0x8d7fc17 2024-09-18T05:14:05.542 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:05.542 INFO:teuthology.orchestra.run.smithi017.stdout:1081 read 0xc0164a thru 0xc0e493 (0xce4a bytes) 2024-09-18T05:14:05.542 INFO:teuthology.orchestra.run.smithi017.stdout:1082 read 0x36268b4 thru 0x3635f01 (0xf64e bytes) 2024-09-18T05:14:05.543 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:05.539+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:05.554 INFO:teuthology.orchestra.run.smithi017.stdout:1084 writesame 0xd3691fb thru 0xd371290 data_size 0x6d(0x8096 bytes) 2024-09-18T05:14:05.554 INFO:teuthology.orchestra.run.smithi017.stdout:1085 write 0xbb88651 thru 0xbb98433 (0xfde3 bytes) 2024-09-18T05:14:05.562 INFO:teuthology.orchestra.run.smithi017.stdout:1086 read 0x99a2887 thru 0x99afca5 (0xd41f bytes) 2024-09-18T05:14:05.562 INFO:teuthology.orchestra.run.smithi017.stdout:1087 punch from 0x3a37cdd to 0x3a4147a, (0x979d bytes) 2024-09-18T05:14:05.562 INFO:teuthology.orchestra.run.smithi017.stdout:1088 write 0x6bcf847 thru 0x6bdb16e (0xb928 bytes) 2024-09-18T05:14:05.570 INFO:teuthology.orchestra.run.smithi017.stdout:1091 write 0x34b867d thru 0x34c1bb8 (0x953c bytes) 2024-09-18T05:14:05.573 INFO:teuthology.orchestra.run.smithi017.stdout:1093 read 0x74b74d3 thru 0x74c3e2b (0xc959 bytes) 2024-09-18T05:14:05.592 INFO:teuthology.orchestra.run.smithi017.stdout:1094 trunc from 0xd371291 to 0x6d638e2 2024-09-18T05:14:05.632 INFO:teuthology.orchestra.run.smithi017.stdout:1095 trunc from 0x6d638e2 to 0xc28eb21 2024-09-18T05:14:05.638 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:05.630+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:05.645 INFO:teuthology.orchestra.run.smithi017.stdout:1096 write 0x973d68 thru 0x97ea26 (0xacbf bytes) 2024-09-18T05:14:05.649 INFO:teuthology.orchestra.run.smithi017.stdout:1098 read 0xa3c855e thru 0xa3cb09e (0x2b41 bytes) 2024-09-18T05:14:05.649 INFO:teuthology.orchestra.run.smithi017.stdout:1100 write 0xbce77f7 thru 0xbceeae6 (0x72f0 bytes) 2024-09-18T05:14:05.657 INFO:teuthology.orchestra.run.smithi017.stdout:1101 punch from 0x2fe1140 to 0x2fe8aa8, (0x7968 bytes) 2024-09-18T05:14:05.657 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:05.657 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:05.662 INFO:teuthology.orchestra.run.smithi017.stdout:1104 trunc from 0xc28eb21 to 0xe02164b 2024-09-18T05:14:05.675 INFO:teuthology.orchestra.run.smithi017.stdout:1105 punch from 0x4a1912c to 0x4a1f836, (0x670a bytes) 2024-09-18T05:14:05.676 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:05.676 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:05.676 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:05.676 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:05.691 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:05.701 INFO:teuthology.orchestra.run.smithi017.stdout:1106 trunc from 0xe02164b to 0x421a134 2024-09-18T05:14:05.739 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:05.739+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:05.748 INFO:teuthology.orchestra.run.smithi017.stdout:1107 trunc from 0x421a134 to 0xcc97009 2024-09-18T05:14:05.760 INFO:teuthology.orchestra.run.smithi017.stdout:1109 read 0x195540c thru 0x196028e (0xae83 bytes) 2024-09-18T05:14:05.761 INFO:teuthology.orchestra.run.smithi017.stdout:1110 write 0xa60f770 thru 0xa61d428 (0xdcb9 bytes) 2024-09-18T05:14:05.799 INFO:teuthology.orchestra.run.smithi017.stdout:1112 trunc from 0xcc97009 to 0x1d9cd24 2024-09-18T05:14:05.818 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:05.819 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:05.828 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:05.828 INFO:teuthology.orchestra.run.smithi017.stdout:1114 trunc from 0x1d9cd24 to 0x1937f5b 2024-09-18T05:14:05.835 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:05.852 INFO:teuthology.orchestra.run.smithi017.stdout:1115 trunc from 0x1937f5b to 0x475c4fe 2024-09-18T05:14:05.863 INFO:teuthology.orchestra.run.smithi017.stdout:1117 read 0x18c0cd5 thru 0x18cf969 (0xec95 bytes) 2024-09-18T05:14:05.864 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:05.864 INFO:teuthology.orchestra.run.smithi017.stdout:1120 punch from 0x25685ca to 0x25704fd, (0x7f33 bytes) 2024-09-18T05:14:05.864 INFO:teuthology.orchestra.run.smithi017.stdout:1122 read 0x1905d02 thru 0x1909c75 (0x3f74 bytes) 2024-09-18T05:14:05.883 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:05.883+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:1123 write 0xa0c0d19 thru 0xa0cee91 (0xe179 bytes) 2024-09-18T05:14:05.916 INFO:teuthology.orchestra.run.smithi017.stdout:1125 write 0xca43fa1 thru 0xca52cfd (0xed5d bytes) 2024-09-18T05:14:05.940 INFO:teuthology.orchestra.run.smithi017.stdout:1126 write 0xd827c20 thru 0xd82f7fe (0x7bdf bytes) 2024-09-18T05:14:05.941 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:05.934+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:05.946 INFO:teuthology.orchestra.run.smithi017.stdout:1128 write 0x87eb2dc thru 0x87f8d80 (0xdaa5 bytes) 2024-09-18T05:14:05.954 INFO:teuthology.orchestra.run.smithi017.stdout:1129 write 0x49c7e6b thru 0x49d0db2 (0x8f48 bytes) 2024-09-18T05:14:05.962 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:05.962 INFO:teuthology.orchestra.run.smithi017.stdout:1131 punch from 0x7fd55c0 to 0x7fd6860, (0x12a0 bytes) 2024-09-18T05:14:05.962 INFO:teuthology.orchestra.run.smithi017.stdout:1132 write 0xa502a0a thru 0xa508dda (0x63d1 bytes) 2024-09-18T05:14:05.968 INFO:teuthology.orchestra.run.smithi017.stdout:1133 read 0x7c8880c thru 0x7c8b094 (0x2889 bytes) 2024-09-18T05:14:05.968 INFO:teuthology.orchestra.run.smithi017.stdout:1134 writesame 0x3eb8cb3 thru 0x3ec71e4 data_size 0x4d(0xe532 bytes) 2024-09-18T05:14:05.971 INFO:teuthology.orchestra.run.smithi017.stdout:1135 read 0x9423bfa thru 0x9425754 (0x1b5b bytes) 2024-09-18T05:14:05.971 INFO:teuthology.orchestra.run.smithi017.stdout:1138 read 0xa8b3c8b thru 0xa8b4b41 (0xeb7 bytes) 2024-09-18T05:14:05.988 INFO:teuthology.orchestra.run.smithi017.stdout:1139 write 0xe45e78a thru 0xe46845c (0x9cd3 bytes) 2024-09-18T05:14:05.994 INFO:teuthology.orchestra.run.smithi017.stdout:1140 clone 9 order 18 su 16384 sc 14 2024-09-18T05:14:06.015 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17095 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247012+0000", 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7659927680000003, 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026804163999999998, 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.016 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17095 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247012+0000", 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247012+0000", 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247011+0000", 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247016+0000", 2024-09-18T05:14:06.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9860000000000002e-06 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247039+0000", 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2484999999999999e-05 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247065+0000", 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6074000000000001e-05 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273624+0000", 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026558509000000001 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273713+0000", 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9207000000000002e-05 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273817+0000", 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010378300000000001 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.020 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17096 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247077+0000", 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7659282940000001, 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026966496999999999, 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.021 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17096 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247077+0000", 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247077+0000", 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247076+0000", 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247084+0000", 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9859999999999994e-06 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247100+0000", 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5917e-05 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247115+0000", 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5480000000000001e-05 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273848+0000", 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026732318000000001 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273938+0000", 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0600999999999995e-05 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274043+0000", 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010507 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17097 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247126+0000", 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7658786319999997, 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027162054000000001, 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.026 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17097 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247126+0000", 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247126+0000", 2024-09-18T05:14:06.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247125+0000", 2024-09-18T05:14:06.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247131+0000", 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3920000000000002e-06 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247161+0000", 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0508e-05 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247174+0000", 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2734e-05 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274093+0000", 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026919307 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274185+0000", 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1525000000000002e-05 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274289+0000", 2024-09-18T05:14:06.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010368499999999999 2024-09-18T05:14:06.031 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.031 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.031 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.032 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17098 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.032 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247185+0000", 2024-09-18T05:14:06.032 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7658199520000002, 2024-09-18T05:14:06.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027333804999999999, 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17098 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247185+0000", 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247185+0000", 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247184+0000", 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247190+0000", 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5570000000000003e-06 2024-09-18T05:14:06.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247206+0000", 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.632e-05 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247218+0000", 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1848000000000001e-05 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274339+0000", 2024-09-18T05:14:06.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027121301 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274425+0000", 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5570999999999998e-05 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274519+0000", 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4245000000000003e-05 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.037 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17139 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.037 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:06.037 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7654366269999997, 2024-09-18T05:14:06.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027184, 2024-09-18T05:14:06.037 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.037 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17139 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:06.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247571+0000", 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1200000000000002e-06 2024-09-18T05:14:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247580+0000", 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7190000000000007e-06 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247586+0000", 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1689999999999997e-06 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274556+0000", 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026969961000000001 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274654+0000", 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8418999999999994e-05 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274752+0000", 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8173999999999999e-05 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17140 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247592+0000", 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7654135210000002, 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027313189000000002, 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17140 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247592+0000", 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247592+0000", 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247591+0000", 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:06.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247594+0000", 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0139999999999999e-06 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247603+0000", 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6049999999999998e-06 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247609+0000", 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0630000000000002e-06 2024-09-18T05:14:06.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274793+0000", 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027184090000000001 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274845+0000", 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1721999999999997e-05 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274905+0000", 2024-09-18T05:14:06.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0266000000000002e-05 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17141 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7653909780000001, 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027536620000000001, 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.046 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17141 2024-09-18T05:14:06.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.047 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:06.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247616+0000", 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.88e-06 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247625+0000", 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5920000000000001e-06 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247631+0000", 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9540000000000001e-06 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274940+0000", 2024-09-18T05:14:06.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027308534999999998 2024-09-18T05:14:06.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275011+0000", 2024-09-18T05:14:06.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1077999999999999e-05 2024-09-18T05:14:06.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275151+0000", 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014013299999999999 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17142 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.765368713, 2024-09-18T05:14:06.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027675153000000001, 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17142 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247639+0000", 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9739999999999998e-06 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247648+0000", 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8519999999999993e-06 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247654+0000", 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9540000000000001e-06 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275168+0000", 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027514732 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275229+0000", 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0924000000000001e-05 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275312+0000", 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2293999999999995e-05 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.055 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17143 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7653459299999996, 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027847998999999998, 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17143 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:06.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247661+0000", 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8169999999999999e-06 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247672+0000", 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0909e-05 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247679+0000", 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1680000000000001e-06 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275351+0000", 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027672703999999999 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275426+0000", 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4963999999999996e-05 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275507+0000", 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1006000000000003e-05 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17144 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247684+0000", 2024-09-18T05:14:06.060 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7653212329999999, 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028012624999999999, 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17144 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247684+0000", 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247684+0000", 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247683+0000", 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247686+0000", 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247695+0000", 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4540000000000007e-06 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247704+0000", 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0259999999999996e-06 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275550+0000", 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027846063000000001 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275617+0000", 2024-09-18T05:14:06.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7797000000000002e-05 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275697+0000", 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9104999999999996e-05 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.065 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17145 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247709+0000", 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7652960819999999, 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028149608, 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17145 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247709+0000", 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247709+0000", 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247708+0000", 2024-09-18T05:14:06.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247711+0000", 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8600000000000001e-06 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247722+0000", 2024-09-18T05:14:06.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0237e-05 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247735+0000", 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3766e-05 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275733+0000", 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027997226 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275788+0000", 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5896000000000002e-05 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275859+0000", 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0220000000000002e-05 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17146 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247743+0000", 2024-09-18T05:14:06.070 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7652620849999998, 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028277204, 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17146 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247743+0000", 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247743+0000", 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247742+0000", 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247746+0000", 2024-09-18T05:14:06.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2480000000000001e-06 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247754+0000", 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9120000000000004e-06 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247763+0000", 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9679999999999995e-06 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275894+0000", 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028131008999999998 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275950+0000", 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5822000000000002e-05 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276020+0000", 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9999000000000005e-05 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17155 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247769+0000", 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7652362620000002, 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028435576000000001, 2024-09-18T05:14:06.075 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17155 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247769+0000", 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247769+0000", 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247768+0000", 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247777+0000", 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6819999999999992e-06 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247787+0000", 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.004e-05 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247798+0000", 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1060000000000001e-05 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276054+0000", 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028256165999999999 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276124+0000", 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9923000000000001e-05 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276204+0000", 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0265000000000005e-05 2024-09-18T05:14:06.079 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17156 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247810+0000", 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7651946860000001, 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028629623, 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.080 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17156 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247810+0000", 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247810+0000", 2024-09-18T05:14:06.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247809+0000", 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247830+0000", 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0060000000000001e-05 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247846+0000", 2024-09-18T05:14:06.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6191000000000001e-05 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247863+0000", 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7649e-05 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276253+0000", 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028390049000000001 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276339+0000", 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5741999999999993e-05 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276440+0000", 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010090300000000001 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17157 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7651296800000003, 2024-09-18T05:14:06.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028768309999999998, 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17157 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247880+0000", 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2630000000000003e-06 2024-09-18T05:14:06.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247897+0000", 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7465e-05 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247912+0000", 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4983e-05 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276487+0000", 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028574835 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276555+0000", 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7849999999999996e-05 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276644+0000", 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8702999999999994e-05 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.089 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17158 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.089 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:06.089 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7650826840000002, 2024-09-18T05:14:06.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028929555999999999, 2024-09-18T05:14:06.089 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.089 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.089 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17158 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:06.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247927+0000", 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247942+0000", 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5591999999999999e-05 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247954+0000", 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1839e-05 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276665+0000", 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028710497000000001 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276750+0000", 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4789000000000004e-05 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276852+0000", 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102456 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17159 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.093 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247964+0000", 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7650410299999999, 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029089349, 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17159 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247964+0000", 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247964+0000", 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247963+0000", 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247969+0000", 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.502e-06 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247985+0000", 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6303e-05 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247999+0000", 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4011e-05 2024-09-18T05:14:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276894+0000", 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028894676000000001 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276973+0000", 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9246999999999995e-05 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277053+0000", 2024-09-18T05:14:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0535000000000001e-05 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17160 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.248010+0000", 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7649951240000004, 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029267069999999999, 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17160 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248010+0000", 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248010+0000", 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248009+0000", 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248014+0000", 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.169e-06 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248030+0000", 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5481999999999998e-05 2024-09-18T05:14:06.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248041+0000", 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1592e-05 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277098+0000", 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029056826000000001 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277182+0000", 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4457999999999997e-05 2024-09-18T05:14:06.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277277+0000", 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4572000000000002e-05 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17161 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.248052+0000", 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7649534789999999, 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029413175999999999, 2024-09-18T05:14:06.102 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17161 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248052+0000", 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248052+0000", 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248051+0000", 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248056+0000", 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1830000000000002e-06 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248086+0000", 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0620000000000002e-05 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248099+0000", 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2434e-05 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277318+0000", 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029218896000000001 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277385+0000", 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6926000000000003e-05 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277465+0000", 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0154000000000005e-05 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17162 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.106 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.248123+0000", 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7648817680000004, 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029517900999999999, 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17162 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248123+0000", 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248123+0000", 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248122+0000", 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248129+0000", 2024-09-18T05:14:06.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2199999999999997e-06 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248148+0000", 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9660000000000002e-05 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248171+0000", 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2388e-05 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277490+0000", 2024-09-18T05:14:06.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029319633000000001 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277572+0000", 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1160000000000002e-05 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277641+0000", 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9740000000000007e-05 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:06.110 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:06.111 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:06.112 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:14:06.113 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:06.111+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:06.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:06.213 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:06.211+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:06.293 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:06.293 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:06.293 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:06.294 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:06.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:06.314 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:06.311+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:06.383 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-18T05:14:06.415 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:06.415+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:06.434 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:06.434 INFO:teuthology.orchestra.run.smithi017.stdout:1143 write 0xd135c53 thru 0xd136685 (0xa33 bytes) 2024-09-18T05:14:06.445 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:06.445 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:06.445 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:06.445 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:06.445 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:06.451 INFO:teuthology.orchestra.run.smithi017.stdout:1144 writesame 0x96efaae thru 0x96f3ae8 data_size 0x51(0x403b bytes) 2024-09-18T05:14:06.460 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:06.463 INFO:teuthology.orchestra.run.smithi017.stdout:1146 trunc from 0xe46845d to 0xdb20d95 2024-09-18T05:14:06.516 INFO:teuthology.orchestra.run.smithi017.stdout:1147 write 0x2402cc7 thru 0x240f852 (0xcb8c bytes) 2024-09-18T05:14:06.516 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:06.510+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:06.534 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:06.534 INFO:teuthology.orchestra.run.smithi017.stdout:1153 write 0x2906989 thru 0x2908041 (0x16b9 bytes) 2024-09-18T05:14:06.544 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:06.544 INFO:teuthology.orchestra.run.smithi017.stdout:1156 writesame 0x28067db thru 0x2808c1a data_size 0x28(0x2440 bytes) 2024-09-18T05:14:06.570 INFO:teuthology.orchestra.run.smithi017.stdout:1157 trunc from 0xdb20d95 to 0x4b072ee 2024-09-18T05:14:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16825 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1474560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3810092489999999, 2024-09-18T05:14:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026210823000000001, 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16825 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219596+0000", 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219602+0000", 2024-09-18T05:14:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999999e-06 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219620+0000", 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7920000000000001e-05 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219633+0000", 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3113e-05 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245513+0000", 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025879669000000001 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245662+0000", 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149009 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245807+0000", 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145589 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16826 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.380959893, 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026570620999999999, 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16826 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219645+0000", 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219652+0000", 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4570000000000002e-06 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219670+0000", 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8295999999999999e-05 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219704+0000", 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4536000000000003e-05 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245864+0000", 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026159953 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246030+0000", 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016550899999999999 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246217+0000", 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018675300000000001 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16885 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2752512~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3792111599999997, 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026057257, 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16885 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221394+0000", 2024-09-18T05:14:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221400+0000", 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.533e-06 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221418+0000", 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8029999999999998e-05 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221432+0000", 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3453e-05 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247088+0000", 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025655971999999999 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247255+0000", 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167066 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247452+0000", 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019720600000000001 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16886 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.619 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3791623800000004, 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026360268999999999, 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16886 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221442+0000", 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221455+0000", 2024-09-18T05:14:06.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2116000000000001e-05 2024-09-18T05:14:06.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221472+0000", 2024-09-18T05:14:06.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.787e-05 2024-09-18T05:14:06.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221486+0000", 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3573e-05 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247512+0000", 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026025942999999999 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247647+0000", 2024-09-18T05:14:06.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000134859 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247804+0000", 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015688099999999999 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16887 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:06.624 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3791076210000002, 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026704731999999998, 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16887 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:06.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221497+0000", 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221503+0000", 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2700000000000001e-06 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221522+0000", 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221535+0000", 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3556e-05 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247862+0000", 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026326385000000001 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248014+0000", 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152168 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248203+0000", 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000189276 2024-09-18T05:14:06.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16888 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3790575939999998, 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027263773000000002, 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16888 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221547+0000", 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221554+0000", 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1430000000000001e-06 2024-09-18T05:14:06.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221572+0000", 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7609999999999999e-05 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221585+0000", 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2639999999999999e-05 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248308+0000", 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026723558000000001 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248546+0000", 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000237741 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248812+0000", 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026612100000000002 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16889 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3790092840000003, 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027689516000000001, 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16889 2024-09-18T05:14:06.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221595+0000", 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221602+0000", 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0169999999999999e-06 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221621+0000", 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8386e-05 2024-09-18T05:14:06.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221634+0000", 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.341e-05 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248882+0000", 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027247771 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249066+0000", 2024-09-18T05:14:06.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018403000000000001 2024-09-18T05:14:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249286+0000", 2024-09-18T05:14:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219986 2024-09-18T05:14:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16890 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3789602389999995, 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028101418999999999, 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16890 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.639 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221645+0000", 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221650+0000", 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7939999999999999e-06 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221667+0000", 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6616000000000002e-05 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221680+0000", 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2663999999999999e-05 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249351+0000", 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027670808000000002 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249539+0000", 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000188505 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249747+0000", 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020795199999999999 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16947 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2654208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3777815479999997, 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027363044999999999, 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16947 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222822+0000", 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222856+0000", 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316999999999997e-05 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222891+0000", 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4273000000000002e-05 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222914+0000", 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3119e-05 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249808+0000", 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026894668 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249979+0000", 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017036699999999999 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250187+0000", 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020850400000000001 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16948 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3776718020000001, 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027712835000000002, 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16948 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222933+0000", 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222941+0000", 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2330000000000006e-06 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222961+0000", 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9933999999999999e-05 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222976+0000", 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5486e-05 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250249+0000", 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027272951 2024-09-18T05:14:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250424+0000", 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017490999999999999 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250647+0000", 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000222761 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16949 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3776165689999997, 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028222578000000002, 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16949 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222988+0000", 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222995+0000", 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7059999999999998e-06 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223013+0000", 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8267e-05 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223027+0000", 2024-09-18T05:14:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3852999999999999e-05 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250733+0000", 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027705456 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250935+0000", 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020255800000000001 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251212+0000", 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027678400000000003 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16950 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3775662290000001, 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028659265999999999, 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16950 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223039+0000", 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223045+0000", 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1500000000000004e-06 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223062+0000", 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223076+0000", 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3495999999999999e-05 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251277+0000", 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028201066 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251460+0000", 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018261199999999999 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251699+0000", 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000239359 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16951 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.377517836, 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029073671999999998, 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16951 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223087+0000", 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223093+0000", 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.003e-06 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223110+0000", 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7024000000000002e-05 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223124+0000", 2024-09-18T05:14:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3682999999999999e-05 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251760+0000", 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028636582000000001 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251957+0000", 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019702399999999999 2024-09-18T05:14:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252162+0000", 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020431299999999999 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16952 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3774681529999997, 2024-09-18T05:14:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029652123999999998, 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16952 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223136+0000", 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223143+0000", 2024-09-18T05:14:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9600000000000003e-06 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223160+0000", 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.721e-05 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223173+0000", 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2486e-05 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252238+0000", 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029065160999999999 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252459+0000", 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022082100000000001 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252790+0000", 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033094299999999999 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16953 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3774220899999996, 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030055742999999999, 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16953 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223183+0000", 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223188+0000", 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223205+0000", 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6359999999999999e-05 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223217+0000", 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2296000000000001e-05 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252853+0000", 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029636077 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253035+0000", 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018143900000000001 2024-09-18T05:14:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253239+0000", 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000204878 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16954 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3773789140000003, 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030518435, 2024-09-18T05:14:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16954 2024-09-18T05:14:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223226+0000", 2024-09-18T05:14:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223231+0000", 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9529999999999998e-06 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223249+0000", 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7754e-05 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223261+0000", 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.198e-05 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253312+0000", 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030051123999999999 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253507+0000", 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019456700000000001 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253745+0000", 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023878699999999999 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17135 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3709288270000002, 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026407401, 2024-09-18T05:14:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17135 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229676+0000", 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229683+0000", 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0400000000000004e-06 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229701+0000", 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8182999999999999e-05 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229714+0000", 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3193000000000001e-05 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255689+0000", 2024-09-18T05:14:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025974962000000001 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255873+0000", 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018339300000000001 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256084+0000", 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021176999999999999 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17136 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3708805310000001, 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026860747000000001, 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17136 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229724+0000", 2024-09-18T05:14:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229730+0000", 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6629999999999998e-06 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229746+0000", 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6293000000000001e-05 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229759+0000", 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2747e-05 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256148+0000", 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026389072999999999 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256345+0000", 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019683799999999999 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256586+0000", 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024106999999999999 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17137 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3708360620000004, 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027322796999999999, 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17137 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229769+0000", 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229775+0000", 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6169999999999998e-06 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229791+0000", 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6126000000000001e-05 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229804+0000", 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2917e-05 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256654+0000", 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026850816 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256857+0000", 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020282399999999999 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257093+0000", 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023535 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17138 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3707902179999998, 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027760476999999999, 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17138 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229815+0000", 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229820+0000", 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7729999999999996e-06 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229838+0000", 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7113e-05 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229850+0000", 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2320000000000001e-05 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257154+0000", 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027304357000000001 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257348+0000", 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000193322 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257576+0000", 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000228569 2024-09-18T05:14:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:06.698 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:06.699 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:06.700 INFO:teuthology.orchestra.run.smithi017.stdout:1158 write 0xcf6e578 thru 0xcf7d58c (0xf015 bytes) 2024-09-18T05:14:06.700 INFO:teuthology.orchestra.run.smithi017.stdout:1159 read 0x8e84963 thru 0x8e8735c (0x29fa bytes) 2024-09-18T05:14:06.700 INFO:teuthology.orchestra.run.smithi017.stdout:1160 write 0x3def40d thru 0x3df9c04 (0xa7f8 bytes) 2024-09-18T05:14:06.700 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:06.694+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:06.706 INFO:teuthology.orchestra.run.smithi017.stdout:1161 write 0xeb4ee6a thru 0xeb54ac2 (0x5c59 bytes) 2024-09-18T05:14:06.717 INFO:teuthology.orchestra.run.smithi017.stdout:1162 read 0xce32ae4 thru 0xce41f29 (0xf446 bytes) 2024-09-18T05:14:06.738 INFO:teuthology.orchestra.run.smithi017.stdout:1163 trunc from 0xeb54ac3 to 0x6d1f62b 2024-09-18T05:14:06.762 INFO:teuthology.orchestra.run.smithi017.stdout:1164 read 0x12d1543 thru 0x12d27f2 (0x12b0 bytes) 2024-09-18T05:14:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:1165 punch from 0x5d4330a to 0x5d51ce0, (0xe9d6 bytes) 2024-09-18T05:14:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:1166 punch from 0x25842cf to 0x258dfd0, (0x9d01 bytes) 2024-09-18T05:14:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:1167 punch from 0x1b71e0e to 0x1b80351, (0xe543 bytes) 2024-09-18T05:14:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:1168 read 0x5d8c26 thru 0x5e4779 (0xbb54 bytes) 2024-09-18T05:14:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:1170 read 0x190693c thru 0x1911125 (0xa7ea bytes) 2024-09-18T05:14:06.786 INFO:teuthology.orchestra.run.smithi017.stdout:1171 write 0x97fb6d4 thru 0x980387f (0x81ac bytes) 2024-09-18T05:14:06.797 INFO:teuthology.orchestra.run.smithi017.stdout:1173 read 0x12c7354 thru 0x12d2d98 (0xba45 bytes) 2024-09-18T05:14:06.800 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:06.799+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:06.810 INFO:teuthology.orchestra.run.smithi017.stdout:1174 trunc from 0x9803880 to 0x4ac898c 2024-09-18T05:14:06.840 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:06.840 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:06.840 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:06.840 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:06.841 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:06.862 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:1176 write 0xcc116bd thru 0xcc1c046 (0xa98a bytes) 2024-09-18T05:14:06.888 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:06.888 INFO:teuthology.orchestra.run.smithi017.stdout:1178 writesame 0x50cfedf thru 0x50d0784 data_size 0x1(0x8a6 bytes) 2024-09-18T05:14:06.897 INFO:teuthology.orchestra.run.smithi017.stdout:1179 write 0x10ad26e thru 0x10ae685 (0x1418 bytes) 2024-09-18T05:14:06.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:06.894+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:06.910 INFO:teuthology.orchestra.run.smithi017.stdout:1180 trunc from 0xcc1c047 to 0xe300399 2024-09-18T05:14:06.921 INFO:teuthology.orchestra.run.smithi017.stdout:1181 read 0xcae3139 thru 0xcae6b48 (0x3a10 bytes) 2024-09-18T05:14:06.922 INFO:teuthology.orchestra.run.smithi017.stdout:1183 write 0x1380a9d thru 0x138f2ec (0xe850 bytes) 2024-09-18T05:14:06.941 INFO:teuthology.orchestra.run.smithi017.stdout:1184 writesame 0x6577a2a thru 0x6586983 data_size 0x1(0xef5a bytes) 2024-09-18T05:14:06.976 INFO:teuthology.orchestra.run.smithi017.stdout:1185 write 0x2375295 thru 0x237ed1c (0x9a88 bytes) 2024-09-18T05:14:06.990 INFO:teuthology.orchestra.run.smithi017.stdout:1186 read 0x5aa04ff thru 0x5aa6f2b (0x6a2d bytes) 2024-09-18T05:14:06.990 INFO:teuthology.orchestra.run.smithi017.stdout:1187 read 0x71717f7 thru 0x717a142 (0x894c bytes) 2024-09-18T05:14:06.990 INFO:teuthology.orchestra.run.smithi017.stdout:1188 punch from 0xad4cd0d to 0xad57ee3, (0xb1d6 bytes) 2024-09-18T05:14:07.002 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:07.003+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:07.013 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:07.013 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:07.013 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:07.013 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:07.013 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:07.015 INFO:teuthology.orchestra.run.smithi017.stdout:1189 trunc from 0xe300399 to 0x2ae8496 2024-09-18T05:14:07.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:07.104 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:07.103+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:07.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:07.486 INFO:teuthology.orchestra.run.smithi017.stdout:1190 write 0x87f73e6 thru 0x8801ce0 (0xa8fb bytes) 2024-09-18T05:14:07.486 INFO:teuthology.orchestra.run.smithi017.stdout:1192 trunc from 0x8801ce1 to 0x1bb41bb 2024-09-18T05:14:07.486 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:07.486 INFO:teuthology.orchestra.run.smithi017.stdout:1194 trunc from 0x1bb41bb to 0x626292a 2024-09-18T05:14:07.487 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:07.487 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:07.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9866653650000003, 2024-09-18T05:14:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.986597755, 2024-09-18T05:14:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:07.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.506 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.507 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.507 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:07.507 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9865503689999997, 2024-09-18T05:14:07.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:07.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:07.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:07.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:07.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9865049629999998, 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9864596729999997, 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9848251220000002, 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9847728030000003, 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.98465516, 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9845932409999998, 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9845348210000004, 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9844811949999999, 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9844341319999996, 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9843740529999998, 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9843137659999996, 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9842464499999997, 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9841978469999999, 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9841242279999998, 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9840507450000002, 2024-09-18T05:14:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9839941549999995, 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.9839480229999999, 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:07.599 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:07.599 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:07.600 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:07.602 INFO:teuthology.orchestra.run.smithi017.stdout:1196 trunc from 0x626292a to 0xac8758c 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1199 trunc from 0xac8758c to 0x290ceff 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1200 write 0xbc06743 thru 0xbc12840 (0xc0fe bytes) 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1203 write 0x447fb94 thru 0x44862b1 (0x671e bytes) 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1204 write 0x960e267 thru 0x96159fc (0x7796 bytes) 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1205 read 0x17772a3 thru 0x177aa21 (0x377f bytes) 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1207 punch from 0x7cf891b to 0x7d03dea, (0xb4cf bytes) 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1209 read 0x104630f thru 0x1046a9e (0x790 bytes) 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1210 trunc from 0xbc12841 to 0xebda09b 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1211 writesame 0xe2772c5 thru 0xe281df1 data_size 0x1b(0xab2d bytes) 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1213 trunc from 0xebda09b to 0xcc59b20 2024-09-18T05:14:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:1215 write 0xc448e0a thru 0xc45431d (0xb514 bytes) 2024-09-18T05:14:07.604 INFO:teuthology.orchestra.run.smithi017.stdout:1216 trunc from 0xcc59b20 to 0x25c63ba 2024-09-18T05:14:07.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:07.478+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:07.605 INFO:teuthology.orchestra.run.smithi017.stdout:1217 read 0x1812f9c thru 0x181bff9 (0x905e bytes) 2024-09-18T05:14:07.605 INFO:teuthology.orchestra.run.smithi017.stdout:1218 write 0x8657b94 thru 0x865c842 (0x4caf bytes) 2024-09-18T05:14:07.605 INFO:teuthology.orchestra.run.smithi017.stdout:1219 read 0x1894a7a thru 0x1895e7b (0x1402 bytes) 2024-09-18T05:14:07.605 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:07.605 INFO:teuthology.orchestra.run.smithi017.stdout:1222 write 0xe447dfc thru 0xe447f6f (0x174 bytes) 2024-09-18T05:14:07.605 INFO:teuthology.orchestra.run.smithi017.stdout:1223 write 0x6bb303c thru 0x6bbfc1c (0xcbe1 bytes) 2024-09-18T05:14:07.605 INFO:teuthology.orchestra.run.smithi017.stdout:1224 trunc from 0xe447f70 to 0xccc17f0 2024-09-18T05:14:07.620 INFO:teuthology.orchestra.run.smithi017.stdout:1226 writesame 0x73fe5a3 thru 0x740c48b data_size 0x65(0xdee9 bytes) 2024-09-18T05:14:07.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:07.614+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:07.640 INFO:teuthology.orchestra.run.smithi017.stdout:1227 punch from 0x7bb485c to 0x7bb58c5, (0x1069 bytes) 2024-09-18T05:14:07.640 INFO:teuthology.orchestra.run.smithi017.stdout:1228 write 0xa4f9e53 thru 0xa502e6c (0x901a bytes) 2024-09-18T05:14:07.653 INFO:teuthology.orchestra.run.smithi017.stdout:1230 read 0x80979c3 thru 0x80a7708 (0xfd46 bytes) 2024-09-18T05:14:07.653 INFO:teuthology.orchestra.run.smithi017.stdout:1231 read 0x91111de thru 0x9114dff (0x3c22 bytes) 2024-09-18T05:14:07.653 INFO:teuthology.orchestra.run.smithi017.stdout:1232 punch from 0x1c0b7b8 to 0x1c11b3e, (0x6386 bytes) 2024-09-18T05:14:07.656 INFO:teuthology.orchestra.run.smithi017.stdout:1233 trunc from 0xccc17f0 to 0xe3a987a 2024-09-18T05:14:07.667 INFO:teuthology.orchestra.run.smithi017.stdout:1234 write 0xab2b087 thru 0xab2c3f5 (0x136f bytes) 2024-09-18T05:14:07.676 INFO:teuthology.orchestra.run.smithi017.stdout:1235 read 0x351e982 thru 0x352a954 (0xbfd3 bytes) 2024-09-18T05:14:07.677 INFO:teuthology.orchestra.run.smithi017.stdout:1240 writesame 0x53cecfa thru 0x53d1556 data_size 0x1(0x285d bytes) 2024-09-18T05:14:07.689 INFO:teuthology.orchestra.run.smithi017.stdout:1241 trunc from 0xe3a987a to 0xe42b0f5 2024-09-18T05:14:07.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:07.698+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:07.707 INFO:teuthology.orchestra.run.smithi017.stdout:1244 trunc from 0xe42b0f5 to 0x96dfafe 2024-09-18T05:14:07.742 INFO:teuthology.orchestra.run.smithi017.stdout:1245 write 0xac9ee40 thru 0xacae4bd (0xf67e bytes) 2024-09-18T05:14:07.759 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:07.759 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:07.760 INFO:teuthology.orchestra.run.smithi017.stdout:1246 punch from 0x882a15e to 0x882db83, (0x3a25 bytes) 2024-09-18T05:14:07.760 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:07.760 INFO:teuthology.orchestra.run.smithi017.stdout:1249 clone 10 order 22 su 131072 sc 12 2024-09-18T05:14:07.772 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:07.773 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:07.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:07.793 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:07.804 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:07.803+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:07.805 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:07.805 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:07.821 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:07.821 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:07.841 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:07.842 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:07.862 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:07.883 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:07.903 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:07.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:07.898+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:07.909 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:07.909 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:07.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:08.015 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:08.010+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:08.092 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:08.092 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:08.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:08.108 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:08.102+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:08.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:14:08.175 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone9 from 0xacae4be (overlap 0x1bb41bb) to 0x58a6bf 2024-09-18T05:14:08.219 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:08.214+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:08.277 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:08.278 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:08.297 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:08.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:08.338+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:08.411 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:08.407+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:08.508 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:08.508 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:08.511 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:08.511+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:08.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:08.608 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-18T05:14:08.613 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:08.606+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:08.648 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:08.649 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:08.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:08.714 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:08.706+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:08.797 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:08.797 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:08.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:08.815 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:08.810+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:08.916 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:08.915+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:08.932 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:08.932 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:08.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:09.028 INFO:teuthology.orchestra.run.smithi017.stdout:1251 punch from 0x2a58162 to 0x2a64b9b, (0xca39 bytes) 2024-09-18T05:14:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:1252 read 0x83b52ed thru 0x83bd4b3 (0x81c7 bytes) 2024-09-18T05:14:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:1253 read 0x45bc078 thru 0x45bfc0b (0x3b94 bytes) 2024-09-18T05:14:09.034 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:09.035+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:09.047 INFO:teuthology.orchestra.run.smithi017.stdout:1254 writesame 0xcd47d07 thru 0xcd5390f data_size 0x1(0xbc09 bytes) 2024-09-18T05:14:09.047 INFO:teuthology.orchestra.run.smithi017.stdout:1255 read 0x1863705 thru 0x18709ed (0xd2e9 bytes) 2024-09-18T05:14:09.049 INFO:teuthology.orchestra.run.smithi017.stdout:1260 read 0x44a3ff3 thru 0x44b1ef4 (0xdf02 bytes) 2024-09-18T05:14:09.049 INFO:teuthology.orchestra.run.smithi017.stdout:1261 read 0x9a1dedf thru 0x9a21c7a (0x3d9c bytes) 2024-09-18T05:14:09.049 INFO:teuthology.orchestra.run.smithi017.stdout:1262 write 0xa0bf526 thru 0xa0caa8c (0xb567 bytes) 2024-09-18T05:14:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:14:09.063 INFO:teuthology.orchestra.run.smithi017.stdout:1263 write 0xb25f182 thru 0xb26721d (0x809c bytes) 2024-09-18T05:14:09.074 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:09.074 INFO:teuthology.orchestra.run.smithi017.stdout:1265 read 0x26a2b9e thru 0x26b0863 (0xdcc6 bytes) 2024-09-18T05:14:09.074 INFO:teuthology.orchestra.run.smithi017.stdout:1266 read 0xc4a5012 thru 0xc4b3a76 (0xea65 bytes) 2024-09-18T05:14:09.074 INFO:teuthology.orchestra.run.smithi017.stdout:1267 write 0x4a40a0e thru 0x4a423c6 (0x19b9 bytes) 2024-09-18T05:14:09.090 INFO:teuthology.orchestra.run.smithi017.stdout:1268 trunc from 0xcd53910 to 0x66501f8 2024-09-18T05:14:09.117 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:09.110+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:09.123 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:09.123 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:09.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:09.148 INFO:teuthology.orchestra.run.smithi017.stdout:1269 trunc from 0x66501f8 to 0xcce4d16 2024-09-18T05:14:09.158 INFO:teuthology.orchestra.run.smithi017.stdout:1270 write 0xcba7bc4 thru 0xcba89b7 (0xdf4 bytes) 2024-09-18T05:14:09.183 INFO:teuthology.orchestra.run.smithi017.stdout:1273 trunc from 0xcce4d16 to 0x2335ac0 2024-09-18T05:14:09.232 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:09.227+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:09.298 INFO:teuthology.orchestra.run.smithi017.stdout:1274 read 0x3fc522 thru 0x40a621 (0xe100 bytes) 2024-09-18T05:14:09.299 INFO:teuthology.orchestra.run.smithi017.stdout:1275 read 0x9d1b5b thru 0x9d4162 (0x2608 bytes) 2024-09-18T05:14:09.315 INFO:teuthology.orchestra.run.smithi017.stdout:1276 write 0x89843ba thru 0x898a2eb (0x5f32 bytes) 2024-09-18T05:14:09.319 INFO:teuthology.orchestra.run.smithi017.stdout:1277 read 0x46362fb thru 0x4641806 (0xb50c bytes) 2024-09-18T05:14:09.320 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:09.319+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:09.336 INFO:teuthology.orchestra.run.smithi017.stdout:1278 write 0xdf90c16 thru 0xdf932a1 (0x268c bytes) 2024-09-18T05:14:09.338 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:09.338 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:09.339 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:09.342 INFO:teuthology.orchestra.run.smithi017.stdout:1280 trunc from 0xdf932a2 to 0xbeaa4c9 2024-09-18T05:14:09.352 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:09.357 INFO:teuthology.orchestra.run.smithi017.stdout:1284 writesame 0x38b50f8 thru 0x38b91f8 data_size 0x2b(0x4101 bytes) 2024-09-18T05:14:09.374 INFO:teuthology.orchestra.run.smithi017.stdout:1285 writesame 0xd030518 thru 0xd03219c data_size 0x7(0x1c85 bytes) 2024-09-18T05:14:09.374 INFO:teuthology.orchestra.run.smithi017.stdout:1287 punch from 0x6f3351a to 0x6f39705, (0x61eb bytes) 2024-09-18T05:14:09.374 INFO:teuthology.orchestra.run.smithi017.stdout:1288 read 0x178f659 thru 0x1793393 (0x3d3b bytes) 2024-09-18T05:14:09.384 INFO:teuthology.orchestra.run.smithi017.stdout:1289 trunc from 0xd03219d to 0x6f549db 2024-09-18T05:14:09.420 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:09.414+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:09.421 INFO:teuthology.orchestra.run.smithi017.stdout:1291 write 0xe5dd4e7 thru 0xe5ea7b8 (0xd2d2 bytes) 2024-09-18T05:14:09.428 INFO:teuthology.orchestra.run.smithi017.stdout:1292 clone 11 order 21 su 524288 sc 8 2024-09-18T05:14:09.516 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:09.517 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:09.521 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:09.519+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:09.530 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:09.622 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:09.614+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:09.694 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:09.694 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:09.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:09.723 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:09.718+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:09.824 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:09.818+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:09.825 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:09.825 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:09.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:14:09.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:09.924 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:09.923+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:09.958 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:09.958 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:09.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:14:10.058 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:10.059+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:10.087 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:10.105 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:10.105 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:10.122 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:10.126 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:10.118+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:10.136 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone10 from 0xe5ea7b9 (overlap 0x2335ac0) to 0x0 2024-09-18T05:14:10.139 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:10.140 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:10.149 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:10.149 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:10.163 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:10.163 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:10.165 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:10.182 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:10.182 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:10.205 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:10.205 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:10.224 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:10.225 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:10.232 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-18T05:14:10.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:10.226+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:10.255 INFO:teuthology.orchestra.run.smithi017.stdout:1293 read 0x12c24e3 thru 0x12cbed0 (0x99ee bytes) 2024-09-18T05:14:10.255 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.255 INFO:teuthology.orchestra.run.smithi017.stdout:1299 read 0x897d449 thru 0x8987116 (0x9cce bytes) 2024-09-18T05:14:10.255 INFO:teuthology.orchestra.run.smithi017.stdout:1301 writesame 0x2744c68 thru 0x2744d1b data_size 0x3(0xb4 bytes) 2024-09-18T05:14:10.260 INFO:teuthology.orchestra.run.smithi017.stdout:1302 write 0xa58762c thru 0xa5912a0 (0x9c75 bytes) 2024-09-18T05:14:10.266 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.266 INFO:teuthology.orchestra.run.smithi017.stdout:1304 punch from 0x4ae5896 to 0x4ae8059, (0x27c3 bytes) 2024-09-18T05:14:10.266 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.266 INFO:teuthology.orchestra.run.smithi017.stdout:1306 punch from 0x45cb9ff to 0x45cc5dc, (0xbdd bytes) 2024-09-18T05:14:10.266 INFO:teuthology.orchestra.run.smithi017.stdout:1307 read 0x4385292 thru 0x438fb1e (0xa88d bytes) 2024-09-18T05:14:10.266 INFO:teuthology.orchestra.run.smithi017.stdout:1310 punch from 0x23e9abe to 0x23eb026, (0x1568 bytes) 2024-09-18T05:14:10.266 INFO:teuthology.orchestra.run.smithi017.stdout:1311 write 0xa94f886 thru 0xa95c311 (0xca8c bytes) 2024-09-18T05:14:10.267 INFO:teuthology.orchestra.run.smithi017.stdout:1314 writesame 0x525870 thru 0x532aed data_size 0x15(0xd27e bytes) 2024-09-18T05:14:10.278 INFO:teuthology.orchestra.run.smithi017.stdout:1316 punch from 0xacfb08c to 0xad02c5a, (0x7bce bytes) 2024-09-18T05:14:10.278 INFO:teuthology.orchestra.run.smithi017.stdout:1318 read 0x5f24a0e thru 0x5f317bf (0xcdb2 bytes) 2024-09-18T05:14:10.278 INFO:teuthology.orchestra.run.smithi017.stdout:1319 write 0x16962b thru 0x17037f (0x6d55 bytes) 2024-09-18T05:14:10.280 INFO:teuthology.orchestra.run.smithi017.stdout:1320 write 0x8f156a3 thru 0x8f191ff (0x3b5d bytes) 2024-09-18T05:14:10.284 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.284 INFO:teuthology.orchestra.run.smithi017.stdout:1322 punch from 0xadfd791 to 0xae0a6d4, (0xcf43 bytes) 2024-09-18T05:14:10.284 INFO:teuthology.orchestra.run.smithi017.stdout:1326 read 0xd492ab3 thru 0xd493a2b (0xf79 bytes) 2024-09-18T05:14:10.299 INFO:teuthology.orchestra.run.smithi017.stdout:1327 trunc from 0xe5ea7b9 to 0x4f26263 2024-09-18T05:14:10.328 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:10.327+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:10.333 INFO:teuthology.orchestra.run.smithi017.stdout:1329 write 0x8105376 thru 0x81107a8 (0xb433 bytes) 2024-09-18T05:14:10.348 INFO:teuthology.orchestra.run.smithi017.stdout:1330 trunc from 0x81107a9 to 0xbd84404 2024-09-18T05:14:10.349 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:10.349 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:10.349 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:10.349 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:10.358 INFO:teuthology.orchestra.run.smithi017.stdout:1333 write 0x8f470b7 thru 0x8f4a60c (0x3556 bytes) 2024-09-18T05:14:10.363 INFO:teuthology.orchestra.run.smithi017.stdout:1334 read 0x3f077db thru 0x3f0ab0b (0x3331 bytes) 2024-09-18T05:14:10.364 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.364 INFO:teuthology.orchestra.run.smithi017.stdout:1336 read 0x78c93 thru 0x87995 (0xed03 bytes) 2024-09-18T05:14:10.365 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:10.365 INFO:teuthology.orchestra.run.smithi017.stdout:1337 write 0x13f8ebb thru 0x140363a (0xa780 bytes) 2024-09-18T05:14:10.378 INFO:teuthology.orchestra.run.smithi017.stdout:1338 read 0x2ba592a thru 0x2bb1a2e (0xc105 bytes) 2024-09-18T05:14:10.397 INFO:teuthology.orchestra.run.smithi017.stdout:1339 write 0xe62ab43 thru 0xe62b3ab (0x869 bytes) 2024-09-18T05:14:10.403 INFO:teuthology.orchestra.run.smithi017.stdout:1340 writesame 0xc404422 thru 0xc40e824 data_size 0xb(0xa403 bytes) 2024-09-18T05:14:10.416 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T05:14:10.416 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:14:10.417 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-18T05:14:10.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T05:14:10.439 INFO:teuthology.orchestra.run.smithi017.stdout:1342 trunc from 0xe62b3ac to 0x1667f79 2024-09-18T05:14:10.463 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:10.463+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:10.507 INFO:teuthology.orchestra.run.smithi017.stdout:1343 write 0xcfb643b thru 0xcfb9e10 (0x39d6 bytes) 2024-09-18T05:14:10.513 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.531 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:10.522+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:10.535 INFO:teuthology.orchestra.run.smithi017.stdout:1345 trunc from 0xcfb9e11 to 0xd758c8 2024-09-18T05:14:10.555 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:10.556 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:10.573 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:1346 write 0x806a729 thru 0x80763ec (0xbcc4 bytes) 2024-09-18T05:14:10.604 INFO:teuthology.orchestra.run.smithi017.stdout:1347 write 0x4c83de6 thru 0x4c8a5f8 (0x6813 bytes) 2024-09-18T05:14:10.625 INFO:teuthology.orchestra.run.smithi017.stdout:1348 write 0xbe3deb9 thru 0xbe46536 (0x867e bytes) 2024-09-18T05:14:10.629 INFO:teuthology.orchestra.run.smithi017.stdout:1349 write 0xb24d33c thru 0xb25b3f2 (0xe0b7 bytes) 2024-09-18T05:14:10.631 INFO:teuthology.orchestra.run.smithi017.stdout:1350 read 0x3d4cbe1 thru 0x3d59232 (0xc652 bytes) 2024-09-18T05:14:10.631 INFO:teuthology.orchestra.run.smithi017.stdout:1351 write 0x130a2a9 thru 0x1311b53 (0x78ab bytes) 2024-09-18T05:14:10.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:10.626+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:10.634 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.640 INFO:teuthology.orchestra.run.smithi017.stdout:1353 trunc from 0xbe46537 to 0x81b3926 2024-09-18T05:14:10.654 INFO:teuthology.orchestra.run.smithi017.stdout:1354 read 0x35cfaca thru 0x35d8f06 (0x943d bytes) 2024-09-18T05:14:10.654 INFO:teuthology.orchestra.run.smithi017.stdout:1355 punch from 0x4a845a4 to 0x4a936c8, (0xf124 bytes) 2024-09-18T05:14:10.654 INFO:teuthology.orchestra.run.smithi017.stdout:1357 punch from 0x2098d68 to 0x20a44d1, (0xb769 bytes) 2024-09-18T05:14:10.654 INFO:teuthology.orchestra.run.smithi017.stdout:1358 punch from 0x66c7c38 to 0x66d4d17, (0xd0df bytes) 2024-09-18T05:14:10.654 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.654 INFO:teuthology.orchestra.run.smithi017.stdout:1360 write 0x68b95f0 thru 0x68baf99 (0x19aa bytes) 2024-09-18T05:14:10.658 INFO:teuthology.orchestra.run.smithi017.stdout:1361 read 0x57962bb thru 0x579c78f (0x64d5 bytes) 2024-09-18T05:14:10.658 INFO:teuthology.orchestra.run.smithi017.stdout:1362 write 0x7c6f589 thru 0x7c766c8 (0x7140 bytes) 2024-09-18T05:14:10.678 INFO:teuthology.orchestra.run.smithi017.stdout:1365 write 0xded62d2 thru 0xdedb941 (0x5670 bytes) 2024-09-18T05:14:10.683 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.689 INFO:teuthology.orchestra.run.smithi017.stdout:1367 trunc from 0xdedb942 to 0x920d12a 2024-09-18T05:14:10.716 INFO:teuthology.orchestra.run.smithi017.stdout:1368 trunc from 0x920d12a to 0x1fad75b 2024-09-18T05:14:10.732 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:10.726+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:10.747 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:10.747 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:10.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:10.747 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17096 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247077+0000", 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4973488259999996, 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026966496999999999, 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17096 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.748 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247077+0000", 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247077+0000", 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247076+0000", 2024-09-18T05:14:10.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247084+0000", 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9859999999999994e-06 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247100+0000", 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5917e-05 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247115+0000", 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5480000000000001e-05 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273848+0000", 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026732318000000001 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.273938+0000", 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0600999999999995e-05 2024-09-18T05:14:10.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274043+0000", 2024-09-18T05:14:10.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010507 2024-09-18T05:14:10.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.752 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17097 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247126+0000", 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4972991639999993, 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027162054000000001, 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.753 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17097 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247126+0000", 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247126+0000", 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247125+0000", 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247131+0000", 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3920000000000002e-06 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247161+0000", 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0508e-05 2024-09-18T05:14:10.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247174+0000", 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2734e-05 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274093+0000", 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026919307 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274185+0000", 2024-09-18T05:14:10.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1525000000000002e-05 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274289+0000", 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010368499999999999 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17098 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247185+0000", 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4972404840000006, 2024-09-18T05:14:10.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027333804999999999, 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17098 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247185+0000", 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247185+0000", 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247184+0000", 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247190+0000", 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5570000000000003e-06 2024-09-18T05:14:10.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247206+0000", 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.632e-05 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247218+0000", 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1848000000000001e-05 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274339+0000", 2024-09-18T05:14:10.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027121301 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274425+0000", 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5570999999999998e-05 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274519+0000", 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4245000000000003e-05 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.762 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17139 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.762 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:10.762 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4968571589999993, 2024-09-18T05:14:10.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027184, 2024-09-18T05:14:10.762 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.762 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.762 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17139 2024-09-18T05:14:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247568+0000", 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247571+0000", 2024-09-18T05:14:10.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1200000000000002e-06 2024-09-18T05:14:10.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247580+0000", 2024-09-18T05:14:10.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7190000000000007e-06 2024-09-18T05:14:10.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247586+0000", 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1689999999999997e-06 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274556+0000", 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026969961000000001 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274654+0000", 2024-09-18T05:14:10.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8418999999999994e-05 2024-09-18T05:14:10.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274752+0000", 2024-09-18T05:14:10.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8173999999999999e-05 2024-09-18T05:14:10.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.769 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.770 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17140 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.770 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247592+0000", 2024-09-18T05:14:10.770 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4968340530000006, 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027313189000000002, 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17140 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247592+0000", 2024-09-18T05:14:10.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247592+0000", 2024-09-18T05:14:10.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247591+0000", 2024-09-18T05:14:10.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:10.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247594+0000", 2024-09-18T05:14:10.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0139999999999999e-06 2024-09-18T05:14:10.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247603+0000", 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6049999999999998e-06 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247609+0000", 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0630000000000002e-06 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274793+0000", 2024-09-18T05:14:10.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027184090000000001 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274845+0000", 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1721999999999997e-05 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274905+0000", 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0266000000000002e-05 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17141 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4968115100000006, 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027536620000000001, 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17141 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247614+0000", 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:10.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247616+0000", 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.88e-06 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247625+0000", 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5920000000000001e-06 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247631+0000", 2024-09-18T05:14:10.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9540000000000001e-06 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.274940+0000", 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027308534999999998 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275011+0000", 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1077999999999999e-05 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275151+0000", 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014013299999999999 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17142 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4967892450000004, 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027675153000000001, 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17142 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247636+0000", 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247639+0000", 2024-09-18T05:14:10.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9739999999999998e-06 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247648+0000", 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8519999999999993e-06 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247654+0000", 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9540000000000001e-06 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275168+0000", 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027514732 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275229+0000", 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0924000000000001e-05 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275312+0000", 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2293999999999995e-05 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.786 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17143 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4967664620000001, 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027847998999999998, 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17143 2024-09-18T05:14:10.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247659+0000", 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247661+0000", 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8169999999999999e-06 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247672+0000", 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0909e-05 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247679+0000", 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1680000000000001e-06 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275351+0000", 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027672703999999999 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275426+0000", 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4963999999999996e-05 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275507+0000", 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1006000000000003e-05 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17144 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247684+0000", 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4967417649999994, 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028012624999999999, 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.791 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17144 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247684+0000", 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247684+0000", 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247683+0000", 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247686+0000", 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247695+0000", 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4540000000000007e-06 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247704+0000", 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0259999999999996e-06 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275550+0000", 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027846063000000001 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275617+0000", 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7797000000000002e-05 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275697+0000", 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9104999999999996e-05 2024-09-18T05:14:10.795 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17145 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247709+0000", 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4967166140000003, 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028149608, 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.796 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17145 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247709+0000", 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247709+0000", 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247708+0000", 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247711+0000", 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8600000000000001e-06 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247722+0000", 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0237e-05 2024-09-18T05:14:10.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247735+0000", 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3766e-05 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275733+0000", 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027997226 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275788+0000", 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5896000000000002e-05 2024-09-18T05:14:10.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275859+0000", 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0220000000000002e-05 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17146 3.15 3:ac261637:::rbd_data.118bd6f23a9d.0000000000000003:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247743+0000", 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4966826169999994, 2024-09-18T05:14:10.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028277204, 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17146 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247743+0000", 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247743+0000", 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247742+0000", 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247746+0000", 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2480000000000001e-06 2024-09-18T05:14:10.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247754+0000", 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9120000000000004e-06 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247763+0000", 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9679999999999995e-06 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275894+0000", 2024-09-18T05:14:10.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028131008999999998 2024-09-18T05:14:10.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.275950+0000", 2024-09-18T05:14:10.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5822000000000002e-05 2024-09-18T05:14:10.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276020+0000", 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9999000000000005e-05 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17155 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247769+0000", 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4966567939999997, 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028435576000000001, 2024-09-18T05:14:10.805 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17155 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247769+0000", 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247769+0000", 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247768+0000", 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247777+0000", 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6819999999999992e-06 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247787+0000", 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.004e-05 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247798+0000", 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1060000000000001e-05 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276054+0000", 2024-09-18T05:14:10.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028256165999999999 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276124+0000", 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9923000000000001e-05 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276204+0000", 2024-09-18T05:14:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0265000000000005e-05 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17156 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247810+0000", 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4966152180000005, 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028629623, 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.810 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17156 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247810+0000", 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247810+0000", 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247809+0000", 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247830+0000", 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0060000000000001e-05 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247846+0000", 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6191000000000001e-05 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247863+0000", 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7649e-05 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276253+0000", 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028390049000000001 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276339+0000", 2024-09-18T05:14:10.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5741999999999993e-05 2024-09-18T05:14:10.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276440+0000", 2024-09-18T05:14:10.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010090300000000001 2024-09-18T05:14:10.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17157 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4965502120000007, 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028768309999999998, 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.815 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17157 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:10.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247875+0000", 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247880+0000", 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2630000000000003e-06 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247897+0000", 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7465e-05 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247912+0000", 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4983e-05 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276487+0000", 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028574835 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276555+0000", 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7849999999999996e-05 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276644+0000", 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8702999999999994e-05 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.820 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17158 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4965032160000007, 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028929555999999999, 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17158 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247922+0000", 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247927+0000", 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247942+0000", 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5591999999999999e-05 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247954+0000", 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1839e-05 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276665+0000", 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028710497000000001 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276750+0000", 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4789000000000004e-05 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276852+0000", 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102456 2024-09-18T05:14:10.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.825 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.825 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.825 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17159 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.825 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.247964+0000", 2024-09-18T05:14:10.825 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4964615620000004, 2024-09-18T05:14:10.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029089349, 2024-09-18T05:14:10.825 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17159 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247964+0000", 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247964+0000", 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247963+0000", 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247969+0000", 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.502e-06 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247985+0000", 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6303e-05 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.247999+0000", 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4011e-05 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276894+0000", 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028894676000000001 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.276973+0000", 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9246999999999995e-05 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277053+0000", 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0535000000000001e-05 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17160 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.248010+0000", 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4964156559999999, 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029267069999999999, 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.830 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17160 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248010+0000", 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248010+0000", 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248009+0000", 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248014+0000", 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.169e-06 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248030+0000", 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5481999999999998e-05 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248041+0000", 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1592e-05 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277098+0000", 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029056826000000001 2024-09-18T05:14:10.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277182+0000", 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4457999999999997e-05 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277277+0000", 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4572000000000002e-05 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.835 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17161 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.835 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.248052+0000", 2024-09-18T05:14:10.835 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4963740110000003, 2024-09-18T05:14:10.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029413175999999999, 2024-09-18T05:14:10.835 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.835 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.835 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.835 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17161 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248052+0000", 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248052+0000", 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248051+0000", 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248056+0000", 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1830000000000002e-06 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248086+0000", 2024-09-18T05:14:10.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0620000000000002e-05 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248099+0000", 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2434e-05 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277318+0000", 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029218896000000001 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277385+0000", 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6926000000000003e-05 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277465+0000", 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0154000000000005e-05 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:17162 3.15 3:aa013009:::rbd_data.118bd6f23a9d.0000000000000005:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:01.248123+0000", 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4963023, 2024-09-18T05:14:10.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029517900999999999, 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17162 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248123+0000", 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248123+0000", 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248122+0000", 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248129+0000", 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2199999999999997e-06 2024-09-18T05:14:10.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248148+0000", 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9660000000000002e-05 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.248171+0000", 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2388e-05 2024-09-18T05:14:10.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277490+0000", 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029319633000000001 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277572+0000", 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1160000000000002e-05 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:01.277641+0000", 2024-09-18T05:14:10.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9740000000000007e-05 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:20539 3.13 3:c976270e:::rbd_object_map.118ba5d0bdf6:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:06.476893+0000", 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.2675322050000002, 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.026833560999999999, 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:10.844 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:10.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:10.845 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20539 2024-09-18T05:14:10.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.845 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:10.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:10.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.476893+0000", 2024-09-18T05:14:10.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.476893+0000", 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.476891+0000", 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:10.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.476907+0000", 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6617e-05 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.476948+0000", 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0703e-05 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.476973+0000", 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5113000000000002e-05 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:10.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.496926+0000", 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019953235999999999 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.497057+0000", 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000130939 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.497881+0000", 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082322999999999999 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.503240+0000", 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053592329999999997 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.503621+0000", 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038133299999999998 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.503678+0000", 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6796000000000003e-05 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:10.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:10.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:10.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:06.503727+0000", 2024-09-18T05:14:10.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8995000000000001e-05 2024-09-18T05:14:10.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.850 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:10.850 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:10.850 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:10.852 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:10.851+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:10.853 INFO:teuthology.orchestra.run.smithi017.stdout:1369 trunc from 0x1fad75b to 0xa6d1ba8 2024-09-18T05:14:10.853 INFO:teuthology.orchestra.run.smithi017.stdout:1370 write 0xb0277ce thru 0xb02f3e8 (0x7c1b bytes) 2024-09-18T05:14:10.853 INFO:teuthology.orchestra.run.smithi017.stdout:1371 punch from 0x5fd31c0 to 0x5fd4c68, (0x1aa8 bytes) 2024-09-18T05:14:10.853 INFO:teuthology.orchestra.run.smithi017.stdout:1375 write 0x22c37e5 thru 0x22c5165 (0x1981 bytes) 2024-09-18T05:14:10.853 INFO:teuthology.orchestra.run.smithi017.stdout:1376 write 0xc746b44 thru 0xc7493f8 (0x28b5 bytes) 2024-09-18T05:14:10.853 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.853 INFO:teuthology.orchestra.run.smithi017.stdout:1379 write 0x35138ae thru 0x351771a (0x3e6d bytes) 2024-09-18T05:14:10.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:14:10.854 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 39, 2024-09-18T05:14:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "04ac0d2c-34bd-46ad-a307-a4eb23236eb4", 2024-09-18T05:14:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-18T05:13:15.193498+0000", 2024-09-18T05:14:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-18T05:14:10.051224+0000", 2024-09-18T05:14:10.854 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-18T05:13:26.810974+0000", 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-18T05:13:18.221936+0000", 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5801984, 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "noscrub", 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T05:14:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T05:14:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-18T05:14:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-18T05:14:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2024-09-18T05:14:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-18T05:14:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2024-09-18T05:14:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2024-09-18T05:14:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-18T05:14:10.856 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:28.629114+0000", 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:14:10.857 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:14:10.858 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "17", 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:14:10.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:14:10.860 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-18T05:14:10.861 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2024-09-18T05:14:10.862 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:34.103981+0000", 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:14:10.863 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:14:10.864 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "21", 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 3, 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 21, 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:14:10.865 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:14:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:14:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:14:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:14:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:14:10.866 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:14:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:14:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:14:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:14:10.868 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:14:10.869 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2024-09-18T05:14:10.870 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:44.114945+0000", 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:14:10.871 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-18T05:14:10.872 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "39", 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:14:10.873 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 14, 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 39, 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:14:10.874 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:14:10.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2024-09-18T05:14:10.876 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "a2a580f7-2bbc-46c3-b6b5-5a9e93539d27", 2024-09-18T05:14:10.877 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:10.878 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.880 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.882 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1558450642", 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1558450642", 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1558450642", 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1558450642", 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "260da429-e6eb-446b-95a0-dcf4581bb584", 2024-09-18T05:14:10.883 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3444575073", 2024-09-18T05:14:10.888 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3444575073", 2024-09-18T05:14:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3444575073", 2024-09-18T05:14:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3444575073", 2024-09-18T05:14:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.889 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "0cf5d53a-552d-4775-8437-86af3465b1bc", 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 18, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:10.892 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.893 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/467806624", 2024-09-18T05:14:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/467806624", 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/467806624", 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/467806624", 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "73bc18b6-4972-4164-a294-b6372bcf9f9d", 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:10.895 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2024-09-18T05:14:10.896 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2024-09-18T05:14:10.897 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2024-09-18T05:14:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2024-09-18T05:14:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.899 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/3763834627", 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/3763834627", 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/3763834627", 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/3763834627", 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "536c8ef2-eca6-44b4-a70c-06f191eb5ff1", 2024-09-18T05:14:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.902 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6800", 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6802", 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6804", 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6806", 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6815", 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6819", 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6809", 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6812", 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6802/1703780253", 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6806/1703780253", 2024-09-18T05:14:10.906 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6819/1703780253", 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6812/1703780253", 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "4341bba4-2913-4352-89d4-36fa18ee39cb", 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:10.907 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6808", 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6811", 2024-09-18T05:14:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6813", 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6816", 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6822", 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6823", 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6817", 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6820", 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6811/3348904742", 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6816/3348904742", 2024-09-18T05:14:10.912 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6823/3348904742", 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6820/3348904742", 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "e47d4aad-9c4b-43a9-9b32-2db463ec2a20", 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6801", 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6803", 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6805", 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6807", 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6818", 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6821", 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6810", 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6814", 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 74856761 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6803/74856761", 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6807/74856761", 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6821/74856761", 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6814/74856761", 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:10.918 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "686d275c-e592-44c1-87f9-ac9718f3a112", 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:14:10.919 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:14:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:14:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6824", 2024-09-18T05:14:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6825", 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6826", 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6827", 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6830", 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6831", 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6828", 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6829", 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6825/1345159853", 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6827/1345159853", 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6831/1345159853", 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6829/1345159853", 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:10.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.758535+0000", 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.800715+0000", 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:10.926 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.783374+0000", 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.779519+0000", 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:10.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.893837+0000", 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:14:10.928 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.776852+0000", 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.919808+0000", 2024-09-18T05:14:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:14:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:14:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:14:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:14:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.883599+0000", 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-18T05:14:10.931 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-18T05:14:10.932 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-18T05:14:10.933 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-18T05:14:10.933 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-18T05:14:10.933 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-18T05:14:10.933 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-18T05:14:10.933 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:10.933 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:10.933 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.933 INFO:teuthology.orchestra.run.smithi017.stdout:1382 write 0x8427ae3 thru 0x842924d (0x176b bytes) 2024-09-18T05:14:10.934 INFO:teuthology.orchestra.run.smithi017.stdout:1383 trunc from 0xc7493f9 to 0x69336b4 2024-09-18T05:14:10.935 INFO:tasks.thrashosds.thrasher:j is {'epoch': 39, 'fsid': '04ac0d2c-34bd-46ad-a307-a4eb23236eb4', 'created': '2024-09-18T05:13:15.193498+0000', 'modified': '2024-09-18T05:14:10.051224+0000', 'last_up_change': '2024-09-18T05:13:26.810974+0000', 'last_in_change': '2024-09-18T05:13:18.221936+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T05:13:28.629114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T05:13:34.103981+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T05:13:44.114945+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 39, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'a2a580f7-2bbc-46c3-b6b5-5a9e93539d27', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1558450642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1558450642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1558450642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1558450642}]}, 'public_addr': '172.21.15.17:6801/1558450642', 'cluster_addr': '172.21.15.17:6803/1558450642', 'heartbeat_back_addr': '172.21.15.17:6807/1558450642', 'heartbeat_front_addr': '172.21.15.17:6805/1558450642', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '260da429-e6eb-446b-95a0-dcf4581bb584', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3444575073}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3444575073}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3444575073}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3444575073}]}, 'public_addr': '172.21.15.17:6809/3444575073', 'cluster_addr': '172.21.15.17:6811/3444575073', 'heartbeat_back_addr': '172.21.15.17:6815/3444575073', 'heartbeat_front_addr': '172.21.15.17:6813/3444575073', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0cf5d53a-552d-4775-8437-86af3465b1bc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 467806624}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 467806624}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 467806624}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 467806624}]}, 'public_addr': '172.21.15.17:6817/467806624', 'cluster_addr': '172.21.15.17:6819/467806624', 'heartbeat_back_addr': '172.21.15.17:6823/467806624', 'heartbeat_front_addr': '172.21.15.17:6821/467806624', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '73bc18b6-4972-4164-a294-b6372bcf9f9d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6824', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6825', 'nonce': 3763834627}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6826', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6827', 'nonce': 3763834627}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6830', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6831', 'nonce': 3763834627}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6828', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6829', 'nonce': 3763834627}]}, 'public_addr': '172.21.15.17:6825/3763834627', 'cluster_addr': '172.21.15.17:6827/3763834627', 'heartbeat_back_addr': '172.21.15.17:6831/3763834627', 'heartbeat_front_addr': '172.21.15.17:6829/3763834627', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '536c8ef2-eca6-44b4-a70c-06f191eb5ff1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6802', 'nonce': 1703780253}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6806', 'nonce': 1703780253}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6815', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 1703780253}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6809', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6812', 'nonce': 1703780253}]}, 'public_addr': '172.21.15.86:6802/1703780253', 'cluster_addr': '172.21.15.86:6806/1703780253', 'heartbeat_back_addr': '172.21.15.86:6819/1703780253', 'heartbeat_front_addr': '172.21.15.86:6812/1703780253', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4341bba4-2913-4352-89d4-36fa18ee39cb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 3348904742}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6813', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6816', 'nonce': 3348904742}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6823', 'nonce': 3348904742}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6817', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6820', 'nonce': 3348904742}]}, 'public_addr': '172.21.15.86:6811/3348904742', 'cluster_addr': '172.21.15.86:6816/3348904742', 'heartbeat_back_addr': '172.21.15.86:6823/3348904742', 'heartbeat_front_addr': '172.21.15.86:6820/3348904742', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e47d4aad-9c4b-43a9-9b32-2db463ec2a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6801', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 74856761}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6805', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 74856761}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 74856761}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 74856761}, {'type': 'v1', 'addr': '172.21.15.86:6814', 'nonce': 74856761}]}, 'public_addr': '172.21.15.86:6803/74856761', 'cluster_addr': '172.21.15.86:6807/74856761', 'heartbeat_back_addr': '172.21.15.86:6821/74856761', 'heartbeat_front_addr': '172.21.15.86:6814/74856761', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '686d275c-e592-44c1-87f9-ac9718f3a112', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 1345159853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6826', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 1345159853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6830', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 1345159853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6829', 'nonce': 1345159853}]}, 'public_addr': '172.21.15.86:6825/1345159853', 'cluster_addr': '172.21.15.86:6827/1345159853', 'heartbeat_back_addr': '172.21.15.86:6831/1345159853', 'heartbeat_front_addr': '172.21.15.86:6829/1345159853', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.758535+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.800715+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.783374+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.779519+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.893837+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.776852+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.919808+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.883599+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T05:14:10.935 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:1385 read 0x231debe thru 0x23290cd (0xb210 bytes) 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:1386 write 0xe578eb3 thru 0xe58663e (0xd78c bytes) 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:1387 punch from 0xe445e2f to 0xe452e3c, (0xd00d bytes) 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:1388 trunc from 0xe58663f to 0xcf44df7 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:1389 write 0x6841d69 thru 0x6850c1f (0xeeb7 bytes) 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:1390 read 0x1b32e99 thru 0x1b37762 (0x48ca bytes) 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:1392 read 0xbf38e8a thru 0xbf39241 (0x3b8 bytes) 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:1393 write 0xa12aaa4 thru 0xa13718f (0xc6ec bytes) 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:1395 punch from 0x6379485 to 0x63825b4, (0x912f bytes) 2024-09-18T05:14:10.937 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:10.938 INFO:teuthology.orchestra.run.smithi017.stdout:1399 write 0x4805bde thru 0x480f008 (0x942b bytes) 2024-09-18T05:14:10.938 INFO:teuthology.orchestra.run.smithi017.stdout:1400 writesame 0xbbb3bd8 thru 0xbbbd568 data_size 0x1(0x9991 bytes) 2024-09-18T05:14:10.952 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:10.951+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:10.964 INFO:teuthology.orchestra.run.smithi017.stdout:1401 write 0xcc8f520 thru 0xcc95ca0 (0x6781 bytes) 2024-09-18T05:14:10.972 INFO:teuthology.orchestra.run.smithi017.stdout:1403 read 0x5f554d9 thru 0x5f59a5a (0x4582 bytes) 2024-09-18T05:14:10.972 INFO:teuthology.orchestra.run.smithi017.stdout:1404 write 0x41ad00 thru 0x41be3b (0x113c bytes) 2024-09-18T05:14:10.998 INFO:teuthology.orchestra.run.smithi017.stdout:1405 trunc from 0xcf44df7 to 0x96943cf 2024-09-18T05:14:11.017 INFO:teuthology.orchestra.run.smithi017.stdout:1408 writesame 0x94eb403 thru 0x94ee54c data_size 0x9(0x314a bytes) 2024-09-18T05:14:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:1410 write 0xba68344 thru 0xba70bf2 (0x88af bytes) 2024-09-18T05:14:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:1415 write 0x603e656 thru 0x604cf1f (0xe8ca bytes) 2024-09-18T05:14:11.050 INFO:teuthology.orchestra.run.smithi017.stdout:1416 trunc from 0xba70bf3 to 0xcbe42dc 2024-09-18T05:14:11.054 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:11.051+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:1417 writesame 0xc70581c thru 0xc70bedb data_size 0x20(0x66c0 bytes) 2024-09-18T05:14:11.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:14:11.087 INFO:teuthology.orchestra.run.smithi017.stdout:1420 trunc from 0xcbe42dc to 0x1078e97 2024-09-18T05:14:11.117 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.117 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.117 INFO:teuthology.orchestra.run.smithi017.stdout:1425 read 0x323469 thru 0x324f43 (0x1adb bytes) 2024-09-18T05:14:11.117 INFO:teuthology.orchestra.run.smithi017.stdout:1426 read 0x730fc8 thru 0x737a43 (0x6a7c bytes) 2024-09-18T05:14:11.118 INFO:teuthology.orchestra.run.smithi017.stdout:1428 write 0x9030e4 thru 0x9084cf (0x53ec bytes) 2024-09-18T05:14:11.126 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:11.126 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:11.140 INFO:teuthology.orchestra.run.smithi017.stdout:1429 trunc from 0x1078e97 to 0xc4bb9f5 2024-09-18T05:14:11.149 INFO:teuthology.orchestra.run.smithi017.stdout:1430 punch from 0x5cfeb04 to 0x5d07592, (0x8a8e bytes) 2024-09-18T05:14:11.150 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.150 INFO:teuthology.orchestra.run.smithi017.stdout:1432 read 0x412158e thru 0x41276c6 (0x6139 bytes) 2024-09-18T05:14:11.150 INFO:teuthology.orchestra.run.smithi017.stdout:1433 write 0xa2b616a thru 0xa2b7c54 (0x1aeb bytes) 2024-09-18T05:14:11.151 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:11.154 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:11.151+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:11.155 INFO:teuthology.orchestra.run.smithi017.stdout:1434 write 0x1b3c909 thru 0x1b3ecd0 (0x23c8 bytes) 2024-09-18T05:14:11.160 INFO:teuthology.orchestra.run.smithi017.stdout:1435 read 0xc272fd3 thru 0xc28171a (0xe748 bytes) 2024-09-18T05:14:11.161 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.161 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.161 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.161 INFO:teuthology.orchestra.run.smithi017.stdout:1439 punch from 0x69be387 to 0x69c3b68, (0x57e1 bytes) 2024-09-18T05:14:11.171 INFO:teuthology.orchestra.run.smithi017.stdout:1440 writesame 0xe225380 thru 0xe23394e data_size 0x1(0xe5cf bytes) 2024-09-18T05:14:11.172 INFO:teuthology.orchestra.run.smithi017.stdout:1441 writesame 0x638af8d thru 0x638cdd2 data_size 0xa(0x1e46 bytes) 2024-09-18T05:14:11.178 INFO:teuthology.orchestra.run.smithi017.stdout:1442 read 0xc54976d thru 0xc5556b7 (0xbf4b bytes) 2024-09-18T05:14:11.179 INFO:teuthology.orchestra.run.smithi017.stdout:1443 writesame 0x116eacc thru 0x1174642 data_size 0x23(0x5b77 bytes) 2024-09-18T05:14:11.182 INFO:teuthology.orchestra.run.smithi017.stdout:1445 write 0x21c4140 thru 0x21d3a45 (0xf906 bytes) 2024-09-18T05:14:11.207 INFO:teuthology.orchestra.run.smithi017.stdout:1450 trunc from 0xe23394f to 0x31ad9ba 2024-09-18T05:14:11.224 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.240 INFO:teuthology.orchestra.run.smithi017.stdout:1456 write 0x826d1cd thru 0x82728ed (0x5721 bytes) 2024-09-18T05:14:11.246 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.246 INFO:teuthology.orchestra.run.smithi017.stdout:1460 read 0x481ac3 thru 0x491485 (0xf9c3 bytes) 2024-09-18T05:14:11.254 INFO:teuthology.orchestra.run.smithi017.stdout:1463 trunc from 0x82728ee to 0x45c58b8 2024-09-18T05:14:11.255 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:11.255+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:11.268 INFO:teuthology.orchestra.run.smithi017.stdout:1464 punch from 0x1fe5311 to 0x1fef3d3, (0xa0c2 bytes) 2024-09-18T05:14:11.268 INFO:teuthology.orchestra.run.smithi017.stdout:1465 read 0x32e74c1 thru 0x32e7aa4 (0x5e4 bytes) 2024-09-18T05:14:11.272 INFO:teuthology.orchestra.run.smithi017.stdout:1466 trunc from 0x45c58b8 to 0x1ab6467 2024-09-18T05:14:11.289 INFO:teuthology.orchestra.run.smithi017.stdout:1467 read 0x44e938 thru 0x45af01 (0xc5ca bytes) 2024-09-18T05:14:11.290 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.301 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:11.301 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:11.301 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:11.301 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:11.301 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:11.310 INFO:teuthology.orchestra.run.smithi017.stdout:1469 write 0x8dc6681 thru 0x8dc981e (0x319e bytes) 2024-09-18T05:14:11.320 INFO:teuthology.orchestra.run.smithi017.stdout:1470 trunc from 0x8dc981f to 0xbad5005 2024-09-18T05:14:11.323 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:11.327 INFO:teuthology.orchestra.run.smithi017.stdout:1471 write 0xa4b2ca thru 0xa4c51c (0x1253 bytes) 2024-09-18T05:14:11.330 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.343 INFO:teuthology.orchestra.run.smithi017.stdout:1475 write 0xe6c0d72 thru 0xe6cb481 (0xa710 bytes) 2024-09-18T05:14:11.348 INFO:teuthology.orchestra.run.smithi017.stdout:1476 read 0x55ac0b8 thru 0x55afecf (0x3e18 bytes) 2024-09-18T05:14:11.349 INFO:teuthology.orchestra.run.smithi017.stdout:1477 write 0xcdc069d thru 0xcdc91fb (0x8b5f bytes) 2024-09-18T05:14:11.355 INFO:teuthology.orchestra.run.smithi017.stdout:1478 write 0x917268f thru 0x917780d (0x517f bytes) 2024-09-18T05:14:11.356 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:11.350+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:11.359 INFO:teuthology.orchestra.run.smithi017.stdout:1480 writesame 0x4d5c25b thru 0x4d67b4b data_size 0x11(0xb8f1 bytes) 2024-09-18T05:14:11.363 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:14:11.364 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:14:11.368 INFO:teuthology.orchestra.run.smithi017.stdout:1481 writesame 0x547538e thru 0x547e6cd data_size 0x2(0x9340 bytes) 2024-09-18T05:14:11.384 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-18T05:14:10.561512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":353645038,"num_objects":538,"num_object_clones":118,"num_object_copies":1076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":259,"num_read":31670,"num_read_kb":203088,"num_write":5718,"num_write_kb":90050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4449,"ondisk_log_size":4449,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283300,"kb_used_data":17992,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754691420,"statfs":{"total":773094113280,"available":772804014080,"internally_reserved":0,"allocated":18423808,"data_stored":164359400,"data_compressed":9336717,"data_compressed_allocated":9940992,"data_compressed_original":158275576,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124976959,"num_objects":79,"num_object_clones":11,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":5,"num_read":6344,"num_read_kb":83653,"num_write":1289,"num_write_kb":27385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.522655"},"pg_stats":[{"pgid":"3.1f","version":"36'183","reported_seq":503,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.387138+0000","last_change":"2024-09-18T05:13:47.874353+0000","last_active":"2024-09-18T05:14:07.387138+0000","last_peered":"2024-09-18T05:14:07.387138+0000","last_clean":"2024-09-18T05:14:07.387138+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:14:07.387138+0000","last_undegraded":"2024-09-18T05:14:07.387138+0000","last_fullsized":"2024-09-18T05:14:07.387138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002377985,"stat_sum":{"num_bytes":9868295,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":8,"num_read":793,"num_read_kb":1634,"num_write":260,"num_write_kb":2321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'720","reported_seq":1191,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.028021+0000","last_change":"2024-09-18T05:13:47.896552+0000","last_active":"2024-09-18T05:14:07.028021+0000","last_peered":"2024-09-18T05:14:07.028021+0000","last_clean":"2024-09-18T05:14:07.028021+0000","last_became_active":"2024-09-18T05:13:45.882552+0000","last_became_peered":"2024-09-18T05:13:45.882552+0000","last_unstale":"2024-09-18T05:14:07.028021+0000","last_undegraded":"2024-09-18T05:14:07.028021+0000","last_fullsized":"2024-09-18T05:14:07.028021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:25:07.826913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001660138,"stat_sum":{"num_bytes":8031180,"num_objects":13,"num_object_clones":1,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":8,"num_read":4544,"num_read_kb":3730,"num_write":1230,"num_write_kb":1669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"36'103","reported_seq":492,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.476051+0000","last_change":"2024-09-18T05:13:47.889261+0000","last_active":"2024-09-18T05:14:07.476051+0000","last_peered":"2024-09-18T05:14:07.476051+0000","last_clean":"2024-09-18T05:14:07.476051+0000","last_became_active":"2024-09-18T05:13:45.883512+0000","last_became_peered":"2024-09-18T05:13:45.883512+0000","last_unstale":"2024-09-18T05:14:07.476051+0000","last_undegraded":"2024-09-18T05:14:07.476051+0000","last_fullsized":"2024-09-18T05:14:07.476051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:13.538982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080162099999999997,"stat_sum":{"num_bytes":1243839,"num_objects":15,"num_object_clones":3,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":9,"num_read":404,"num_read_kb":746,"num_write":97,"num_write_kb":2712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"36'166","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.498863+0000","last_change":"2024-09-18T05:13:47.889511+0000","last_active":"2024-09-18T05:14:07.498863+0000","last_peered":"2024-09-18T05:14:07.498863+0000","last_clean":"2024-09-18T05:14:07.498863+0000","last_became_active":"2024-09-18T05:13:45.890406+0000","last_became_peered":"2024-09-18T05:13:45.890406+0000","last_unstale":"2024-09-18T05:14:07.498863+0000","last_undegraded":"2024-09-18T05:14:07.498863+0000","last_fullsized":"2024-09-18T05:14:07.498863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:49:08.888102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001443443,"stat_sum":{"num_bytes":18849157,"num_objects":17,"num_object_clones":1,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":10,"num_read":713,"num_read_kb":10281,"num_write":229,"num_write_kb":4390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"36'80","reported_seq":313,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.386593+0000","last_change":"2024-09-18T05:13:47.872985+0000","last_active":"2024-09-18T05:14:07.386593+0000","last_peered":"2024-09-18T05:14:07.386593+0000","last_clean":"2024-09-18T05:14:07.386593+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:14:07.386593+0000","last_undegraded":"2024-09-18T05:14:07.386593+0000","last_fullsized":"2024-09-18T05:14:07.386593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016154539999999999,"stat_sum":{"num_bytes":11203716,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":6,"num_read":243,"num_read_kb":5556,"num_write":94,"num_write_kb":3175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"36'80","reported_seq":623,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.526737+0000","last_change":"2024-09-18T05:13:47.881254+0000","last_active":"2024-09-18T05:14:07.526737+0000","last_peered":"2024-09-18T05:14:07.526737+0000","last_clean":"2024-09-18T05:14:07.526737+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:14:07.526737+0000","last_undegraded":"2024-09-18T05:14:07.526737+0000","last_fullsized":"2024-09-18T05:14:07.526737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091901600000000004,"stat_sum":{"num_bytes":1267619,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":7,"num_read":536,"num_read_kb":883,"num_write":84,"num_write_kb":2500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"36'141","reported_seq":1539,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.151717+0000","last_change":"2024-09-18T05:13:47.880516+0000","last_active":"2024-09-18T05:14:07.151717+0000","last_peered":"2024-09-18T05:14:07.151717+0000","last_clean":"2024-09-18T05:14:07.151717+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:14:07.151717+0000","last_undegraded":"2024-09-18T05:14:07.151717+0000","last_fullsized":"2024-09-18T05:14:07.151717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042422500000000003,"stat_sum":{"num_bytes":20301607,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":2311,"num_read_kb":8884,"num_write":148,"num_write_kb":2812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"36'97","reported_seq":731,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.475337+0000","last_change":"2024-09-18T05:13:47.895130+0000","last_active":"2024-09-18T05:14:07.475337+0000","last_peered":"2024-09-18T05:14:07.475337+0000","last_clean":"2024-09-18T05:14:07.475337+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:14:07.475337+0000","last_undegraded":"2024-09-18T05:14:07.475337+0000","last_fullsized":"2024-09-18T05:14:07.475337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000585963,"stat_sum":{"num_bytes":16250358,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":6,"num_read":649,"num_read_kb":11577,"num_write":109,"num_write_kb":2561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'116","reported_seq":924,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:06.823141+0000","last_change":"2024-09-18T05:13:47.874514+0000","last_active":"2024-09-18T05:14:06.823141+0000","last_peered":"2024-09-18T05:14:06.823141+0000","last_clean":"2024-09-18T05:14:06.823141+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:14:06.823141+0000","last_undegraded":"2024-09-18T05:14:06.823141+0000","last_fullsized":"2024-09-18T05:14:06.823141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021885429999999998,"stat_sum":{"num_bytes":12639719,"num_objects":18,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":10,"num_read":1310,"num_read_kb":8082,"num_write":102,"num_write_kb":1446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'252","reported_seq":949,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.152203+0000","last_change":"2024-09-18T05:13:47.888939+0000","last_active":"2024-09-18T05:14:07.152203+0000","last_peered":"2024-09-18T05:14:07.152203+0000","last_clean":"2024-09-18T05:14:07.152203+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:14:07.152203+0000","last_undegraded":"2024-09-18T05:14:07.152203+0000","last_fullsized":"2024-09-18T05:14:07.152203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081828800000000002,"stat_sum":{"num_bytes":16422244,"num_objects":22,"num_object_clones":4,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":10,"num_read":1894,"num_read_kb":7545,"num_write":320,"num_write_kb":2680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"36'91","reported_seq":848,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.479475+0000","last_change":"2024-09-18T05:13:47.875490+0000","last_active":"2024-09-18T05:14:07.479475+0000","last_peered":"2024-09-18T05:14:07.479475+0000","last_clean":"2024-09-18T05:14:07.479475+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:14:07.479475+0000","last_undegraded":"2024-09-18T05:14:07.479475+0000","last_fullsized":"2024-09-18T05:14:07.479475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068601800000000004,"stat_sum":{"num_bytes":22526392,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":9,"num_read":784,"num_read_kb":16076,"num_write":89,"num_write_kb":1652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"36'55","reported_seq":646,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.152249+0000","last_change":"2024-09-18T05:13:47.881467+0000","last_active":"2024-09-18T05:14:07.152249+0000","last_peered":"2024-09-18T05:14:07.152249+0000","last_clean":"2024-09-18T05:14:07.152249+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:14:07.152249+0000","last_undegraded":"2024-09-18T05:14:07.152249+0000","last_fullsized":"2024-09-18T05:14:07.152249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147750000000001,"stat_sum":{"num_bytes":11011217,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":7,"num_read":595,"num_read_kb":5745,"num_write":47,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T05:14:04.026449+0000","last_change":"2024-09-18T05:13:37.891260+0000","last_active":"2024-09-18T05:14:04.026449+0000","last_peered":"2024-09-18T05:14:04.026449+0000","last_clean":"2024-09-18T05:14:04.026449+0000","last_became_active":"2024-09-18T05:13:35.878930+0000","last_became_peered":"2024-09-18T05:13:35.878930+0000","last_unstale":"2024-09-18T05:14:04.026449+0000","last_undegraded":"2024-09-18T05:14:04.026449+0000","last_fullsized":"2024-09-18T05:14:04.026449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:44.904896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070920800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"36'195","reported_seq":308,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.024044+0000","last_change":"2024-09-18T05:13:47.873517+0000","last_active":"2024-09-18T05:14:07.024044+0000","last_peered":"2024-09-18T05:14:07.024044+0000","last_clean":"2024-09-18T05:14:07.024044+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:14:07.024044+0000","last_undegraded":"2024-09-18T05:14:07.024044+0000","last_fullsized":"2024-09-18T05:14:07.024044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019230849999999999,"stat_sum":{"num_bytes":5180556,"num_objects":15,"num_object_clones":2,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":9,"num_read":741,"num_read_kb":817,"num_write":272,"num_write_kb":2471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T05:14:04.082763+0000","last_change":"2024-09-18T05:13:37.896976+0000","last_active":"2024-09-18T05:14:04.082763+0000","last_peered":"2024-09-18T05:14:04.082763+0000","last_clean":"2024-09-18T05:14:04.082763+0000","last_became_active":"2024-09-18T05:13:35.879278+0000","last_became_peered":"2024-09-18T05:13:35.879278+0000","last_unstale":"2024-09-18T05:14:04.082763+0000","last_undegraded":"2024-09-18T05:14:04.082763+0000","last_fullsized":"2024-09-18T05:14:04.082763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:47.035613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"36'160","reported_seq":1393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:06.823093+0000","last_change":"2024-09-18T05:13:47.897304+0000","last_active":"2024-09-18T05:14:06.823093+0000","last_peered":"2024-09-18T05:14:06.823093+0000","last_clean":"2024-09-18T05:14:06.823093+0000","last_became_active":"2024-09-18T05:13:45.882587+0000","last_became_peered":"2024-09-18T05:13:45.882587+0000","last_unstale":"2024-09-18T05:14:06.823093+0000","last_undegraded":"2024-09-18T05:14:06.823093+0000","last_fullsized":"2024-09-18T05:14:06.823093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:27:19.084581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021450010000000001,"stat_sum":{"num_bytes":23369244,"num_objects":22,"num_object_clones":6,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":8,"num_read":1655,"num_read_kb":16079,"num_write":208,"num_write_kb":2818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T05:14:04.040705+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:14:04.040705+0000","last_peered":"2024-09-18T05:14:04.040705+0000","last_clean":"2024-09-18T05:14:04.040705+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:14:04.040705+0000","last_undegraded":"2024-09-18T05:14:04.040705+0000","last_fullsized":"2024-09-18T05:14:04.040705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"36'63","reported_seq":221,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:06.713463+0000","last_change":"2024-09-18T05:13:47.880769+0000","last_active":"2024-09-18T05:14:06.713463+0000","last_peered":"2024-09-18T05:14:06.713463+0000","last_clean":"2024-09-18T05:14:06.713463+0000","last_became_active":"2024-09-18T05:13:46.174136+0000","last_became_peered":"2024-09-18T05:13:46.174136+0000","last_unstale":"2024-09-18T05:14:06.713463+0000","last_undegraded":"2024-09-18T05:14:06.713463+0000","last_fullsized":"2024-09-18T05:14:06.713463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:52.243601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058757199999999996,"stat_sum":{"num_bytes":10089577,"num_objects":16,"num_object_clones":2,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":11,"num_read":157,"num_read_kb":992,"num_write":119,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T05:14:04.082779+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:14:04.082779+0000","last_peered":"2024-09-18T05:14:04.082779+0000","last_clean":"2024-09-18T05:14:04.082779+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:14:04.082779+0000","last_undegraded":"2024-09-18T05:14:04.082779+0000","last_fullsized":"2024-09-18T05:14:04.082779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'119","reported_seq":792,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.340339+0000","last_change":"2024-09-18T05:13:47.889820+0000","last_active":"2024-09-18T05:14:07.340339+0000","last_peered":"2024-09-18T05:14:07.340339+0000","last_clean":"2024-09-18T05:14:07.340339+0000","last_became_active":"2024-09-18T05:13:45.881482+0000","last_became_peered":"2024-09-18T05:13:45.881482+0000","last_unstale":"2024-09-18T05:14:07.340339+0000","last_undegraded":"2024-09-18T05:14:07.340339+0000","last_fullsized":"2024-09-18T05:14:07.340339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:50:34.961113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013457199999999999,"stat_sum":{"num_bytes":6253985,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":682,"num_read_kb":9464,"num_write":113,"num_write_kb":4959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"36'80","reported_seq":424,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.076716+0000","last_change":"2024-09-18T05:13:47.881241+0000","last_active":"2024-09-18T05:14:07.076716+0000","last_peered":"2024-09-18T05:14:07.076716+0000","last_clean":"2024-09-18T05:14:07.076716+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:14:07.076716+0000","last_undegraded":"2024-09-18T05:14:07.076716+0000","last_fullsized":"2024-09-18T05:14:07.076716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087944100000000001,"stat_sum":{"num_bytes":17878117,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":7,"num_read":347,"num_read_kb":12220,"num_write":86,"num_write_kb":6524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T05:14:04.030979+0000","last_change":"2024-09-18T05:13:37.897308+0000","last_active":"2024-09-18T05:14:04.030979+0000","last_peered":"2024-09-18T05:14:04.030979+0000","last_clean":"2024-09-18T05:14:04.030979+0000","last_became_active":"2024-09-18T05:13:35.880281+0000","last_became_peered":"2024-09-18T05:13:35.880281+0000","last_unstale":"2024-09-18T05:14:04.030979+0000","last_undegraded":"2024-09-18T05:14:04.030979+0000","last_fullsized":"2024-09-18T05:14:04.030979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"36'100","reported_seq":1070,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.350380+0000","last_change":"2024-09-18T05:13:47.880771+0000","last_active":"2024-09-18T05:14:07.350380+0000","last_peered":"2024-09-18T05:14:07.350380+0000","last_clean":"2024-09-18T05:14:07.350380+0000","last_became_active":"2024-09-18T05:13:46.174696+0000","last_became_peered":"2024-09-18T05:13:46.174696+0000","last_unstale":"2024-09-18T05:14:07.350380+0000","last_undegraded":"2024-09-18T05:14:07.350380+0000","last_fullsized":"2024-09-18T05:14:07.350380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:04:21.805854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058553999999999995,"stat_sum":{"num_bytes":11272519,"num_objects":22,"num_object_clones":7,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":8,"num_read":987,"num_read_kb":10780,"num_write":94,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T05:14:04.081089+0000","last_change":"2024-09-18T05:13:37.887642+0000","last_active":"2024-09-18T05:14:04.081089+0000","last_peered":"2024-09-18T05:14:04.081089+0000","last_clean":"2024-09-18T05:14:04.081089+0000","last_became_active":"2024-09-18T05:13:36.135298+0000","last_became_peered":"2024-09-18T05:13:36.135298+0000","last_unstale":"2024-09-18T05:14:04.081089+0000","last_undegraded":"2024-09-18T05:14:04.081089+0000","last_fullsized":"2024-09-18T05:14:04.081089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.310834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088184600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"36'81","reported_seq":729,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:06.744484+0000","last_change":"2024-09-18T05:13:47.872235+0000","last_active":"2024-09-18T05:14:06.744484+0000","last_peered":"2024-09-18T05:14:06.744484+0000","last_clean":"2024-09-18T05:14:06.744484+0000","last_became_active":"2024-09-18T05:13:45.870133+0000","last_became_peered":"2024-09-18T05:13:45.870133+0000","last_unstale":"2024-09-18T05:14:06.744484+0000","last_undegraded":"2024-09-18T05:14:06.744484+0000","last_fullsized":"2024-09-18T05:14:06.744484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:02:08.230414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014534350000000001,"stat_sum":{"num_bytes":929222,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":11,"num_read":646,"num_read_kb":356,"num_write":71,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T05:14:04.040463+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:14:04.040463+0000","last_peered":"2024-09-18T05:14:04.040463+0000","last_clean":"2024-09-18T05:14:04.040463+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:14:04.040463+0000","last_undegraded":"2024-09-18T05:14:04.040463+0000","last_fullsized":"2024-09-18T05:14:04.040463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"36'80","reported_seq":909,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.180109+0000","last_change":"2024-09-18T05:13:47.897422+0000","last_active":"2024-09-18T05:14:07.180109+0000","last_peered":"2024-09-18T05:14:07.180109+0000","last_clean":"2024-09-18T05:14:07.180109+0000","last_became_active":"2024-09-18T05:13:45.878063+0000","last_became_peered":"2024-09-18T05:13:45.878063+0000","last_unstale":"2024-09-18T05:14:07.180109+0000","last_undegraded":"2024-09-18T05:14:07.180109+0000","last_fullsized":"2024-09-18T05:14:07.180109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:53.493537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023719930000000002,"stat_sum":{"num_bytes":20295186,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":7,"num_read":868,"num_read_kb":5046,"num_write":105,"num_write_kb":2965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T05:14:04.030864+0000","last_change":"2024-09-18T05:13:37.896005+0000","last_active":"2024-09-18T05:14:04.030864+0000","last_peered":"2024-09-18T05:14:04.030864+0000","last_clean":"2024-09-18T05:14:04.030864+0000","last_became_active":"2024-09-18T05:13:35.878921+0000","last_became_peered":"2024-09-18T05:13:35.878921+0000","last_unstale":"2024-09-18T05:14:04.030864+0000","last_undegraded":"2024-09-18T05:14:04.030864+0000","last_fullsized":"2024-09-18T05:14:04.030864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:03.020943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-18T05:14:04.040506+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:14:04.040506+0000","last_peered":"2024-09-18T05:14:04.040506+0000","last_clean":"2024-09-18T05:14:04.040506+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:14:04.040506+0000","last_undegraded":"2024-09-18T05:14:04.040506+0000","last_fullsized":"2024-09-18T05:14:04.040506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"35'91","reported_seq":967,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.178195+0000","last_change":"2024-09-18T05:13:47.896354+0000","last_active":"2024-09-18T05:14:07.178195+0000","last_peered":"2024-09-18T05:14:07.178195+0000","last_clean":"2024-09-18T05:14:07.178195+0000","last_became_active":"2024-09-18T05:13:45.873640+0000","last_became_peered":"2024-09-18T05:13:45.873640+0000","last_unstale":"2024-09-18T05:14:07.178195+0000","last_undegraded":"2024-09-18T05:14:07.178195+0000","last_fullsized":"2024-09-18T05:14:07.178195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:45.276749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001525368,"stat_sum":{"num_bytes":10535473,"num_objects":13,"num_object_clones":3,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":5,"num_read":1543,"num_read_kb":14079,"num_write":93,"num_write_kb":7224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"36'65","reported_seq":245,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.475685+0000","last_change":"2024-09-18T05:13:47.880748+0000","last_active":"2024-09-18T05:14:07.475685+0000","last_peered":"2024-09-18T05:14:07.475685+0000","last_clean":"2024-09-18T05:14:07.475685+0000","last_became_active":"2024-09-18T05:13:46.177331+0000","last_became_peered":"2024-09-18T05:13:46.177331+0000","last_unstale":"2024-09-18T05:14:07.475685+0000","last_undegraded":"2024-09-18T05:14:07.475685+0000","last_fullsized":"2024-09-18T05:14:07.475685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:38:10.519505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044114000000000002,"stat_sum":{"num_bytes":3028628,"num_objects":13,"num_object_clones":4,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":8,"num_read":169,"num_read_kb":574,"num_write":57,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"36'69","reported_seq":209,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.190569+0000","last_change":"2024-09-18T05:13:48.338662+0000","last_active":"2024-09-18T05:14:07.190569+0000","last_peered":"2024-09-18T05:14:07.190569+0000","last_clean":"2024-09-18T05:14:07.190569+0000","last_became_active":"2024-09-18T05:13:45.896900+0000","last_became_peered":"2024-09-18T05:13:45.896900+0000","last_unstale":"2024-09-18T05:14:07.190569+0000","last_undegraded":"2024-09-18T05:14:07.190569+0000","last_fullsized":"2024-09-18T05:14:07.190569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:03.337669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070131499999999999,"stat_sum":{"num_bytes":4392329,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":146,"num_read_kb":447,"num_write":80,"num_write_kb":2412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"36'76","reported_seq":772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.325350+0000","last_change":"2024-09-18T05:13:47.896719+0000","last_active":"2024-09-18T05:14:07.325350+0000","last_peered":"2024-09-18T05:14:07.325350+0000","last_clean":"2024-09-18T05:14:07.325350+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:14:07.325350+0000","last_undegraded":"2024-09-18T05:14:07.325350+0000","last_fullsized":"2024-09-18T05:14:07.325350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001766786,"stat_sum":{"num_bytes":3035006,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":6,"num_read":694,"num_read_kb":1088,"num_write":68,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"36'82","reported_seq":460,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:06.463192+0000","last_change":"2024-09-18T05:13:47.889554+0000","last_active":"2024-09-18T05:14:06.463192+0000","last_peered":"2024-09-18T05:14:06.463192+0000","last_clean":"2024-09-18T05:14:06.463192+0000","last_became_active":"2024-09-18T05:13:45.883970+0000","last_became_peered":"2024-09-18T05:13:45.883970+0000","last_unstale":"2024-09-18T05:14:06.463192+0000","last_undegraded":"2024-09-18T05:14:06.463192+0000","last_fullsized":"2024-09-18T05:14:06.463192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:50.318030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011236919999999999,"stat_sum":{"num_bytes":2226942,"num_objects":17,"num_object_clones":4,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":10,"num_read":380,"num_read_kb":1918,"num_write":83,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"36'65","reported_seq":194,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.352760+0000","last_change":"2024-09-18T05:13:47.875657+0000","last_active":"2024-09-18T05:14:07.352760+0000","last_peered":"2024-09-18T05:14:07.352760+0000","last_clean":"2024-09-18T05:14:07.352760+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:14:07.352760+0000","last_undegraded":"2024-09-18T05:14:07.352760+0000","last_fullsized":"2024-09-18T05:14:07.352760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070575100000000001,"stat_sum":{"num_bytes":6264583,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":4,"num_read":137,"num_read_kb":2678,"num_write":64,"num_write_kb":4858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"36'263","reported_seq":1393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.356069+0000","last_change":"2024-09-18T05:13:47.875757+0000","last_active":"2024-09-18T05:14:07.356069+0000","last_peered":"2024-09-18T05:14:07.356069+0000","last_clean":"2024-09-18T05:14:07.356069+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:14:07.356069+0000","last_undegraded":"2024-09-18T05:14:07.356069+0000","last_fullsized":"2024-09-18T05:14:07.356069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066626200000000004,"stat_sum":{"num_bytes":27610525,"num_objects":37,"num_object_clones":8,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":2132,"num_read_kb":11881,"num_write":308,"num_write_kb":1383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"36'143","reported_seq":1350,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.576162+0000","last_change":"2024-09-18T05:13:47.875939+0000","last_active":"2024-09-18T05:14:07.576162+0000","last_peered":"2024-09-18T05:14:07.576162+0000","last_clean":"2024-09-18T05:14:07.576162+0000","last_became_active":"2024-09-18T05:13:45.896673+0000","last_became_peered":"2024-09-18T05:13:45.896673+0000","last_unstale":"2024-09-18T05:14:07.576162+0000","last_undegraded":"2024-09-18T05:14:07.576162+0000","last_fullsized":"2024-09-18T05:14:07.576162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:31:36.790001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072282800000000001,"stat_sum":{"num_bytes":6642589,"num_objects":19,"num_object_clones":3,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":8,"num_read":2195,"num_read_kb":7071,"num_write":145,"num_write_kb":3330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"36'120","reported_seq":616,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.178425+0000","last_change":"2024-09-18T05:13:48.338568+0000","last_active":"2024-09-18T05:14:07.178425+0000","last_peered":"2024-09-18T05:14:07.178425+0000","last_clean":"2024-09-18T05:14:07.178425+0000","last_became_active":"2024-09-18T05:13:45.886582+0000","last_became_peered":"2024-09-18T05:13:45.886582+0000","last_unstale":"2024-09-18T05:14:07.178425+0000","last_undegraded":"2024-09-18T05:14:07.178425+0000","last_fullsized":"2024-09-18T05:14:07.178425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:27.323301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060322900000000005,"stat_sum":{"num_bytes":25206823,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":6,"num_read":675,"num_read_kb":15841,"num_write":225,"num_write_kb":6277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"36'53","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.152688+0000","last_change":"2024-09-18T05:13:47.875315+0000","last_active":"2024-09-18T05:14:07.152688+0000","last_peered":"2024-09-18T05:14:07.152688+0000","last_clean":"2024-09-18T05:14:07.152688+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:14:07.152688+0000","last_undegraded":"2024-09-18T05:14:07.152688+0000","last_fullsized":"2024-09-18T05:14:07.152688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000619883,"stat_sum":{"num_bytes":11739769,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":4,"num_read":370,"num_read_kb":4788,"num_write":63,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"36'62","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.473568+0000","last_change":"2024-09-18T05:13:47.873548+0000","last_active":"2024-09-18T05:14:07.473568+0000","last_peered":"2024-09-18T05:14:07.473568+0000","last_clean":"2024-09-18T05:14:07.473568+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:14:07.473568+0000","last_undegraded":"2024-09-18T05:14:07.473568+0000","last_fullsized":"2024-09-18T05:14:07.473568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025716760000000002,"stat_sum":{"num_bytes":1042513,"num_objects":11,"num_object_clones":1,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":7,"num_read":37,"num_read_kb":323,"num_write":56,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"36'278","reported_seq":1287,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T05:14:07.588194+0000","last_change":"2024-09-18T05:13:47.875357+0000","last_active":"2024-09-18T05:14:07.588194+0000","last_peered":"2024-09-18T05:14:07.588194+0000","last_clean":"2024-09-18T05:14:07.588194+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:14:07.588194+0000","last_undegraded":"2024-09-18T05:14:07.588194+0000","last_fullsized":"2024-09-18T05:14:07.588194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063229599999999996,"stat_sum":{"num_bytes":6445722,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":12,"num_read":2217,"num_read_kb":5807,"num_write":438,"num_write_kb":2729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":353054651,"num_objects":534,"num_object_clones":118,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":534,"num_whiteouts":259,"num_read":31554,"num_read_kb":202988,"num_write":5557,"num_write_kb":87632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15065088,"data_stored":161776974,"data_compressed":9265200,"data_compressed_allocated":9830400,"data_compressed_original":157046776,"omap_allocated":0,"internal_metadata":0},"log_size":4329,"ondisk_log_size":4329,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":2764800,"data_stored":24431298,"data_compressed":1423228,"data_compressed_allocated":1449984,"data_compressed_original":23457893,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1097728,"data_stored":7440649,"data_compressed":399589,"data_compressed_allocated":552960,"data_compressed_original":7167476,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33624,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338216,"statfs":{"total":96636764160,"available":96602333184,"internally_reserved":0,"allocated":2568192,"data_stored":22622411,"data_compressed":1228183,"data_compressed_allocated":1437696,"data_compressed_original":21857005,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34076,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337764,"statfs":{"total":96636764160,"available":96601870336,"internally_reserved":0,"allocated":3035136,"data_stored":27884605,"data_compressed":1741747,"data_compressed_allocated":1896448,"data_compressed_original":27132282,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42512,"kb_used_data":3204,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329328,"statfs":{"total":96636764160,"available":96593231872,"internally_reserved":0,"allocated":3280896,"data_stored":31404381,"data_compressed":1679371,"data_compressed_allocated":1757184,"data_compressed_original":30089853,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":839680,"data_stored":5760365,"data_compressed":343329,"data_compressed_allocated":253952,"data_compressed_original":5455872,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37136,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334704,"statfs":{"total":96636764160,"available":96598736896,"internally_reserved":0,"allocated":1970176,"data_stored":19160728,"data_compressed":1080463,"data_compressed_allocated":983040,"data_compressed_original":18347636,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38012,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94333828,"statfs":{"total":96636764160,"available":96597839872,"internally_reserved":0,"allocated":2867200,"data_stored":25654963,"data_compressed":1440807,"data_compressed_allocated":1609728,"data_compressed_original":24767559,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2342912,"data_stored":24829352,"data_compressed":1406226,"data_compressed_allocated":1560576,"data_compressed_original":24177735,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1564672,"data_stored":18995746,"data_compressed":1080463,"data_compressed_allocated":983040,"data_compressed_original":18347636,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":5595402,"data_compressed":342544,"data_compressed_allocated":249856,"data_compressed_original":5439488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2895872,"data_stored":31255802,"data_compressed":1679371,"data_compressed_allocated":1757184,"data_compressed_original":30089853,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2658304,"data_stored":27717809,"data_compressed":1740177,"data_compressed_allocated":1888256,"data_compressed_original":27099514,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2179072,"data_stored":22473206,"data_compressed":1228183,"data_compressed_allocated":1437696,"data_compressed_original":21857005,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":684032,"data_stored":7261417,"data_compressed":399589,"data_compressed_allocated":552960,"data_compressed_original":7167476,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2289664,"data_stored":23648240,"data_compressed":1388647,"data_compressed_allocated":1400832,"data_compressed_original":22868069,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:14:11.387 INFO:tasks.thrashosds.thrasher:Setting 3.f to [7, 3, 2, 6] 2024-09-18T05:14:11.387 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.f', '7', '3', '2', '6'] 2024-09-18T05:14:11.387 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.f 7 3 2 6 2024-09-18T05:14:11.396 INFO:teuthology.orchestra.run.smithi017.stdout:1482 punch from 0x608bef1 to 0x6097e8e, (0xbf9d bytes) 2024-09-18T05:14:11.397 INFO:teuthology.orchestra.run.smithi017.stdout:1483 read 0xba9adb2 thru 0xbaa6658 (0xb8a7 bytes) 2024-09-18T05:14:11.397 INFO:teuthology.orchestra.run.smithi017.stdout:1484 read 0x74661a0 thru 0x746fec1 (0x9d22 bytes) 2024-09-18T05:14:11.397 INFO:teuthology.orchestra.run.smithi017.stdout:1485 writesame 0x9e45c75 thru 0x9e5449e data_size 0x1(0xe82a bytes) 2024-09-18T05:14:11.452 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16825 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1474560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.227461069, 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026210823000000001, 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16825 2024-09-18T05:14:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219596+0000", 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219602+0000", 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999999e-06 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219620+0000", 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7920000000000001e-05 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219633+0000", 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3113e-05 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245513+0000", 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025879669000000001 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245662+0000", 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149009 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245807+0000", 2024-09-18T05:14:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145589 2024-09-18T05:14:11.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16826 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.227411713, 2024-09-18T05:14:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026570620999999999, 2024-09-18T05:14:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16826 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219645+0000", 2024-09-18T05:14:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219652+0000", 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4570000000000002e-06 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219670+0000", 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8295999999999999e-05 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219704+0000", 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4536000000000003e-05 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245864+0000", 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026159953 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246030+0000", 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016550899999999999 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246217+0000", 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018675300000000001 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16885 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2752512~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.225662979999999, 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026057257, 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16885 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:11.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221394+0000", 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221400+0000", 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.533e-06 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221418+0000", 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8029999999999998e-05 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221432+0000", 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3453e-05 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247088+0000", 2024-09-18T05:14:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025655971999999999 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247255+0000", 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167066 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247452+0000", 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019720600000000001 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.468 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16886 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.468 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:11.468 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.225614200000001, 2024-09-18T05:14:11.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026360268999999999, 2024-09-18T05:14:11.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16886 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221442+0000", 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221455+0000", 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2116000000000001e-05 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221472+0000", 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.787e-05 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221486+0000", 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3573e-05 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247512+0000", 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026025942999999999 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247647+0000", 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000134859 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247804+0000", 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015688099999999999 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16887 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.225559441, 2024-09-18T05:14:11.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026704731999999998, 2024-09-18T05:14:11.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.474 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16887 2024-09-18T05:14:11.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.474 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221497+0000", 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221503+0000", 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2700000000000001e-06 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221522+0000", 2024-09-18T05:14:11.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:14:11.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221535+0000", 2024-09-18T05:14:11.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3556e-05 2024-09-18T05:14:11.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247862+0000", 2024-09-18T05:14:11.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026326385000000001 2024-09-18T05:14:11.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248014+0000", 2024-09-18T05:14:11.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152168 2024-09-18T05:14:11.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248203+0000", 2024-09-18T05:14:11.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000189276 2024-09-18T05:14:11.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.479 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.480 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16888 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.480 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:11.480 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.225509413999999, 2024-09-18T05:14:11.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027263773000000002, 2024-09-18T05:14:11.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16888 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221547+0000", 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221554+0000", 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1430000000000001e-06 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221572+0000", 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7609999999999999e-05 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221585+0000", 2024-09-18T05:14:11.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2639999999999999e-05 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248308+0000", 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026723558000000001 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248546+0000", 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000237741 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248812+0000", 2024-09-18T05:14:11.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026612100000000002 2024-09-18T05:14:11.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.486 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16889 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.486 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:11.487 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.225461104000001, 2024-09-18T05:14:11.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027689516000000001, 2024-09-18T05:14:11.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16889 2024-09-18T05:14:11.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.488 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:11.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:11.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221595+0000", 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221602+0000", 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0169999999999999e-06 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221621+0000", 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8386e-05 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221634+0000", 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.341e-05 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248882+0000", 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027247771 2024-09-18T05:14:11.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249066+0000", 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018403000000000001 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249286+0000", 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219986 2024-09-18T05:14:11.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16890 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.225412059, 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028101418999999999, 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16890 2024-09-18T05:14:11.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.494 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:11.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221645+0000", 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221650+0000", 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7939999999999999e-06 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221667+0000", 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6616000000000002e-05 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221680+0000", 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2663999999999999e-05 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249351+0000", 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027670808000000002 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249539+0000", 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000188505 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249747+0000", 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020795199999999999 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.500 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16947 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2654208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.224233368, 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027363044999999999, 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16947 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222822+0000", 2024-09-18T05:14:11.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222856+0000", 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316999999999997e-05 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222891+0000", 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4273000000000002e-05 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222914+0000", 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3119e-05 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249808+0000", 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026894668 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249979+0000", 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017036699999999999 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250187+0000", 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020850400000000001 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16948 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.224123622, 2024-09-18T05:14:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027712835000000002, 2024-09-18T05:14:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16948 2024-09-18T05:14:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222933+0000", 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222941+0000", 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2330000000000006e-06 2024-09-18T05:14:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222961+0000", 2024-09-18T05:14:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9933999999999999e-05 2024-09-18T05:14:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222976+0000", 2024-09-18T05:14:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5486e-05 2024-09-18T05:14:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250249+0000", 2024-09-18T05:14:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027272951 2024-09-18T05:14:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250424+0000", 2024-09-18T05:14:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017490999999999999 2024-09-18T05:14:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250647+0000", 2024-09-18T05:14:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000222761 2024-09-18T05:14:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16949 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.224068388999999, 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028222578000000002, 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16949 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222988+0000", 2024-09-18T05:14:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222995+0000", 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7059999999999998e-06 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223013+0000", 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8267e-05 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223027+0000", 2024-09-18T05:14:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3852999999999999e-05 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250733+0000", 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027705456 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250935+0000", 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020255800000000001 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251212+0000", 2024-09-18T05:14:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027678400000000003 2024-09-18T05:14:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16950 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.224018049, 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028659265999999999, 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16950 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223039+0000", 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223045+0000", 2024-09-18T05:14:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1500000000000004e-06 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223062+0000", 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223076+0000", 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3495999999999999e-05 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251277+0000", 2024-09-18T05:14:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028201066 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251460+0000", 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018261199999999999 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251699+0000", 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000239359 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16951 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.223969656, 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029073671999999998, 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16951 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223087+0000", 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223093+0000", 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.003e-06 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223110+0000", 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7024000000000002e-05 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223124+0000", 2024-09-18T05:14:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3682999999999999e-05 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251760+0000", 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028636582000000001 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251957+0000", 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019702399999999999 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252162+0000", 2024-09-18T05:14:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020431299999999999 2024-09-18T05:14:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16952 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.223919972999999, 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029652123999999998, 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16952 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223136+0000", 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223143+0000", 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9600000000000003e-06 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223160+0000", 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.721e-05 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223173+0000", 2024-09-18T05:14:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2486e-05 2024-09-18T05:14:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252238+0000", 2024-09-18T05:14:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029065160999999999 2024-09-18T05:14:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252459+0000", 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022082100000000001 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252790+0000", 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033094299999999999 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16953 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.22387391, 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030055742999999999, 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16953 2024-09-18T05:14:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223183+0000", 2024-09-18T05:14:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223188+0000", 2024-09-18T05:14:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223205+0000", 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6359999999999999e-05 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223217+0000", 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2296000000000001e-05 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252853+0000", 2024-09-18T05:14:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029636077 2024-09-18T05:14:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253035+0000", 2024-09-18T05:14:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018143900000000001 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253239+0000", 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000204878 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16954 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.223830734, 2024-09-18T05:14:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030518435, 2024-09-18T05:14:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16954 2024-09-18T05:14:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223226+0000", 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223231+0000", 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9529999999999998e-06 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223249+0000", 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7754e-05 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223261+0000", 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.198e-05 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253312+0000", 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030051123999999999 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253507+0000", 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019456700000000001 2024-09-18T05:14:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253745+0000", 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023878699999999999 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17135 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.217380647000001, 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026407401, 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17135 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229676+0000", 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229683+0000", 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0400000000000004e-06 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229701+0000", 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8182999999999999e-05 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229714+0000", 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3193000000000001e-05 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255689+0000", 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025974962000000001 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255873+0000", 2024-09-18T05:14:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018339300000000001 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256084+0000", 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021176999999999999 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17136 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.217332351, 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026860747000000001, 2024-09-18T05:14:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17136 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229724+0000", 2024-09-18T05:14:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229730+0000", 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6629999999999998e-06 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229746+0000", 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6293000000000001e-05 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229759+0000", 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2747e-05 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256148+0000", 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026389072999999999 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256345+0000", 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019683799999999999 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256586+0000", 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024106999999999999 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17137 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.217287882000001, 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027322796999999999, 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17137 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229769+0000", 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229775+0000", 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6169999999999998e-06 2024-09-18T05:14:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229791+0000", 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6126000000000001e-05 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229804+0000", 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2917e-05 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256654+0000", 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026850816 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256857+0000", 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020282399999999999 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257093+0000", 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023535 2024-09-18T05:14:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17138 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.217242038, 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027760476999999999, 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17138 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229815+0000", 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229820+0000", 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7729999999999996e-06 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229838+0000", 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7113e-05 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229850+0000", 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2320000000000001e-05 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257154+0000", 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027304357000000001 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257348+0000", 2024-09-18T05:14:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000193322 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257576+0000", 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000228569 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:11.564 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:11.565 INFO:teuthology.orchestra.run.smithi017.stdout:1486 read 0x3b6632d thru 0x3b7460c (0xe2e0 bytes) 2024-09-18T05:14:11.565 INFO:teuthology.orchestra.run.smithi017.stdout:1487 writesame 0x7675338 thru 0x7682f65 data_size 0x1(0xdc2e bytes) 2024-09-18T05:14:11.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:11.569 INFO:teuthology.orchestra.run.smithi017.stdout:1488 write 0x75cf82a thru 0x75d317d (0x3954 bytes) 2024-09-18T05:14:11.569 INFO:teuthology.orchestra.run.smithi017.stdout:1489 write 0xb81ae5c thru 0xb81b5e5 (0x78a bytes) 2024-09-18T05:14:11.569 INFO:teuthology.orchestra.run.smithi017.stdout:1492 read 0x81c0b47 thru 0x81cbd94 (0xb24e bytes) 2024-09-18T05:14:11.569 INFO:teuthology.orchestra.run.smithi017.stdout:1493 read 0x9ad1794 thru 0x9ad3821 (0x208e bytes) 2024-09-18T05:14:11.569 INFO:teuthology.orchestra.run.smithi017.stdout:1494 write 0x33bf180 thru 0x33cdb90 (0xea11 bytes) 2024-09-18T05:14:11.569 INFO:teuthology.orchestra.run.smithi017.stdout:1495 read 0x2f956b4 thru 0x2f9b7be (0x610b bytes) 2024-09-18T05:14:11.569 INFO:teuthology.orchestra.run.smithi017.stdout:1496 read 0x39a0c65 thru 0x39ab1df (0xa57b bytes) 2024-09-18T05:14:11.569 INFO:teuthology.orchestra.run.smithi017.stdout:1497 punch from 0x98753ab to 0x9879d84, (0x49d9 bytes) 2024-09-18T05:14:11.569 INFO:teuthology.orchestra.run.smithi017.stdout:1499 read 0x371e040 thru 0x37230ce (0x508f bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1500 read 0x9e2979d thru 0x9e2aeed (0x1751 bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1503 read 0x585f551 thru 0x58632c9 (0x3d79 bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1505 punch from 0x2682c22 to 0x2687d59, (0x5137 bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1506 writesame 0x6252855 thru 0x625858d data_size 0x2b(0x5d39 bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1507 write 0x281e1d9 thru 0x2820718 (0x2540 bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1508 write 0xd5125dd thru 0xd518d74 (0x6798 bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1509 read 0x94816ba thru 0x94860a6 (0x49ed bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1510 writesame 0xeea533 thru 0xeecf20 data_size 0x3(0x29ee bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1511 write 0x32f786a thru 0x32fc13c (0x48d3 bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1512 punch from 0xd6df4fe to 0xd6e7069, (0x7b6b bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1513 punch from 0xd7add77 to 0xd7b824d, (0xa4d6 bytes) 2024-09-18T05:14:11.570 INFO:teuthology.orchestra.run.smithi017.stdout:1514 write 0x7d3a994 thru 0x7d49373 (0xe9e0 bytes) 2024-09-18T05:14:11.571 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:11.558+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:11.578 INFO:teuthology.orchestra.run.smithi017.stdout:1515 trunc from 0xe6cb482 to 0x5b410a3 2024-09-18T05:14:11.600 INFO:teuthology.orchestra.run.smithi017.stdout:1516 read 0x1941fb0 thru 0x194e7f8 (0xc849 bytes) 2024-09-18T05:14:11.602 INFO:teuthology.orchestra.run.smithi017.stdout:1517 read 0x350dbad thru 0x351b75e (0xdbb2 bytes) 2024-09-18T05:14:11.602 INFO:teuthology.orchestra.run.smithi017.stdout:1519 punch from 0x3ac4780 to 0x3acda1d, (0x929d bytes) 2024-09-18T05:14:11.603 INFO:teuthology.orchestra.run.smithi017.stdout:1520 punch from 0x49dd373 to 0x49de1c7, (0xe54 bytes) 2024-09-18T05:14:11.603 INFO:teuthology.orchestra.run.smithi017.stdout:1521 punch from 0x3fb24eb to 0x3fbaed0, (0x89e5 bytes) 2024-09-18T05:14:11.603 INFO:teuthology.orchestra.run.smithi017.stdout:1522 read 0x21c6dd2 thru 0x21d30ea (0xc319 bytes) 2024-09-18T05:14:11.603 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.609 INFO:teuthology.orchestra.run.smithi017.stdout:1525 trunc from 0x5b410a3 to 0xb495cf7 2024-09-18T05:14:11.617 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.626 INFO:teuthology.orchestra.run.smithi017.stdout:1528 trunc from 0xb495cf7 to 0x4be3598 2024-09-18T05:14:11.644 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.661 INFO:teuthology.orchestra.run.smithi017.stdout:1532 write 0xa8d0b98 thru 0xa8d2df2 (0x225b bytes) 2024-09-18T05:14:11.667 INFO:teuthology.orchestra.run.smithi017.stdout:1533 read 0x15f8daa thru 0x1601f92 (0x91e9 bytes) 2024-09-18T05:14:11.667 INFO:teuthology.orchestra.run.smithi017.stdout:1536 read 0x72c6435 thru 0x72d5646 (0xf212 bytes) 2024-09-18T05:14:11.667 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:11.662+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:11.668 INFO:teuthology.orchestra.run.smithi017.stdout:1539 writesame 0x8dc8bd3 thru 0x8dd024f data_size 0x1(0x767d bytes) 2024-09-18T05:14:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:1542 read 0x206bee3 thru 0x2070ef5 (0x5013 bytes) 2024-09-18T05:14:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:1544 read 0x874a944 thru 0x874e8af (0x3f6c bytes) 2024-09-18T05:14:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:1545 write 0xd59a28 thru 0xd61832 (0x7e0b bytes) 2024-09-18T05:14:11.690 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.690 INFO:teuthology.orchestra.run.smithi017.stdout:1548 write 0x855f90f thru 0x856d333 (0xda25 bytes) 2024-09-18T05:14:11.711 INFO:teuthology.orchestra.run.smithi017.stdout:1549 write 0xe70a9d2 thru 0xe71670c (0xbd3b bytes) 2024-09-18T05:14:11.713 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:11.713 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.724 INFO:teuthology.orchestra.run.smithi017.stdout:1552 trunc from 0xe71670d to 0x9a3d070 2024-09-18T05:14:11.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:11.754 INFO:teuthology.orchestra.run.smithi017.stdout:1554 write 0xc463e69 thru 0xc46a0e3 (0x627b bytes) 2024-09-18T05:14:11.758 INFO:teuthology.orchestra.run.smithi017.stdout:1555 read 0x2404915 thru 0x240d510 (0x8bfc bytes) 2024-09-18T05:14:11.770 INFO:teuthology.orchestra.run.smithi017.stdout:1557 write 0xdfebae6 thru 0xdfed37a (0x1895 bytes) 2024-09-18T05:14:11.771 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:11.766+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:11.798 INFO:teuthology.orchestra.run.smithi017.stdout:1558 trunc from 0xdfed37b to 0xd67e72 2024-09-18T05:14:11.822 INFO:teuthology.orchestra.run.smithi017.stdout:1559 read 0x47682b thru 0x47d62a (0x6e00 bytes) 2024-09-18T05:14:11.823 INFO:teuthology.orchestra.run.smithi017.stdout:1560 punch from 0xad3fb6 to 0xad41a2, (0x1ec bytes) 2024-09-18T05:14:11.823 INFO:teuthology.orchestra.run.smithi017.stdout:1561 trunc from 0xd67e72 to 0x113916e 2024-09-18T05:14:11.832 INFO:teuthology.orchestra.run.smithi017.stdout:1562 writesame 0xb232b2 thru 0xb2a3d5 data_size 0x1a(0x7124 bytes) 2024-09-18T05:14:11.843 INFO:teuthology.orchestra.run.smithi017.stdout:1563 write 0x117dbbb thru 0x117f43d (0x1883 bytes) 2024-09-18T05:14:11.862 INFO:teuthology.orchestra.run.smithi017.stdout:1564 writesame 0x25b15f6 thru 0x25bf4dc data_size 0x17(0xdee7 bytes) 2024-09-18T05:14:11.862 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.862 INFO:teuthology.orchestra.run.smithi017.stdout:1568 writesame 0x14ecfd9 thru 0x14f040e data_size 0x2(0x3436 bytes) 2024-09-18T05:14:11.869 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:11.862+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:1570 clone 12 order 23 su 524288 sc 2 2024-09-18T05:14:11.895 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:11.895 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:11.895 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:11.895 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:11.895 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:11.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:11.996 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:11.990+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:12.070 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:12.062+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:12.080 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:12.080 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:12.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:12.080 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:12.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.080 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.080 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:12.080 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.843419706000001, 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:12.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.085 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.843352096, 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.84330471, 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:12.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:12.094 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.843259304, 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.843214014000001, 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:12.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.100 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:12.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841579463, 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:12.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:12.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:12.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:12.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:12.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:12.109 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841527144000001, 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:12.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:12.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:12.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:12.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:12.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:12.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841409500999999, 2024-09-18T05:14:12.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:12.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:12.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.117 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:12.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:12.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:12.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:12.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:12.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.121 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841347582000001, 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.122 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841289162000001, 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:12.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:12.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841235535999999, 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:12.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:12.135 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841188473000001, 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:12.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:12.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.140 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841128394, 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:12.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.145 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841068107, 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:12.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.841000791000001, 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.151 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:12.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.840952187999999, 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.156 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.160 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.840878569000001, 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:12.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:12.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.165 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.840805086, 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.166 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:12.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.840748496, 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.840702364, 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:12.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:12.181 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.182 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.182 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.182 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:12.183 INFO:teuthology.orchestra.run.smithi017.stderr:set 3.f pg_upmap_items mapping to [7->3,2->6] 2024-09-18T05:14:12.183 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:14:12.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:12.186 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:12.183+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:12.190 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone11 from 0x25bf4dd (overlap 0xd67e72) to 0x405922 2024-09-18T05:14:12.255 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:12.285 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:12.283+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:12.317 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:12.318 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:12.318 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:12.318 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:12.325 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-18T05:14:12.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:12.338 INFO:teuthology.orchestra.run.smithi017.stdout:1571 trunc from 0x25bf4dd to 0x9279296 2024-09-18T05:14:12.357 INFO:teuthology.orchestra.run.smithi017.stdout:1572 read 0x4abf7cd thru 0x4ac056c (0xda0 bytes) 2024-09-18T05:14:12.357 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:12.357 INFO:teuthology.orchestra.run.smithi017.stdout:1574 punch from 0x60d121d to 0x60dffd7, (0xedba bytes) 2024-09-18T05:14:12.357 INFO:teuthology.orchestra.run.smithi017.stdout:1576 read 0x3fed22e thru 0x3ff7c31 (0xaa04 bytes) 2024-09-18T05:14:12.367 INFO:teuthology.orchestra.run.smithi017.stdout:1577 trunc from 0x9279296 to 0x17409d3 2024-09-18T05:14:12.385 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:12.378+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:12.389 INFO:teuthology.orchestra.run.smithi017.stdout:1578 trunc from 0x17409d3 to 0x3452407 2024-09-18T05:14:12.411 INFO:teuthology.orchestra.run.smithi017.stdout:1580 write 0x3ed1256 thru 0x3ed1fec (0xd97 bytes) 2024-09-18T05:14:12.426 INFO:teuthology.orchestra.run.smithi017.stdout:1583 writesame 0x546e139 thru 0x547bd16 data_size 0x9f(0xdbde bytes) 2024-09-18T05:14:12.433 INFO:teuthology.orchestra.run.smithi017.stdout:1585 trunc from 0x547bd17 to 0xa688d9e 2024-09-18T05:14:12.437 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:12.437 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:12.449 INFO:teuthology.orchestra.run.smithi017.stdout:1588 trunc from 0xa688d9e to 0xdacf257 2024-09-18T05:14:12.457 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:12.457 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:12.459 INFO:teuthology.orchestra.run.smithi017.stdout:1589 punch from 0xcdf376d to 0xcdf3eea, (0x77d bytes) 2024-09-18T05:14:12.459 INFO:teuthology.orchestra.run.smithi017.stdout:1590 write 0x96f6d5e thru 0x96f912d (0x23d0 bytes) 2024-09-18T05:14:12.464 INFO:teuthology.orchestra.run.smithi017.stdout:1592 write 0xd118757 thru 0xd127fdb (0xf885 bytes) 2024-09-18T05:14:12.481 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:12.481 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:12.481 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:12.481 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:12.481 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:12.485 INFO:teuthology.orchestra.run.smithi017.stdout:1593 trunc from 0xdacf257 to 0x1a59c3d 2024-09-18T05:14:12.486 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:12.487+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:12.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:12.505 INFO:teuthology.orchestra.run.smithi017.stdout:1594 punch from 0x1465921 to 0x146eb31, (0x9210 bytes) 2024-09-18T05:14:12.505 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:12.516 INFO:teuthology.orchestra.run.smithi017.stdout:1598 trunc from 0x1a59c3d to 0x979c870 2024-09-18T05:14:12.527 INFO:teuthology.orchestra.run.smithi017.stdout:1601 punch from 0x376af6c to 0x376f6f9, (0x478d bytes) 2024-09-18T05:14:12.546 INFO:teuthology.orchestra.run.smithi017.stdout:1602 write 0xeb2cba9 thru 0xeb3a469 (0xd8c1 bytes) 2024-09-18T05:14:12.551 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:12.552 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:12.552 INFO:teuthology.orchestra.run.smithi017.stdout:1605 writesame 0xaaa257e thru 0xaaab924 data_size 0x1(0x93a7 bytes) 2024-09-18T05:14:12.586 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:12.578+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:12.595 INFO:teuthology.orchestra.run.smithi017.stdout:1606 read 0x140c388 thru 0x1418e10 (0xca89 bytes) 2024-09-18T05:14:12.604 INFO:teuthology.orchestra.run.smithi017.stdout:1608 trunc from 0xeb3a46a to 0xad39cfe 2024-09-18T05:14:12.637 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:12.637 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:12.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:12.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:12.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.638 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1059 3.4 e26/22 3:2547571c:::rbd_data.118b4598dbfb.0000000000000108:head v 26'5, mlcod=25'3)", 2024-09-18T05:14:12.638 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:12.638 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.137392717000001, 2024-09-18T05:14:12.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021306210000000001, 2024-09-18T05:14:12.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.638 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:12.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:12.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494008+0000", 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494034+0000", 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5865999999999999e-05 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494066+0000", 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2317999999999998e-05 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494080+0000", 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4482e-05 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494200+0000", 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119744 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494258+0000", 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8082999999999999e-05 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.496043+0000", 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001784887 2024-09-18T05:14:12.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.496140+0000", 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7351999999999999e-05 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1160 3.9 e26/22 3:93ecdcc7:::rbd_data.118b4598dbfb.000000000000005f:head v 26'6, mlcod=26'4)", 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:12.644 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.066966058999999, 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020475789999999999, 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564434+0000", 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564473+0000", 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8977000000000003e-05 2024-09-18T05:14:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564501+0000", 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7582000000000001e-05 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564514+0000", 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3134e-05 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564633+0000", 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011863500000000001 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564699+0000", 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6447999999999998e-05 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.566372+0000", 2024-09-18T05:14:12.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016731459999999999 2024-09-18T05:14:12.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.566484+0000", 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011178799999999999 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1175 3.0 e26/22 3:0163bb0f:::rbd_data.118b4598dbfb.00000000000000ee:head v 26'9, mlcod=26'7)", 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.038809372999999, 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021239800000000001, 2024-09-18T05:14:12.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592590+0000", 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592614+0000", 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3220000000000001e-05 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592670+0000", 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5939000000000001e-05 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592717+0000", 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7647e-05 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592964+0000", 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024644400000000001 2024-09-18T05:14:12.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.593019+0000", 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5457000000000001e-05 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.594550+0000", 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015306510000000001 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.594717+0000", 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016734900000000001 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1432 3.4 e26/22 3:207a8b3d:::rbd_data.118b4598dbfb.000000000000005b:head v 26'7, mlcod=26'5)", 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 20.866320365, 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020916770000000001, 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765080+0000", 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765140+0000", 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0813000000000002e-05 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765182+0000", 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1480000000000003e-05 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765203+0000", 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1126000000000001e-05 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765334+0000", 2024-09-18T05:14:12.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000130636 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765403+0000", 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9096000000000004e-05 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.767072+0000", 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001668861 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.767174+0000", 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000102132 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 20.808965731000001, 2024-09-18T05:14:12.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:12.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:14:12.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1476 3.4 e26/22 3:207a8b3d:::rbd_data.118b4598dbfb.000000000000005b:head v 26'8, mlcod=26'6)", 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:12.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 20.798545942000001, 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022241629999999999, 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832855+0000", 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832871+0000", 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5862000000000002e-05 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832903+0000", 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832919+0000", 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6277e-05 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.833081+0000", 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016194899999999999 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.833154+0000", 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3226000000000007e-05 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834997+0000", 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018433340000000001 2024-09-18T05:14:12.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.835081+0000", 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3354000000000002e-05 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:2097 3.4 e26/22 3:2079477c:::rbd_data.118b4598dbfb.00000000000001d4:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 20.444715799000001, 2024-09-18T05:14:12.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021624840000000001, 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:12.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186684+0000", 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186707+0000", 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2823000000000002e-05 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186756+0000", 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9459999999999997e-05 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186777+0000", 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0809999999999999e-05 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.187161+0000", 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038411000000000001 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.187218+0000", 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7065999999999999e-05 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.188759+0000", 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001540535 2024-09-18T05:14:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.188849+0000", 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0489999999999996e-05 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:9001 3.4 e29/22 3:224b1375:::rbd_data.118beb25b049.0000000000000128:head v 29'42, mlcod=29'40)", 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:12.675 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.669441515000001, 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002309742, 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961959+0000", 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962023+0000", 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3678999999999998e-05 2024-09-18T05:14:12.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962057+0000", 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4606e-05 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962078+0000", 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1109999999999999e-05 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962204+0000", 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125306 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962271+0000", 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7009999999999997e-05 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964181+0000", 2024-09-18T05:14:12.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019100619999999999 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964271+0000", 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9819000000000002e-05 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16114 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'50, mlcod=32'48)", 2024-09-18T05:14:12.680 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.911262915, 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020637609999999999, 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720138+0000", 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720178+0000", 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0635e-05 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720204+0000", 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5660000000000002e-05 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720215+0000", 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1222e-05 2024-09-18T05:14:12.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720390+0000", 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017476300000000001 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720431+0000", 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.108e-05 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.722119+0000", 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016880269999999999 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.722203+0000", 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4419000000000006e-05 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.815327988, 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:14:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.812711191, 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:12.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:12.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:14:12.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:14:12.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16290 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'52, mlcod=32'49)", 2024-09-18T05:14:12.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:12.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.811620487000001, 2024-09-18T05:14:12.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023378159999999999, 2024-09-18T05:14:12.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.697 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:12.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819780+0000", 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819796+0000", 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325999999999999e-05 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819826+0000", 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9583000000000001e-05 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819845+0000", 2024-09-18T05:14:12.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8597000000000002e-05 2024-09-18T05:14:12.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819950+0000", 2024-09-18T05:14:12.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105356 2024-09-18T05:14:12.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820003+0000", 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3295999999999999e-05 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822018+0000", 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020151779999999998 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822120+0000", 2024-09-18T05:14:12.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101316 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.730175679, 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.703 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:14:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:14:12.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:14:12.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.355637986, 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:14:12.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.713 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17196 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'90, mlcod=32'86)", 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.347751404, 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023459290000000001, 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:12.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283650+0000", 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:12.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283663+0000", 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2697999999999999e-05 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283682+0000", 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9012999999999999e-05 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283691+0000", 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7720000000000006e-06 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283777+0000", 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5923999999999999e-05 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283830+0000", 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2320000000000001e-05 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285942+0000", 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002112039 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285997+0000", 2024-09-18T05:14:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5322000000000003e-05 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21826 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'62, mlcod=36'60)", 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3140081639999996, 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002048064, 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.721 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317391+0000", 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317425+0000", 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3492999999999999e-05 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317462+0000", 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7543000000000003e-05 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317480+0000", 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7960000000000001e-05 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317588+0000", 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107654 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317641+0000", 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2675e-05 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.319355+0000", 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017144059999999999 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.319442+0000", 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7349999999999995e-05 2024-09-18T05:14:12.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21886 3.9 e36/22 3:969ecc48:::rbd_data.118ba5d0bdf6.000000000000010b:head v 36'64, mlcod=36'62)", 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.1619108149999997, 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021557630000000002, 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469489+0000", 2024-09-18T05:14:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469514+0000", 2024-09-18T05:14:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5269000000000002e-05 2024-09-18T05:14:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469558+0000", 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.401e-05 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469581+0000", 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2422999999999999e-05 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469722+0000", 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014086900000000001 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469780+0000", 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8362999999999997e-05 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471554+0000", 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001774156 2024-09-18T05:14:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471647+0000", 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3256000000000003e-05 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21891 3.0 e36/22 3:04d4c8a4:::rbd_data.118ba5d0bdf6.0000000000000259:head v 36'100, mlcod=36'98)", 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:12.731 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.1616295210000001, 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022905260000000002, 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469771+0000", 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469789+0000", 2024-09-18T05:14:12.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.821e-05 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469821+0000", 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1335999999999999e-05 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469839+0000", 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-05 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469944+0000", 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104576 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469996+0000", 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2102999999999999e-05 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471954+0000", 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019575980000000001 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472063+0000", 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010984600000000001 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.736 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21892 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'65, mlcod=36'62)", 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.1606654949999999, 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023311389999999999, 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470735+0000", 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470750+0000", 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470788+0000", 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7252999999999997e-05 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470806+0000", 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8105999999999999e-05 2024-09-18T05:14:12.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470949+0000", 2024-09-18T05:14:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014359600000000001 2024-09-18T05:14:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471048+0000", 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8888999999999995e-05 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472956+0000", 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019074820000000001 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.473068+0000", 2024-09-18T05:14:12.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011240599999999999 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.664708804, 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:12.742 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:12.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:14:12.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:14:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:14:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:14:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:14:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:12.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:14:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:14:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:12.748 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:12.748 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:12.749 INFO:teuthology.orchestra.run.smithi017.stdout:1609 trunc from 0xad39cfe to 0x3461958 2024-09-18T05:14:12.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:12.751 INFO:teuthology.orchestra.run.smithi017.stdout:1610 read 0x9cc2a0 thru 0x9ce9bb (0x271c bytes) 2024-09-18T05:14:12.751 INFO:teuthology.orchestra.run.smithi017.stdout:1611 punch from 0x16cf194 to 0x16db592, (0xc3fe bytes) 2024-09-18T05:14:12.751 INFO:teuthology.orchestra.run.smithi017.stdout:1612 punch from 0x26f66a3 to 0x26fa746, (0x40a3 bytes) 2024-09-18T05:14:12.751 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:12.751 INFO:teuthology.orchestra.run.smithi017.stdout:1617 trunc from 0x3461958 to 0xa7d7be9 2024-09-18T05:14:12.752 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:12.752 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:12.753 INFO:teuthology.orchestra.run.smithi017.stdout:1618 read 0x6a5c4c4 thru 0x6a6888b (0xc3c8 bytes) 2024-09-18T05:14:12.753 INFO:teuthology.orchestra.run.smithi017.stdout:1619 trunc from 0xa7d7be9 to 0xca76c27 2024-09-18T05:14:12.753 INFO:teuthology.orchestra.run.smithi017.stdout:1620 clone 13 order 23 su 262144 sc 15 2024-09-18T05:14:12.753 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:12.753 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:12.754 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:12.754 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:12.754 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:12.747+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:12.763 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:12.790 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:12.790 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:12.817 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:12.818 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:12.851 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:12.851+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:12.887 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:12.887 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:12.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:12.952 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:12.951+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:13.027 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:13.027 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:13.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:13.053 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:13.051+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:13.153 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:13.151+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:13.183 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:13.184 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:13.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:13.253 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone12 from 0xca76c27 (overlap 0x17409d3) to 0x94d0ba 2024-09-18T05:14:13.254 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:13.246+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:13.333 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:13.333 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:13.346 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:13.355 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:13.350+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:13.456 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:13.455+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:13.466 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:13.466 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:13.481 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:13.520 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-18T05:14:13.538 INFO:teuthology.orchestra.run.smithi017.stdout:1621 read 0x3500bc9 thru 0x350735e (0x6796 bytes) 2024-09-18T05:14:13.539 INFO:teuthology.orchestra.run.smithi017.stdout:1623 read 0x2ee43bb thru 0x2eedf69 (0x9baf bytes) 2024-09-18T05:14:13.540 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:13.540 INFO:teuthology.orchestra.run.smithi017.stdout:1627 writesame 0x70a7802 thru 0x70aeced data_size 0xe(0x74ec bytes) 2024-09-18T05:14:13.560 INFO:teuthology.orchestra.run.smithi017.stdout:1628 punch from 0x29a8944 to 0x29b2fad, (0xa669 bytes) 2024-09-18T05:14:13.560 INFO:teuthology.orchestra.run.smithi017.stdout:1630 write 0x3ba4da6 thru 0x3bb07e1 (0xba3c bytes) 2024-09-18T05:14:13.566 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:13.567+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:13.569 INFO:teuthology.orchestra.run.smithi017.stdout:1631 writesame 0x92248b7 thru 0x9228f7a data_size 0x7(0x46c4 bytes) 2024-09-18T05:14:13.576 INFO:teuthology.orchestra.run.smithi017.stdout:1632 writesame 0x981eed7 thru 0x9827a13 data_size 0x1(0x8b3d bytes) 2024-09-18T05:14:13.620 INFO:teuthology.orchestra.run.smithi017.stdout:1633 read 0x72c70d9 thru 0x72d5272 (0xe19a bytes) 2024-09-18T05:14:13.620 INFO:teuthology.orchestra.run.smithi017.stdout:1634 writesame 0xa499cc thru 0xa58e44 data_size 0x1(0xf479 bytes) 2024-09-18T05:14:13.642 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:13.643 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:13.657 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:13.701 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:13.699+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:13.759 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:13.754+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:13.827 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:13.827 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:13.841 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:13.886 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:13.887+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:13.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:13.954+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:13.962 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:13.962 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:13.976 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:14.062 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:14.063+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:14.143 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:14.143 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:14.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:14.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:14:14.199 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:14.199+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:14.264 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:14.258+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:14.321 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:14.322 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:14.335 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:14.335 INFO:teuthology.orchestra.run.smithi017.stdout:1636 read 0xff90b4 thru 0x1006077 (0xcfc4 bytes) 2024-09-18T05:14:14.336 INFO:teuthology.orchestra.run.smithi017.stdout:1637 read 0x731074f thru 0x7313752 (0x3004 bytes) 2024-09-18T05:14:14.336 INFO:teuthology.orchestra.run.smithi017.stdout:1638 punch from 0x3ef98cd to 0x3f09134, (0xf867 bytes) 2024-09-18T05:14:14.337 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:14:14.339 INFO:teuthology.orchestra.run.smithi017.stdout:1639 trunc from 0xca76c27 to 0xe9f3363 2024-09-18T05:14:14.346 INFO:teuthology.orchestra.run.smithi017.stdout:1641 punch from 0x5bed24 to 0x5c1101, (0x23dd bytes) 2024-09-18T05:14:14.346 INFO:teuthology.orchestra.run.smithi017.stdout:1642 write 0xe2d39bc thru 0xe2d4c01 (0x1246 bytes) 2024-09-18T05:14:14.367 INFO:teuthology.orchestra.run.smithi017.stdout:1643 trunc from 0xe9f3363 to 0x574c440 2024-09-18T05:14:14.387 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:14.387+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:1644 punch from 0x4d1f26d to 0x4d2391b, (0x46ae bytes) 2024-09-18T05:14:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:1647 read 0x2f56ca4 thru 0x2f5c3c2 (0x571f bytes) 2024-09-18T05:14:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:1648 read 0x6bbd8b thru 0x6c959a (0xd810 bytes) 2024-09-18T05:14:14.427 INFO:teuthology.orchestra.run.smithi017.stdout:1649 write 0xed7d1ef thru 0xed89b47 (0xc959 bytes) 2024-09-18T05:14:14.431 INFO:teuthology.orchestra.run.smithi017.stdout:1650 read 0x43867a7 thru 0x439473d (0xdf97 bytes) 2024-09-18T05:14:14.437 INFO:teuthology.orchestra.run.smithi017.stdout:1651 write 0xedd81af thru 0xede6a03 (0xe855 bytes) 2024-09-18T05:14:14.440 INFO:teuthology.orchestra.run.smithi017.stdout:1652 read 0xdefe290 thru 0xdf0ae24 (0xcb95 bytes) 2024-09-18T05:14:14.441 INFO:teuthology.orchestra.run.smithi017.stdout:1654 read 0xbc5d96e thru 0xbc6166d (0x3d00 bytes) 2024-09-18T05:14:14.441 INFO:teuthology.orchestra.run.smithi017.stdout:1655 write 0x7dd23ff thru 0x7dd9f85 (0x7b87 bytes) 2024-09-18T05:14:14.445 INFO:teuthology.orchestra.run.smithi017.stdout:1657 write 0x356d929 thru 0x357a89e (0xcf76 bytes) 2024-09-18T05:14:14.447 INFO:teuthology.orchestra.run.smithi017.stdout:1658 punch from 0x43a9647 to 0x43aa3ec, (0xda5 bytes) 2024-09-18T05:14:14.453 INFO:teuthology.orchestra.run.smithi017.stdout:1659 trunc from 0xede6a04 to 0xad04ab8 2024-09-18T05:14:14.463 INFO:teuthology.orchestra.run.smithi017.stdout:1660 write 0x22e62f9 thru 0x22e9eca (0x3bd2 bytes) 2024-09-18T05:14:14.464 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:14.464 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:14.466 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:14.458+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:1661 punch from 0x35932da to 0x35933e7, (0x10d bytes) 2024-09-18T05:14:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:1662 read 0x91805eb thru 0x9183b83 (0x3599 bytes) 2024-09-18T05:14:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:1665 read 0xdae70b thru 0xdb9046 (0xa93c bytes) 2024-09-18T05:14:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:1666 write 0x75995be thru 0x75a7ce9 (0xe72c bytes) 2024-09-18T05:14:14.479 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:14:14.480 INFO:teuthology.orchestra.run.smithi017.stdout:1667 write 0xbfb8199 thru 0xbfbd70b (0x5573 bytes) 2024-09-18T05:14:14.489 INFO:teuthology.orchestra.run.smithi017.stdout:1668 trunc from 0xbfbd70c to 0x8b91a5e 2024-09-18T05:14:14.500 INFO:teuthology.orchestra.run.smithi017.stdout:1669 write 0x7c610df thru 0x7c63cc6 (0x2be8 bytes) 2024-09-18T05:14:14.514 INFO:teuthology.orchestra.run.smithi017.stdout:1670 write 0x8ca8186 thru 0x8cb7382 (0xf1fd bytes) 2024-09-18T05:14:14.518 INFO:teuthology.orchestra.run.smithi017.stdout:1672 read 0x80e87f4 thru 0x80f14df (0x8cec bytes) 2024-09-18T05:14:14.519 INFO:teuthology.orchestra.run.smithi017.stdout:1673 punch from 0x5e5f962 to 0x5e620cf, (0x276d bytes) 2024-09-18T05:14:14.531 INFO:teuthology.orchestra.run.smithi017.stdout:1674 writesame 0xb1b1d10 thru 0xb1bc964 data_size 0x1(0xac55 bytes) 2024-09-18T05:14:14.532 INFO:teuthology.orchestra.run.smithi017.stdout:1675 read 0x76ed982 thru 0x76f073f (0x2dbe bytes) 2024-09-18T05:14:14.533 INFO:teuthology.orchestra.run.smithi017.stdout:1676 punch from 0xa5cbde1 to 0xa5daa20, (0xec3f bytes) 2024-09-18T05:14:14.542 INFO:teuthology.orchestra.run.smithi017.stdout:1677 write 0xbc38fa9 thru 0xbc40a50 (0x7aa8 bytes) 2024-09-18T05:14:14.546 INFO:teuthology.orchestra.run.smithi017.stdout:1680 read 0x430dad1 thru 0x430ff6c (0x249c bytes) 2024-09-18T05:14:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:1681 trunc from 0xbc40a51 to 0x1b7cc7a 2024-09-18T05:14:14.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:14.558+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:14.587 INFO:teuthology.orchestra.run.smithi017.stdout:1683 write 0x2d706e thru 0x2e14cd (0xa460 bytes) 2024-09-18T05:14:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:1687 punch from 0xaf4bfb to 0xafef4d, (0xa352 bytes) 2024-09-18T05:14:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:1689 read 0x4481ff thru 0x44afc3 (0x2dc5 bytes) 2024-09-18T05:14:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:1690 read 0x1b4ad1f thru 0x1b5a179 (0xf45b bytes) 2024-09-18T05:14:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:1691 trunc from 0x1b7cc7a to 0xcde6bec 2024-09-18T05:14:14.616 INFO:teuthology.orchestra.run.smithi017.stdout:1692 read 0x5b81ba6 thru 0x5b90a4f (0xeeaa bytes) 2024-09-18T05:14:14.617 INFO:teuthology.orchestra.run.smithi017.stdout:1693 punch from 0x36bb9d7 to 0x36bbe73, (0x49c bytes) 2024-09-18T05:14:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:1694 trunc from 0xcde6bec to 0x54b42bb 2024-09-18T05:14:14.643 INFO:teuthology.orchestra.run.smithi017.stdout:1695 read 0x39f9e3e thru 0x3a09060 (0xf223 bytes) 2024-09-18T05:14:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:1697 read 0x2f5a1bf thru 0x2f682ba (0xe0fc bytes) 2024-09-18T05:14:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:1698 trunc from 0x54b42bb to 0x88e1bc7 2024-09-18T05:14:14.654 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:14.654 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:14.661 INFO:teuthology.orchestra.run.smithi017.stdout:1699 trunc from 0x88e1bc7 to 0x86f5ff1 2024-09-18T05:14:14.667 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:14.662+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:14.668 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:14.669 INFO:teuthology.orchestra.run.smithi017.stdout:1701 write 0x5a66251 thru 0x5a6fbcd (0x997d bytes) 2024-09-18T05:14:14.673 INFO:teuthology.orchestra.run.smithi017.stdout:1704 flatten 2024-09-18T05:14:14.685 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:14.688 INFO:teuthology.orchestra.run.smithi017.stdout:1708 trunc from 0x86f5ff1 to 0xa0d396f 2024-09-18T05:14:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:1710 write 0xb1b7ed3 thru 0xb1c1dbd (0x9eeb bytes) 2024-09-18T05:14:14.727 INFO:teuthology.orchestra.run.smithi017.stdout:1711 read 0x747ffb6 thru 0x74878a3 (0x78ee bytes) 2024-09-18T05:14:14.762 INFO:teuthology.orchestra.run.smithi017.stdout:1713 trunc from 0xb1c1dbe to 0xbab4b 2024-09-18T05:14:14.768 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:14.762+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:14.796 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:14.796 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:14.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:14.839 INFO:teuthology.orchestra.run.smithi017.stdout:1714 read 0x37031 thru 0x3889a (0x186a bytes) 2024-09-18T05:14:14.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:14.856 INFO:teuthology.orchestra.run.smithi017.stdout:1715 write 0x228532f thru 0x228fdc7 (0xaa99 bytes) 2024-09-18T05:14:14.862 INFO:teuthology.orchestra.run.smithi017.stdout:1717 punch from 0x52b736 to 0x53a386, (0xec50 bytes) 2024-09-18T05:14:14.869 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:14.867+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:14:14.873 INFO:teuthology.orchestra.run.smithi017.stdout:1718 write 0x287c60e thru 0x2884e63 (0x8856 bytes) 2024-09-18T05:14:14.937 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:14.937 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:14.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:14.995 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:14.995+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:15.001 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:15.002 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:15.018 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:15.034 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:15.034 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:15.050 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:15.050 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:15.067 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:15.067 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:15.072 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:15.071+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:15.084 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:15.085 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:15.106 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:15.106 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:15.117 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:15.118 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:15.125 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:15.125 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:15.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:15.187 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:15.182+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:15.250 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:15.250 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:15.250 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:15.250 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:15.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:15.307 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:15.302+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:15.377 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:15.370+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:15.433 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:15.433 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:15.433 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:15.434 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:15.434 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:15.448 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:15.474 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:15.474+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16825 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1474560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.348028919000001, 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026210823000000001, 2024-09-18T05:14:15.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16825 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219596+0000", 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219602+0000", 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999999e-06 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219620+0000", 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7920000000000001e-05 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219633+0000", 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3113e-05 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245513+0000", 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025879669000000001 2024-09-18T05:14:15.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245662+0000", 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149009 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245807+0000", 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145589 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16826 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.347979562999999, 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026570620999999999, 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16826 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219645+0000", 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219652+0000", 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4570000000000002e-06 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219670+0000", 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8295999999999999e-05 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219704+0000", 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4536000000000003e-05 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245864+0000", 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026159953 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246030+0000", 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016550899999999999 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246217+0000", 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018675300000000001 2024-09-18T05:14:15.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16885 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2752512~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.34623083, 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026057257, 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16885 2024-09-18T05:14:15.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221394+0000", 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221400+0000", 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.533e-06 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221418+0000", 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8029999999999998e-05 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221432+0000", 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3453e-05 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247088+0000", 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025655971999999999 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247255+0000", 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167066 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247452+0000", 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019720600000000001 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.587 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16886 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.346182049999999, 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026360268999999999, 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16886 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221442+0000", 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221455+0000", 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2116000000000001e-05 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221472+0000", 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.787e-05 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221486+0000", 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3573e-05 2024-09-18T05:14:15.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247512+0000", 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026025942999999999 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247647+0000", 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000134859 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247804+0000", 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015688099999999999 2024-09-18T05:14:15.591 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16887 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.346127291, 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026704731999999998, 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16887 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221497+0000", 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221503+0000", 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2700000000000001e-06 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221522+0000", 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221535+0000", 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3556e-05 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247862+0000", 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026326385000000001 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248014+0000", 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152168 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248203+0000", 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000189276 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16888 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.346077264, 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027263773000000002, 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16888 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:15.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221547+0000", 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221554+0000", 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1430000000000001e-06 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221572+0000", 2024-09-18T05:14:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7609999999999999e-05 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221585+0000", 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2639999999999999e-05 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248308+0000", 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026723558000000001 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248546+0000", 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000237741 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248812+0000", 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026612100000000002 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16889 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:15.600 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.346028953999999, 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027689516000000001, 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16889 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221595+0000", 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221602+0000", 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0169999999999999e-06 2024-09-18T05:14:15.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221621+0000", 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8386e-05 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221634+0000", 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.341e-05 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248882+0000", 2024-09-18T05:14:15.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027247771 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249066+0000", 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018403000000000001 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249286+0000", 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219986 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16890 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.345979909, 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028101418999999999, 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16890 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221645+0000", 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221650+0000", 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7939999999999999e-06 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221667+0000", 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6616000000000002e-05 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221680+0000", 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2663999999999999e-05 2024-09-18T05:14:15.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249351+0000", 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027670808000000002 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249539+0000", 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000188505 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249747+0000", 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020795199999999999 2024-09-18T05:14:15.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16947 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2654208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.344801218000001, 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027363044999999999, 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16947 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222822+0000", 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222856+0000", 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316999999999997e-05 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222891+0000", 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4273000000000002e-05 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222914+0000", 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3119e-05 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249808+0000", 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026894668 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249979+0000", 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017036699999999999 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250187+0000", 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020850400000000001 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16948 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.344691471999999, 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027712835000000002, 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16948 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:15.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222933+0000", 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222941+0000", 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2330000000000006e-06 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222961+0000", 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9933999999999999e-05 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222976+0000", 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5486e-05 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250249+0000", 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027272951 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250424+0000", 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017490999999999999 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250647+0000", 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000222761 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16949 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:15.617 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.344636239, 2024-09-18T05:14:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028222578000000002, 2024-09-18T05:14:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16949 2024-09-18T05:14:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.618 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222988+0000", 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222995+0000", 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7059999999999998e-06 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223013+0000", 2024-09-18T05:14:15.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8267e-05 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223027+0000", 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3852999999999999e-05 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250733+0000", 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027705456 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250935+0000", 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020255800000000001 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251212+0000", 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027678400000000003 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16950 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.622 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.344585899, 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028659265999999999, 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16950 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:15.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223039+0000", 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223045+0000", 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1500000000000004e-06 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223062+0000", 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223076+0000", 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3495999999999999e-05 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251277+0000", 2024-09-18T05:14:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028201066 2024-09-18T05:14:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251460+0000", 2024-09-18T05:14:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018261199999999999 2024-09-18T05:14:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251699+0000", 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000239359 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16951 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.344537506, 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029073671999999998, 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16951 2024-09-18T05:14:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223087+0000", 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223093+0000", 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.003e-06 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223110+0000", 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7024000000000002e-05 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223124+0000", 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3682999999999999e-05 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251760+0000", 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028636582000000001 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251957+0000", 2024-09-18T05:14:15.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019702399999999999 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252162+0000", 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020431299999999999 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16952 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.344487823, 2024-09-18T05:14:15.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029652123999999998, 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16952 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223136+0000", 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223143+0000", 2024-09-18T05:14:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9600000000000003e-06 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223160+0000", 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.721e-05 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223173+0000", 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2486e-05 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252238+0000", 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029065160999999999 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252459+0000", 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022082100000000001 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252790+0000", 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033094299999999999 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16953 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.34444176, 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030055742999999999, 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.637 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16953 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223183+0000", 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223188+0000", 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223205+0000", 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6359999999999999e-05 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223217+0000", 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2296000000000001e-05 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252853+0000", 2024-09-18T05:14:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029636077 2024-09-18T05:14:15.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253035+0000", 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018143900000000001 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253239+0000", 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000204878 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16954 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.344398584, 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030518435, 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16954 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223226+0000", 2024-09-18T05:14:15.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223231+0000", 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9529999999999998e-06 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223249+0000", 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7754e-05 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223261+0000", 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.198e-05 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253312+0000", 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030051123999999999 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253507+0000", 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019456700000000001 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253745+0000", 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023878699999999999 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17135 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.647 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.337948496999999, 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026407401, 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17135 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:15.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229676+0000", 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229683+0000", 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0400000000000004e-06 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229701+0000", 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8182999999999999e-05 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229714+0000", 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3193000000000001e-05 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255689+0000", 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025974962000000001 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255873+0000", 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018339300000000001 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256084+0000", 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021176999999999999 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.651 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17136 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.337900201, 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026860747000000001, 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17136 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229724+0000", 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229730+0000", 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6629999999999998e-06 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229746+0000", 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6293000000000001e-05 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229759+0000", 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2747e-05 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256148+0000", 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026389072999999999 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256345+0000", 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019683799999999999 2024-09-18T05:14:15.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256586+0000", 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024106999999999999 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17137 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.337855732, 2024-09-18T05:14:15.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027322796999999999, 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17137 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229769+0000", 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229775+0000", 2024-09-18T05:14:15.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6169999999999998e-06 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229791+0000", 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6126000000000001e-05 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229804+0000", 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2917e-05 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256654+0000", 2024-09-18T05:14:15.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026850816 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256857+0000", 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020282399999999999 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257093+0000", 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023535 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17138 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.337809888000001, 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027760476999999999, 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17138 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.661 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:15.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229815+0000", 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229820+0000", 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7729999999999996e-06 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229838+0000", 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7113e-05 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229850+0000", 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2320000000000001e-05 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257154+0000", 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027304357000000001 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257348+0000", 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000193322 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:15.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257576+0000", 2024-09-18T05:14:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000228569 2024-09-18T05:14:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:15.665 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:15.665 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:15.667 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:15.667 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:15.666+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:15.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:15.762+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:15.797 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:15.797 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:15.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:15.868 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:15.866+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:15.882 INFO:teuthology.orchestra.run.smithi017.stdout:1720 read 0x1ac3617 thru 0x1ace59f (0xaf89 bytes) 2024-09-18T05:14:15.887 INFO:teuthology.orchestra.run.smithi017.stdout:1722 punch from 0x14d9e75 to 0x14e116c, (0x72f7 bytes) 2024-09-18T05:14:15.887 INFO:teuthology.orchestra.run.smithi017.stdout:1723 punch from 0x71dd0a to 0x7206a3, (0x2999 bytes) 2024-09-18T05:14:15.887 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:15.894 INFO:teuthology.orchestra.run.smithi017.stdout:1726 trunc from 0x2884e64 to 0x63f25e8 2024-09-18T05:14:15.912 INFO:teuthology.orchestra.run.smithi017.stdout:1727 trunc from 0x63f25e8 to 0x2e0610b 2024-09-18T05:14:15.931 INFO:teuthology.orchestra.run.smithi017.stdout:1728 read 0x1cfa9fb thru 0x1d00443 (0x5a49 bytes) 2024-09-18T05:14:15.931 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:15.931 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:15.935 INFO:teuthology.orchestra.run.smithi017.stdout:1731 trunc from 0x2e0610b to 0x101f406 2024-09-18T05:14:15.951 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:15.951 INFO:teuthology.orchestra.run.smithi017.stdout:1733 punch from 0xf543f5 to 0xf63e32, (0xfa3d bytes) 2024-09-18T05:14:15.951 INFO:teuthology.orchestra.run.smithi017.stdout:1734 read 0x76f6c6 thru 0x77b683 (0xbfbe bytes) 2024-09-18T05:14:15.951 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:15.970 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:15.962+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:15.985 INFO:teuthology.orchestra.run.smithi017.stdout:1736 write 0xaef0992 thru 0xaeff20f (0xe87e bytes) 2024-09-18T05:14:15.999 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.003 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:16.003 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:16.003 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:16.003 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:16.003 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:16.012 INFO:teuthology.orchestra.run.smithi017.stdout:1739 trunc from 0xaeff210 to 0x14fbf01 2024-09-18T05:14:16.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:16.034 INFO:teuthology.orchestra.run.smithi017.stdout:1740 write 0x79a30c thru 0x7a97b4 (0xf4a9 bytes) 2024-09-18T05:14:16.036 INFO:teuthology.orchestra.run.smithi017.stdout:1741 read 0x4dec2f thru 0x4e1b0d (0x2edf bytes) 2024-09-18T05:14:16.068 INFO:teuthology.orchestra.run.smithi017.stdout:1742 write 0xe9aaab9 thru 0xe9afbb9 (0x5101 bytes) 2024-09-18T05:14:16.070 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:16.070+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:16.086 INFO:teuthology.orchestra.run.smithi017.stdout:1743 trunc from 0xe9afbba to 0x7093e00 2024-09-18T05:14:16.108 INFO:teuthology.orchestra.run.smithi017.stdout:1744 trunc from 0x7093e00 to 0x8dcd6c9 2024-09-18T05:14:16.116 INFO:teuthology.orchestra.run.smithi017.stdout:1746 writesame 0x6db5571 thru 0x6dbc4bd data_size 0x1(0x6f4d bytes) 2024-09-18T05:14:16.154 INFO:teuthology.orchestra.run.smithi017.stdout:1747 punch from 0x20702c6 to 0x2071be5, (0x191f bytes) 2024-09-18T05:14:16.154 INFO:teuthology.orchestra.run.smithi017.stdout:1748 punch from 0x3c8fbb6 to 0x3c9d7fd, (0xdc47 bytes) 2024-09-18T05:14:16.154 INFO:teuthology.orchestra.run.smithi017.stdout:1749 punch from 0x7f60e85 to 0x7f6f727, (0xe8a2 bytes) 2024-09-18T05:14:16.168 INFO:teuthology.orchestra.run.smithi017.stdout:1750 writesame 0xacfc2b6 thru 0xad09852 data_size 0x1(0xd59d bytes) 2024-09-18T05:14:16.170 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:16.170 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:16.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:16.170 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.934122907000001, 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.171 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:16.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.934055297, 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.934007911, 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:16.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:16.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.933962505, 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.184 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:16.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:16.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:16.188 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.933917214999999, 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:16.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:16.192 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.932282664000001, 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:16.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:16.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.932230345000001, 2024-09-18T05:14:16.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:16.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.198 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:16.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.198 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:16.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:16.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:16.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.932112702, 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:16.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.932050782999999, 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:16.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:16.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:16.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931992362999999, 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:16.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:16.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:16.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.218 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.218 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931938736999999, 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:16.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931891673999999, 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.227 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931831595, 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:16.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931771308, 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:16.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:16.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:16.236 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931703991999999, 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:16.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.240 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931655388999999, 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931581769999999, 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:16.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:16.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931508287, 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:16.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931451697, 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.254 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:16.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:16.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:16.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:16.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.931405565, 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:16.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.264 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.264 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:16.265 INFO:teuthology.orchestra.run.smithi017.stdout:1751 write 0xaf1689c thru 0xaf1c5d7 (0x5d3c bytes) 2024-09-18T05:14:16.265 INFO:teuthology.orchestra.run.smithi017.stdout:1752 read 0x9b9c18e thru 0x9b9f373 (0x31e6 bytes) 2024-09-18T05:14:16.265 INFO:teuthology.orchestra.run.smithi017.stdout:1753 punch from 0x73b1e33 to 0x73bc34f, (0xa51c bytes) 2024-09-18T05:14:16.265 INFO:teuthology.orchestra.run.smithi017.stdout:1754 punch from 0x5de70e to 0x5ded06, (0x5f8 bytes) 2024-09-18T05:14:16.265 INFO:teuthology.orchestra.run.smithi017.stdout:1755 punch from 0x182977d to 0x183282a, (0x90ad bytes) 2024-09-18T05:14:16.265 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:1757 write 0xdf9e073 thru 0xdfaa8d7 (0xc865 bytes) 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:1759 write 0x468ccd2 thru 0x4699b2d (0xce5c bytes) 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:1760 writesame 0x1437f2d thru 0x14476c0 data_size 0xa(0xf794 bytes) 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:1762 read 0x695bc64 thru 0x696075b (0x4af8 bytes) 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:1766 read 0x7c951ba thru 0x7c97e11 (0x2c58 bytes) 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:1768 writesame 0x7f9f55f thru 0x7fa4eea data_size 0x16(0x598c bytes) 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:1769 read 0x8790f55 thru 0x87964ad (0x5559 bytes) 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:1770 trunc from 0xdfaa8d8 to 0xbd5f4e2 2024-09-18T05:14:16.268 INFO:teuthology.orchestra.run.smithi017.stdout:1771 trunc from 0xbd5f4e2 to 0x269d48c 2024-09-18T05:14:16.269 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:16.262+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:16.313 INFO:teuthology.orchestra.run.smithi017.stdout:1772 writesame 0x4970c42 thru 0x497fc1d data_size 0x81(0xefdc bytes) 2024-09-18T05:14:16.318 INFO:teuthology.orchestra.run.smithi017.stdout:1773 trunc from 0x497fc1e to 0x62f07db 2024-09-18T05:14:16.329 INFO:teuthology.orchestra.run.smithi017.stdout:1774 punch from 0x215d9f2 to 0x2164d01, (0x730f bytes) 2024-09-18T05:14:16.340 INFO:teuthology.orchestra.run.smithi017.stdout:1775 write 0x65631ce thru 0x656f2b2 (0xc0e5 bytes) 2024-09-18T05:14:16.354 INFO:teuthology.orchestra.run.smithi017.stdout:1776 trunc from 0x656f2b3 to 0xbfe51e5 2024-09-18T05:14:16.365 INFO:teuthology.orchestra.run.smithi017.stdout:1777 read 0x3fcb82b thru 0x3fd0004 (0x47da bytes) 2024-09-18T05:14:16.365 INFO:teuthology.orchestra.run.smithi017.stdout:1778 read 0x13434ae thru 0x134ce53 (0x99a6 bytes) 2024-09-18T05:14:16.366 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:16.358+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:16.366 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.376 INFO:teuthology.orchestra.run.smithi017.stdout:1780 trunc from 0xbfe51e5 to 0x6f260c9 2024-09-18T05:14:16.388 INFO:teuthology.orchestra.run.smithi017.stdout:1781 writesame 0x1207c12 thru 0x1209089 data_size 0x14(0x1478 bytes) 2024-09-18T05:14:16.417 INFO:teuthology.orchestra.run.smithi017.stdout:1782 writesame 0xe1ba2d2 thru 0xe1c79d5 data_size 0x2c(0xd704 bytes) 2024-09-18T05:14:16.417 INFO:teuthology.orchestra.run.smithi017.stdout:1783 writesame 0xc5c4ed thru 0xc6afed data_size 0x1(0xeb01 bytes) 2024-09-18T05:14:16.454 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:16.455 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:16.467 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:16.466+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:16.468 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:16.487 INFO:teuthology.orchestra.run.smithi017.stdout:1784 write 0xa5579f0 thru 0xa55b918 (0x3f29 bytes) 2024-09-18T05:14:16.493 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.506 INFO:teuthology.orchestra.run.smithi017.stdout:1786 trunc from 0xe1c79d6 to 0x8b01e60 2024-09-18T05:14:16.519 INFO:teuthology.orchestra.run.smithi017.stdout:1788 punch from 0x6f5a57c to 0x6f6096b, (0x63ef bytes) 2024-09-18T05:14:16.519 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.535 INFO:teuthology.orchestra.run.smithi017.stdout:1790 write 0xb616d62 thru 0xb61864d (0x18ec bytes) 2024-09-18T05:14:16.540 INFO:teuthology.orchestra.run.smithi017.stdout:1792 writesame 0x34bb91c thru 0x34c57ce data_size 0x1(0x9eb3 bytes) 2024-09-18T05:14:16.543 INFO:teuthology.orchestra.run.smithi017.stdout:1793 trunc from 0xb61864e to 0xb988bba 2024-09-18T05:14:16.551 INFO:teuthology.orchestra.run.smithi017.stdout:1795 read 0x5aa4f93 thru 0x5aaf224 (0xa292 bytes) 2024-09-18T05:14:16.552 INFO:teuthology.orchestra.run.smithi017.stdout:1796 read 0x9c87244 thru 0x9c88ee2 (0x1c9f bytes) 2024-09-18T05:14:16.552 INFO:teuthology.orchestra.run.smithi017.stdout:1797 write 0x22d5ede thru 0x22df1be (0x92e1 bytes) 2024-09-18T05:14:16.555 INFO:teuthology.orchestra.run.smithi017.stdout:1798 read 0x380d3d thru 0x38ce96 (0xc15a bytes) 2024-09-18T05:14:16.555 INFO:teuthology.orchestra.run.smithi017.stdout:1800 punch from 0x4ae6d13 to 0x4ae6df2, (0xdf bytes) 2024-09-18T05:14:16.567 INFO:teuthology.orchestra.run.smithi017.stdout:1802 write 0xcb77ffb thru 0xcb85533 (0xd539 bytes) 2024-09-18T05:14:16.568 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:16.566+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:16.574 INFO:teuthology.orchestra.run.smithi017.stdout:1803 writesame 0x2e3b615 thru 0x2e478ca data_size 0x1(0xc2b6 bytes) 2024-09-18T05:14:16.616 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:16.617 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:16.619 INFO:teuthology.orchestra.run.smithi017.stdout:1804 punch from 0x5ecc87b to 0x5ed845a, (0xbbdf bytes) 2024-09-18T05:14:16.624 INFO:teuthology.orchestra.run.smithi017.stdout:1805 trunc from 0xcb85534 to 0xa778b10 2024-09-18T05:14:16.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:16.639 INFO:teuthology.orchestra.run.smithi017.stdout:1808 read 0x72be9f8 thru 0x72c0654 (0x1c5d bytes) 2024-09-18T05:14:16.639 INFO:teuthology.orchestra.run.smithi017.stdout:1809 read 0xfdc6e1 thru 0xfec154 (0xfa74 bytes) 2024-09-18T05:14:16.655 INFO:teuthology.orchestra.run.smithi017.stdout:1810 write 0xd472ac3 thru 0xd47f488 (0xc9c6 bytes) 2024-09-18T05:14:16.667 INFO:teuthology.orchestra.run.smithi017.stdout:1811 write 0xdab1a5d thru 0xdab1c18 (0x1bc bytes) 2024-09-18T05:14:16.668 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:16.662+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:16.670 INFO:teuthology.orchestra.run.smithi017.stdout:1812 punch from 0xce3702 to 0xced101, (0x99ff bytes) 2024-09-18T05:14:16.670 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.671 INFO:teuthology.orchestra.run.smithi017.stdout:1816 write 0x7cc4910 thru 0x7cd3513 (0xec04 bytes) 2024-09-18T05:14:16.673 INFO:teuthology.orchestra.run.smithi017.stdout:1817 trunc from 0xdab1c19 to 0xe1b3e22 2024-09-18T05:14:16.705 INFO:teuthology.orchestra.run.smithi017.stdout:1818 trunc from 0xe1b3e22 to 0x138340a 2024-09-18T05:14:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:1819 punch from 0xd628c to 0xd9ddf, (0x3b53 bytes) 2024-09-18T05:14:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:1820 write 0x7fe1ad0 thru 0x7ff0be2 (0xf113 bytes) 2024-09-18T05:14:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:1822 writesame 0x3698a72 thru 0x36a69a2 data_size 0x1(0xdf31 bytes) 2024-09-18T05:14:16.769 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:16.766+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1059 3.4 e26/22 3:2547571c:::rbd_data.118b4598dbfb.0000000000000108:head v 26'5, mlcod=25'3)", 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.298616587000001, 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021306210000000001, 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494008+0000", 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494034+0000", 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5865999999999999e-05 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494066+0000", 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2317999999999998e-05 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494080+0000", 2024-09-18T05:14:16.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4482e-05 2024-09-18T05:14:16.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494200+0000", 2024-09-18T05:14:16.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119744 2024-09-18T05:14:16.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494258+0000", 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8082999999999999e-05 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.496043+0000", 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001784887 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.496140+0000", 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7351999999999999e-05 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.803 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1160 3.9 e26/22 3:93ecdcc7:::rbd_data.118b4598dbfb.000000000000005f:head v 26'6, mlcod=26'4)", 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.228189928999999, 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020475789999999999, 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:16.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564434+0000", 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564473+0000", 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8977000000000003e-05 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564501+0000", 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7582000000000001e-05 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564514+0000", 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3134e-05 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564633+0000", 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011863500000000001 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564699+0000", 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6447999999999998e-05 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.566372+0000", 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016731459999999999 2024-09-18T05:14:16.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.566484+0000", 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011178799999999999 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1175 3.0 e26/22 3:0163bb0f:::rbd_data.118b4598dbfb.00000000000000ee:head v 26'9, mlcod=26'7)", 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.200033243, 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021239800000000001, 2024-09-18T05:14:16.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592590+0000", 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592614+0000", 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3220000000000001e-05 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592670+0000", 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5939000000000001e-05 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592717+0000", 2024-09-18T05:14:16.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7647e-05 2024-09-18T05:14:16.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592964+0000", 2024-09-18T05:14:16.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024644400000000001 2024-09-18T05:14:16.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.593019+0000", 2024-09-18T05:14:16.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5457000000000001e-05 2024-09-18T05:14:16.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.594550+0000", 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015306510000000001 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.594717+0000", 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016734900000000001 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1432 3.4 e26/22 3:207a8b3d:::rbd_data.118b4598dbfb.000000000000005b:head v 26'7, mlcod=26'5)", 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.027544235000001, 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020916770000000001, 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765080+0000", 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765140+0000", 2024-09-18T05:14:16.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0813000000000002e-05 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765182+0000", 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1480000000000003e-05 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765203+0000", 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1126000000000001e-05 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765334+0000", 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000130636 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765403+0000", 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9096000000000004e-05 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.767072+0000", 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001668861 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.767174+0000", 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000102132 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.970189601000001, 2024-09-18T05:14:16.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:14:16.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:14:16.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:14:16.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:14:16.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:14:16.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1476 3.4 e26/22 3:207a8b3d:::rbd_data.118b4598dbfb.000000000000005b:head v 26'8, mlcod=26'6)", 2024-09-18T05:14:16.825 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.959769812000001, 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022241629999999999, 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832855+0000", 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832871+0000", 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5862000000000002e-05 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832903+0000", 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832919+0000", 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6277e-05 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.833081+0000", 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016194899999999999 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.833154+0000", 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3226000000000007e-05 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834997+0000", 2024-09-18T05:14:16.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018433340000000001 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.835081+0000", 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3354000000000002e-05 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:2097 3.4 e26/22 3:2079477c:::rbd_data.118b4598dbfb.00000000000001d4:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.605939669000001, 2024-09-18T05:14:16.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021624840000000001, 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186684+0000", 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186707+0000", 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2823000000000002e-05 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186756+0000", 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9459999999999997e-05 2024-09-18T05:14:16.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186777+0000", 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0809999999999999e-05 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.187161+0000", 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038411000000000001 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.187218+0000", 2024-09-18T05:14:16.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7065999999999999e-05 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.188759+0000", 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001540535 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.188849+0000", 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0489999999999996e-05 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:9001 3.4 e29/22 3:224b1375:::rbd_data.118beb25b049.0000000000000128:head v 29'42, mlcod=29'40)", 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.830665385, 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002309742, 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961959+0000", 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962023+0000", 2024-09-18T05:14:16.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3678999999999998e-05 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962057+0000", 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4606e-05 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962078+0000", 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1109999999999999e-05 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962204+0000", 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125306 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962271+0000", 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7009999999999997e-05 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964181+0000", 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019100619999999999 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964271+0000", 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9819000000000002e-05 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16114 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'50, mlcod=32'48)", 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.072486784999999, 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020637609999999999, 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.839 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720138+0000", 2024-09-18T05:14:16.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720178+0000", 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0635e-05 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720204+0000", 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5660000000000002e-05 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720215+0000", 2024-09-18T05:14:16.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1222e-05 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720390+0000", 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017476300000000001 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720431+0000", 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.108e-05 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.722119+0000", 2024-09-18T05:14:16.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016880269999999999 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.722203+0000", 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4419000000000006e-05 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.976551858000001, 2024-09-18T05:14:16.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:14:16.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:14:16.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.847 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.973935061000001, 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:16.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16290 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'52, mlcod=32'49)", 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.972844357, 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023378159999999999, 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819780+0000", 2024-09-18T05:14:16.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819796+0000", 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325999999999999e-05 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819826+0000", 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9583000000000001e-05 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819845+0000", 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8597000000000002e-05 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819950+0000", 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105356 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820003+0000", 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3295999999999999e-05 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822018+0000", 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020151779999999998 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822120+0000", 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101316 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:16.856 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.891399548999999, 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:14:16.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.516861856, 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.864 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17196 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'90, mlcod=32'86)", 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.508975274000001, 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023459290000000001, 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:16.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283650+0000", 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283663+0000", 2024-09-18T05:14:16.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2697999999999999e-05 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283682+0000", 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9012999999999999e-05 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283691+0000", 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7720000000000006e-06 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283777+0000", 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5923999999999999e-05 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283830+0000", 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2320000000000001e-05 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285942+0000", 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002112039 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285997+0000", 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5322000000000003e-05 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21826 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'62, mlcod=36'60)", 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4752320339999994, 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002048064, 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317391+0000", 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317425+0000", 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3492999999999999e-05 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317462+0000", 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7543000000000003e-05 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317480+0000", 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7960000000000001e-05 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317588+0000", 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107654 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317641+0000", 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2675e-05 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.319355+0000", 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017144059999999999 2024-09-18T05:14:16.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.319442+0000", 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7349999999999995e-05 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21886 3.9 e36/22 3:969ecc48:::rbd_data.118ba5d0bdf6.000000000000010b:head v 36'64, mlcod=36'62)", 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3231346849999994, 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021557630000000002, 2024-09-18T05:14:16.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469489+0000", 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469514+0000", 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5269000000000002e-05 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469558+0000", 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.401e-05 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469581+0000", 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2422999999999999e-05 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469722+0000", 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014086900000000001 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469780+0000", 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8362999999999997e-05 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471554+0000", 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001774156 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471647+0000", 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3256000000000003e-05 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21891 3.0 e36/22 3:04d4c8a4:::rbd_data.118ba5d0bdf6.0000000000000259:head v 36'100, mlcod=36'98)", 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:16.877 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3228533910000007, 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022905260000000002, 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469771+0000", 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469789+0000", 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.821e-05 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469821+0000", 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1335999999999999e-05 2024-09-18T05:14:16.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469839+0000", 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-05 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469944+0000", 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104576 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469996+0000", 2024-09-18T05:14:16.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2102999999999999e-05 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471954+0000", 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019575980000000001 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472063+0000", 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010984600000000001 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21892 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'65, mlcod=36'62)", 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3218893650000005, 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023311389999999999, 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470735+0000", 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470750+0000", 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470788+0000", 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7252999999999997e-05 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470806+0000", 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8105999999999999e-05 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470949+0000", 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014359600000000001 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471048+0000", 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8888999999999995e-05 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472956+0000", 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019074820000000001 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.473068+0000", 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011240599999999999 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8259326739999997, 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:16.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:16.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:16.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:16.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:14:16.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:14:16.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.890 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:16.890 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:16.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:1824 read 0x255ec7f thru 0x256691b (0x7c9d bytes) 2024-09-18T05:14:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:1825 write 0xbe83f4c thru 0xbe8e9e0 (0xaa95 bytes) 2024-09-18T05:14:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:1826 write 0x2c273a6 thru 0x2c36a30 (0xf68b bytes) 2024-09-18T05:14:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:1827 punch from 0x496213f to 0x496e6fa, (0xc5bb bytes) 2024-09-18T05:14:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:1828 writesame 0xd82dd51 thru 0xd8378d0 data_size 0x40(0x9b80 bytes) 2024-09-18T05:14:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:1829 trunc from 0xd8378d1 to 0xea5f275 2024-09-18T05:14:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:1830 read 0xbf8c7 thru 0xcb5c7 (0xbd01 bytes) 2024-09-18T05:14:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:1832 punch from 0x898a78b to 0x8996a8c, (0xc301 bytes) 2024-09-18T05:14:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:1834 writesame 0xad78177 thru 0xad863f3 data_size 0x4d(0xe27d bytes) 2024-09-18T05:14:16.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:16.886+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:16.897 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:14:16.914 INFO:teuthology.orchestra.run.smithi017.stdout:1835 trunc from 0xea5f275 to 0x17823f0 2024-09-18T05:14:16.970 INFO:teuthology.orchestra.run.smithi017.stdout:1838 write 0xd6e67d4 thru 0xd6f0c30 (0xa45d bytes) 2024-09-18T05:14:16.975 INFO:teuthology.orchestra.run.smithi017.stdout:1839 write 0x90abba7 thru 0x90b58fd (0x9d57 bytes) 2024-09-18T05:14:16.981 INFO:teuthology.orchestra.run.smithi017.stdout:1840 write 0x63a24bf thru 0x63b07b4 (0xe2f6 bytes) 2024-09-18T05:14:16.992 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:16.986+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:16.999 INFO:teuthology.orchestra.run.smithi017.stdout:1841 trunc from 0xd6f0c31 to 0x5227b90 2024-09-18T05:14:17.035 INFO:teuthology.orchestra.run.smithi017.stdout:1843 write 0x868ae96 thru 0x86901fb (0x5366 bytes) 2024-09-18T05:14:17.040 INFO:teuthology.orchestra.run.smithi017.stdout:1844 write 0x8e4f43 thru 0x8e96ab (0x4769 bytes) 2024-09-18T05:14:17.044 INFO:teuthology.orchestra.run.smithi017.stdout:1846 write 0x4f7006f thru 0x4f7a2ab (0xa23d bytes) 2024-09-18T05:14:17.050 INFO:teuthology.orchestra.run.smithi017.stdout:1848 trunc from 0x86901fc to 0x71268db 2024-09-18T05:14:17.053 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:29061 3.18 3:1ca6fb9e:::rbd_object_map.118b3d2c15c4:head [call lock.assert_locked in=44b,call rbd.object_map_update in=39b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T05:14:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:17.048543+0000", 2024-09-18T05:14:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0018476720000000001, 2024-09-18T05:14:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018864210000000001, 2024-09-18T05:14:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for sub ops", 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 29061 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.048543+0000", 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.048543+0000", 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.048540+0000", 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.048559+0000", 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8813000000000001e-05 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.048590+0000", 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1862000000000001e-05 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.048606+0000", 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5193e-05 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.048660+0000", 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4826e-05 2024-09-18T05:14:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.048736+0000", 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5457000000000006e-05 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.048969+0000", 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000233057 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.050073+0000", 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011041359999999999 2024-09-18T05:14:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4491.0:29061 3.18 e44/22 ondisk, result = 0)", 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:17.050385+0000", 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.4079999999999997e-06, 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014816800000000001, 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.050385+0000", 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.050385+0000", 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.050384+0000", 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.050390+0000", 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3000000000000001e-06 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.050401+0000", 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1062e-05 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.050406+0000", 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6629999999999998e-06 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.050446+0000", 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9394999999999998e-05 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:17.050454+0000", 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4929999999999998e-06 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 2 2024-09-18T05:14:17.061 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:17.070 INFO:teuthology.orchestra.run.smithi017.stdout:1849 read 0x5ad14e1 thru 0x5ad1971 (0x491 bytes) 2024-09-18T05:14:17.071 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.071 INFO:teuthology.orchestra.run.smithi017.stdout:1851 write 0x5319676 thru 0x531e375 (0x4d00 bytes) 2024-09-18T05:14:17.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:17.078 INFO:teuthology.orchestra.run.smithi017.stdout:1852 trunc from 0x71268db to 0x9b5df8b 2024-09-18T05:14:17.089 INFO:teuthology.orchestra.run.smithi017.stdout:1853 trunc from 0x9b5df8b to 0x7663a32 2024-09-18T05:14:17.092 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:17.086+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:17.099 INFO:teuthology.orchestra.run.smithi017.stdout:1854 writesame 0x2800632 thru 0x2808374 data_size 0x15(0x7d43 bytes) 2024-09-18T05:14:17.112 INFO:teuthology.orchestra.run.smithi017.stdout:1855 writesame 0x94744ab thru 0x947499d data_size 0x1(0x4f3 bytes) 2024-09-18T05:14:17.112 INFO:teuthology.orchestra.run.smithi017.stdout:1856 write 0x6c6c238 thru 0x6c6c700 (0x4c9 bytes) 2024-09-18T05:14:17.118 INFO:teuthology.orchestra.run.smithi017.stdout:1857 trunc from 0x947499e to 0xab48491 2024-09-18T05:14:17.126 INFO:teuthology.orchestra.run.smithi017.stdout:1858 punch from 0x2c02494 to 0x2c0f4c1, (0xd02d bytes) 2024-09-18T05:14:17.126 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.126 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.126 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.133 INFO:teuthology.orchestra.run.smithi017.stdout:1865 write 0xb0f349f thru 0xb0fb42b (0x7f8d bytes) 2024-09-18T05:14:17.138 INFO:teuthology.orchestra.run.smithi017.stdout:1867 punch from 0x3e3bf55 to 0x3e3cbfd, (0xca8 bytes) 2024-09-18T05:14:17.138 INFO:teuthology.orchestra.run.smithi017.stdout:1871 read 0x8332322 thru 0x8337366 (0x5045 bytes) 2024-09-18T05:14:17.138 INFO:teuthology.orchestra.run.smithi017.stdout:1872 writesame 0x5a72aef thru 0x5a7352e data_size 0x20(0xa40 bytes) 2024-09-18T05:14:17.143 INFO:teuthology.orchestra.run.smithi017.stdout:1873 trunc from 0xb0fb42c to 0xd65a960 2024-09-18T05:14:17.143 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:17.150 INFO:teuthology.orchestra.run.smithi017.stdout:1874 read 0x3ad0e4d thru 0x3ad36fd (0x28b1 bytes) 2024-09-18T05:14:17.166 INFO:teuthology.orchestra.run.smithi017.stdout:1876 trunc from 0xd65a960 to 0x2c7612a 2024-09-18T05:14:17.187 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T05:14:17.187 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:14:17.187 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-18T05:14:17.187 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T05:14:17.187 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T05:14:17.187 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-18T05:14:17.188 INFO:teuthology.orchestra.run.smithi017.stdout:1877 trunc from 0x2c7612a to 0x1ea99c5 2024-09-18T05:14:17.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:17.186+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:17.202 INFO:teuthology.orchestra.run.smithi017.stdout:1878 trunc from 0x1ea99c5 to 0x2b82c5e 2024-09-18T05:14:17.209 INFO:teuthology.orchestra.run.smithi017.stdout:1879 read 0xca30ec thru 0xcaff9b (0xceb0 bytes) 2024-09-18T05:14:17.210 INFO:teuthology.orchestra.run.smithi017.stdout:1880 writesame 0x2512660 thru 0x251488b data_size 0x12(0x222c bytes) 2024-09-18T05:14:17.220 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:17.220 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:17.221 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:17.221 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:17.230 INFO:teuthology.orchestra.run.smithi017.stdout:1883 writesame 0xa163ae1 thru 0xa16f51d data_size 0x31(0xba3d bytes) 2024-09-18T05:14:17.235 INFO:teuthology.orchestra.run.smithi017.stdout:1884 trunc from 0xa16f51e to 0xd28e320 2024-09-18T05:14:17.243 INFO:teuthology.orchestra.run.smithi017.stdout:1885 write 0x81713db thru 0x817fd8f (0xe9b5 bytes) 2024-09-18T05:14:17.244 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:17.266 INFO:teuthology.orchestra.run.smithi017.stdout:1886 trunc from 0xd28e320 to 0xc689e1 2024-09-18T05:14:17.286 INFO:teuthology.orchestra.run.smithi017.stdout:1887 read 0xd0364 thru 0xdceef (0xcb8c bytes) 2024-09-18T05:14:17.286 INFO:teuthology.orchestra.run.smithi017.stdout:1889 punch from 0xaea15d to 0xaeb9cc, (0x186f bytes) 2024-09-18T05:14:17.294 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:17.286+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:17.308 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:17.313 INFO:teuthology.orchestra.run.smithi017.stdout:1890 write 0xc806e68 thru 0xc814d86 (0xdf1f bytes) 2024-09-18T05:14:17.317 INFO:teuthology.orchestra.run.smithi017.stdout:1891 punch from 0xa2f95e9 to 0xa2f9f09, (0x920 bytes) 2024-09-18T05:14:17.317 INFO:teuthology.orchestra.run.smithi017.stdout:1892 read 0xbe4fe2c thru 0xbe5f7ea (0xf9bf bytes) 2024-09-18T05:14:17.317 INFO:teuthology.orchestra.run.smithi017.stdout:1893 write 0x93510f4 thru 0x9356f88 (0x5e95 bytes) 2024-09-18T05:14:17.322 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.324 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:17.324 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "" 2024-09-18T05:14:17.324 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:17.325 INFO:teuthology.orchestra.run.smithi017.stdout:1896 trunc from 0xc814d87 to 0xaa06454 2024-09-18T05:14:17.328 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:17.328 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:17.334 INFO:teuthology.orchestra.run.smithi017.stdout:1898 writesame 0xa4b6b20 thru 0xa4c11a5 data_size 0x69(0xa686 bytes) 2024-09-18T05:14:17.339 INFO:teuthology.orchestra.run.smithi017.stdout:1899 write 0x25196cc thru 0x252028a (0x6bbf bytes) 2024-09-18T05:14:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:1900 write 0x177c4bd thru 0x177d94e (0x1492 bytes) 2024-09-18T05:14:17.347 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:17.347 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:17.356 INFO:teuthology.orchestra.run.smithi017.stdout:1901 writesame 0xdde91ed thru 0xddf8ba2 data_size 0x1(0xf9b6 bytes) 2024-09-18T05:14:17.356 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.356 INFO:teuthology.orchestra.run.smithi017.stdout:1903 read 0xa926ed3 thru 0xa92b743 (0x4871 bytes) 2024-09-18T05:14:17.356 INFO:teuthology.orchestra.run.smithi017.stdout:1907 write 0x94d809e thru 0x94de8e9 (0x684c bytes) 2024-09-18T05:14:17.361 INFO:teuthology.orchestra.run.smithi017.stdout:1908 write 0x52262ed thru 0x522e6d5 (0x83e9 bytes) 2024-09-18T05:14:17.363 INFO:teuthology.orchestra.run.smithi017.stdout:1909 punch from 0x9355fbd to 0x93589c6, (0x2a09 bytes) 2024-09-18T05:14:17.363 INFO:teuthology.orchestra.run.smithi017.stdout:1910 writesame 0xa4a7354 thru 0xa4a8929 data_size 0x5(0x15d6 bytes) 2024-09-18T05:14:17.365 INFO:teuthology.orchestra.run.smithi017.stdout:1911 read 0x5fe75be thru 0x5fea726 (0x3169 bytes) 2024-09-18T05:14:17.365 INFO:teuthology.orchestra.run.smithi017.stdout:1912 read 0xa135445 thru 0xa13cdaf (0x796b bytes) 2024-09-18T05:14:17.367 INFO:teuthology.orchestra.run.smithi017.stdout:1913 read 0x9c50d04 thru 0x9c5f0be (0xe3bb bytes) 2024-09-18T05:14:17.367 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:17.367 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:17.368 INFO:teuthology.orchestra.run.smithi017.stdout:1915 read 0x23cce9 thru 0x2469b0 (0x9cc8 bytes) 2024-09-18T05:14:17.368 INFO:teuthology.orchestra.run.smithi017.stdout:1916 writesame 0x8662c44 thru 0x8671ed6 data_size 0x1(0xf293 bytes) 2024-09-18T05:14:17.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:17.390+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:17.407 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:17.408 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:17.408 INFO:teuthology.orchestra.run.smithi017.stdout:1918 punch from 0xae26175 to 0xae2b2bd, (0x5148 bytes) 2024-09-18T05:14:17.408 INFO:teuthology.orchestra.run.smithi017.stdout:1920 write 0x123c9aa thru 0x124477f (0x7dd6 bytes) 2024-09-18T05:14:17.412 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:17.412 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:17.415 INFO:teuthology.orchestra.run.smithi017.stdout:1921 trunc from 0xddf8ba3 to 0xb5e5e98 2024-09-18T05:14:17.425 INFO:teuthology.orchestra.run.smithi017.stdout:1923 write 0x1f932b6 thru 0x1fa0751 (0xd49c bytes) 2024-09-18T05:14:17.430 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:17.430 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:17.431 INFO:teuthology.orchestra.run.smithi017.stdout:1924 trunc from 0xb5e5e98 to 0xcfbb0b3 2024-09-18T05:14:17.432 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:17.437 INFO:teuthology.orchestra.run.smithi017.stdout:1925 read 0x574cba9 thru 0x575943f (0xc897 bytes) 2024-09-18T05:14:17.438 INFO:teuthology.orchestra.run.smithi017.stdout:1927 writesame 0x896944d thru 0x8970062 data_size 0x5(0x6c16 bytes) 2024-09-18T05:14:17.444 INFO:teuthology.orchestra.run.smithi017.stdout:1928 read 0x1c93e89 thru 0x1ca21af (0xe327 bytes) 2024-09-18T05:14:17.444 INFO:teuthology.orchestra.run.smithi017.stdout:1929 read 0x3b113d9 thru 0x3b2043e (0xf066 bytes) 2024-09-18T05:14:17.444 INFO:teuthology.orchestra.run.smithi017.stdout:1930 read 0x481f5c9 thru 0x4828b73 (0x95ab bytes) 2024-09-18T05:14:17.450 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:17.451 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:17.452 INFO:teuthology.orchestra.run.smithi017.stdout:1932 write 0xd5e7ac9 thru 0xd5f2c62 (0xb19a bytes) 2024-09-18T05:14:17.456 INFO:teuthology.orchestra.run.smithi017.stdout:1933 write 0x130e780 thru 0x130f91c (0x119d bytes) 2024-09-18T05:14:17.457 INFO:teuthology.orchestra.run.smithi017.stdout:1934 write 0x8b647a4 thru 0x8b709e9 (0xc246 bytes) 2024-09-18T05:14:17.461 INFO:teuthology.orchestra.run.smithi017.stdout:1937 write 0x2bb9551 thru 0x2bc5d26 (0xc7d6 bytes) 2024-09-18T05:14:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:17.471 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:1938 write 0xeb8ac49 thru 0xeb8fc1c (0x4fd4 bytes) 2024-09-18T05:14:17.476 INFO:teuthology.orchestra.run.smithi017.stdout:1940 write 0x7aecefd thru 0x7af36bd (0x67c1 bytes) 2024-09-18T05:14:17.479 INFO:teuthology.orchestra.run.smithi017.stdout:1941 writesame 0x963078f thru 0x96336bf data_size 0x1(0x2f31 bytes) 2024-09-18T05:14:17.492 INFO:teuthology.orchestra.run.smithi017.stdout:1942 read 0x4ffb2dc thru 0x50028a6 (0x75cb bytes) 2024-09-18T05:14:17.493 INFO:teuthology.orchestra.run.smithi017.stdout:1943 write 0x69fe112 thru 0x6a0d312 (0xf201 bytes) 2024-09-18T05:14:17.495 INFO:teuthology.orchestra.run.smithi017.stdout:1944 read 0x53da76c thru 0x53df64c (0x4ee1 bytes) 2024-09-18T05:14:17.496 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:17.494+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:17.496 INFO:teuthology.orchestra.run.smithi017.stdout:1945 punch from 0xeb0a4ef to 0xeb0e3c0, (0x3ed1 bytes) 2024-09-18T05:14:17.496 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.496 INFO:teuthology.orchestra.run.smithi017.stdout:1947 write 0x85ee99a thru 0x85f4a76 (0x60dd bytes) 2024-09-18T05:14:17.497 INFO:teuthology.orchestra.run.smithi017.stdout:1948 read 0x8e1d171 thru 0x8e281f1 (0xb081 bytes) 2024-09-18T05:14:17.498 INFO:teuthology.orchestra.run.smithi017.stdout:1949 punch from 0xa7995e9 to 0xa7a3054, (0x9a6b bytes) 2024-09-18T05:14:17.498 INFO:teuthology.orchestra.run.smithi017.stdout:1951 punch from 0xeb12769 to 0xeb1af1c, (0x87b3 bytes) 2024-09-18T05:14:17.498 INFO:teuthology.orchestra.run.smithi017.stdout:1952 write 0x13e6b4a thru 0x13e7621 (0xad8 bytes) 2024-09-18T05:14:17.500 INFO:teuthology.orchestra.run.smithi017.stdout:1953 writesame 0x6b82abb thru 0x6b8995c data_size 0x62(0x6ea2 bytes) 2024-09-18T05:14:17.502 INFO:teuthology.orchestra.run.smithi017.stdout:1954 write 0x4d0bcd4 thru 0x4d18b5f (0xce8c bytes) 2024-09-18T05:14:17.503 INFO:teuthology.orchestra.run.smithi017.stdout:1955 write 0xd620f9c thru 0xd624ac9 (0x3b2e bytes) 2024-09-18T05:14:17.507 INFO:teuthology.orchestra.run.smithi017.stdout:1956 write 0x7ce8b11 thru 0x7cf6d5f (0xe24f bytes) 2024-09-18T05:14:17.509 INFO:teuthology.orchestra.run.smithi017.stdout:1958 write 0x17abb14 thru 0x17b870d (0xcbfa bytes) 2024-09-18T05:14:17.511 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.511 INFO:teuthology.orchestra.run.smithi017.stdout:1961 read 0xd8b5746 thru 0xd8b8243 (0x2afe bytes) 2024-09-18T05:14:17.512 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.512 INFO:teuthology.orchestra.run.smithi017.stdout:1963 punch from 0x7a0cd52 to 0x7a0f2c4, (0x2572 bytes) 2024-09-18T05:14:17.512 INFO:teuthology.orchestra.run.smithi017.stdout:1965 read 0x52959cf thru 0x529b689 (0x5cbb bytes) 2024-09-18T05:14:17.514 INFO:teuthology.orchestra.run.smithi017.stdout:1966 trunc from 0xeb8fc1d to 0xd21b7ff 2024-09-18T05:14:17.525 INFO:teuthology.orchestra.run.smithi017.stdout:1967 write 0xb120d5f thru 0xb12d2b8 (0xc55a bytes) 2024-09-18T05:14:17.538 INFO:teuthology.orchestra.run.smithi017.stdout:1968 writesame 0xe6971c4 thru 0xe698af4 data_size 0x1(0x1931 bytes) 2024-09-18T05:14:17.538 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:17.549 INFO:teuthology.orchestra.run.smithi017.stdout:1972 trunc from 0xe698af5 to 0x7bebc9b 2024-09-18T05:14:17.565 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:17.566 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:17.574 INFO:teuthology.orchestra.run.smithi017.stdout:1973 trunc from 0x7bebc9b to 0x209b23b 2024-09-18T05:14:17.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:17.603 INFO:teuthology.orchestra.run.smithi017.stdout:1974 read 0x16a4778 thru 0x16b0084 (0xb90d bytes) 2024-09-18T05:14:17.604 INFO:teuthology.orchestra.run.smithi017.stdout:1975 read 0x1a84990 thru 0x1a92318 (0xd989 bytes) 2024-09-18T05:14:17.604 INFO:teuthology.orchestra.run.smithi017.stdout:1976 read 0x1c64399 thru 0x1c65d00 (0x1968 bytes) 2024-09-18T05:14:17.605 INFO:teuthology.orchestra.run.smithi017.stdout:1977 punch from 0x18d7e2c to 0x18df40f, (0x75e3 bytes) 2024-09-18T05:14:17.623 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:17.622+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:17.637 INFO:teuthology.orchestra.run.smithi017.stdout:1978 write 0xa3972cf thru 0xa3a371b (0xc44d bytes) 2024-09-18T05:14:17.641 INFO:teuthology.orchestra.run.smithi017.stdout:1979 write 0x2f34822 thru 0x2f37c76 (0x3455 bytes) 2024-09-18T05:14:17.644 INFO:teuthology.orchestra.run.smithi017.stdout:1980 clone 14 order 19 su 8192 sc 3 2024-09-18T05:14:17.697 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:17.694+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:17.746 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:17.747 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:17.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:17.798 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:17.790+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:17.885 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:17.886 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:17.888 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:14:17.899 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:17.898+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:17.903 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:18.000 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:17.998+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:18.065 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:18.066 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:18.079 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:18.101 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:18.094+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:18.202 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:18.194+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:18.229 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-18T05:14:18.249 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:18.250 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:18.251 INFO:teuthology.orchestra.run.smithi017.stdout:1981 read 0x12e7804 thru 0x12f3d47 (0xc544 bytes) 2024-09-18T05:14:18.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:18.273 INFO:teuthology.orchestra.run.smithi017.stdout:1982 writesame 0xa3b8745 thru 0xa3c48d9 data_size 0x1(0xc195 bytes) 2024-09-18T05:14:18.288 INFO:teuthology.orchestra.run.smithi017.stdout:1983 punch from 0x7efd66f to 0x7f09a2c, (0xc3bd bytes) 2024-09-18T05:14:18.289 INFO:teuthology.orchestra.run.smithi017.stdout:1984 read 0x3e7f803 thru 0x3e81c47 (0x2445 bytes) 2024-09-18T05:14:18.289 INFO:teuthology.orchestra.run.smithi017.stdout:1985 punch from 0x9f7a3a9 to 0x9f8287f, (0x84d6 bytes) 2024-09-18T05:14:18.289 INFO:teuthology.orchestra.run.smithi017.stdout:1987 punch from 0x1eae278 to 0x1eb08bd, (0x2645 bytes) 2024-09-18T05:14:18.289 INFO:teuthology.orchestra.run.smithi017.stdout:1988 read 0x8f11473 thru 0x8f1a995 (0x9523 bytes) 2024-09-18T05:14:18.290 INFO:teuthology.orchestra.run.smithi017.stdout:1989 read 0x2b7f943 thru 0x2b8ae42 (0xb500 bytes) 2024-09-18T05:14:18.291 INFO:teuthology.orchestra.run.smithi017.stdout:1990 punch from 0x3bc42db to 0x3bcc206, (0x7f2b bytes) 2024-09-18T05:14:18.291 INFO:teuthology.orchestra.run.smithi017.stdout:1991 punch from 0x8eb3536 to 0x8ec2864, (0xf32e bytes) 2024-09-18T05:14:18.307 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:18.306+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:18.311 INFO:teuthology.orchestra.run.smithi017.stdout:1993 write 0xdbd667e thru 0xdbe6651 (0xffd4 bytes) 2024-09-18T05:14:18.321 INFO:teuthology.orchestra.run.smithi017.stdout:1994 punch from 0xad3b7ae to 0xad442da, (0x8b2c bytes) 2024-09-18T05:14:18.321 INFO:teuthology.orchestra.run.smithi017.stdout:1996 read 0x5947be4 thru 0x594ac23 (0x3040 bytes) 2024-09-18T05:14:18.321 INFO:teuthology.orchestra.run.smithi017.stdout:1997 read 0x9a2312 thru 0x9abfb0 (0x9c9f bytes) 2024-09-18T05:14:18.323 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:18.323 INFO:teuthology.orchestra.run.smithi017.stdout:2000 read 0x3d1efc5 thru 0x3d25d62 (0x6d9e bytes) 2024-09-18T05:14:18.324 INFO:teuthology.orchestra.run.smithi017.stdout:2001 read 0x1c83138 thru 0x1c8cdc7 (0x9c90 bytes) 2024-09-18T05:14:18.326 INFO:teuthology.orchestra.run.smithi017.stdout:2002 punch from 0x1bfeb86 to 0x1c0cd62, (0xe1dc bytes) 2024-09-18T05:14:18.326 INFO:teuthology.orchestra.run.smithi017.stdout:2003 punch from 0x563ad85 to 0x5648120, (0xd39b bytes) 2024-09-18T05:14:18.326 INFO:teuthology.orchestra.run.smithi017.stdout:2004 read 0x345b04f thru 0x34617b6 (0x6768 bytes) 2024-09-18T05:14:18.326 INFO:teuthology.orchestra.run.smithi017.stdout:2005 read 0xd1d38a7 thru 0xd1d8689 (0x4de3 bytes) 2024-09-18T05:14:18.327 INFO:teuthology.orchestra.run.smithi017.stdout:2006 writesame 0xc117109 thru 0xc1177b9 data_size 0x1(0x6b1 bytes) 2024-09-18T05:14:18.331 INFO:teuthology.orchestra.run.smithi017.stdout:2007 write 0x2bad599 thru 0x2bb0a76 (0x34de bytes) 2024-09-18T05:14:18.369 INFO:teuthology.orchestra.run.smithi017.stdout:2008 write 0xec68b79 thru 0xec727a9 (0x9c31 bytes) 2024-09-18T05:14:18.382 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:18.382 INFO:teuthology.orchestra.run.smithi017.stdout:2010 write 0xc152513 thru 0xc15289f (0x38d bytes) 2024-09-18T05:14:18.385 INFO:teuthology.orchestra.run.smithi017.stdout:2011 writesame 0xae232c6 thru 0xae26809 data_size 0xe(0x3544 bytes) 2024-09-18T05:14:18.393 INFO:teuthology.orchestra.run.smithi017.stdout:2013 read 0xbe3812a thru 0xbe42866 (0xa73d bytes) 2024-09-18T05:14:18.393 INFO:teuthology.orchestra.run.smithi017.stdout:2014 read 0x2a4d4b8 thru 0x2a50592 (0x30db bytes) 2024-09-18T05:14:18.394 INFO:teuthology.orchestra.run.smithi017.stdout:2016 write 0x965c3d6 thru 0x9661ef4 (0x5b1f bytes) 2024-09-18T05:14:18.400 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:18.401 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:18.404 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:18.398+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:18.405 INFO:teuthology.orchestra.run.smithi017.stdout:2017 write 0xca97b24 thru 0xca9fe87 (0x8364 bytes) 2024-09-18T05:14:18.418 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:18.455 INFO:teuthology.orchestra.run.smithi017.stdout:2018 trunc from 0xec727aa to 0x1965265 2024-09-18T05:14:18.504 INFO:teuthology.orchestra.run.smithi017.stdout:2020 punch from 0x5919b4 to 0x597e55, (0x64a1 bytes) 2024-09-18T05:14:18.505 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:18.505 INFO:teuthology.orchestra.run.smithi017.stdout:2022 read 0xa9c160 thru 0xaa5b5e (0x99ff bytes) 2024-09-18T05:14:18.506 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:18.506+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:18.547 INFO:teuthology.orchestra.run.smithi017.stdout:2023 write 0xd0b4f5e thru 0xd0bbc25 (0x6cc8 bytes) 2024-09-18T05:14:18.564 INFO:teuthology.orchestra.run.smithi017.stdout:2024 trunc from 0xd0bbc26 to 0xeb3f087 2024-09-18T05:14:18.578 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:18.578 INFO:teuthology.orchestra.run.smithi017.stdout:2026 punch from 0x738f74 to 0x73d5fc, (0x4688 bytes) 2024-09-18T05:14:18.578 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:18.578 INFO:teuthology.orchestra.run.smithi017.stdout:2031 write 0xb9af11a thru 0xb9b2935 (0x381c bytes) 2024-09-18T05:14:18.581 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:18.581 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:18.589 INFO:teuthology.orchestra.run.smithi017.stdout:2032 punch from 0x8f8757e to 0x8f8a48c, (0x2f0e bytes) 2024-09-18T05:14:18.589 INFO:teuthology.orchestra.run.smithi017.stdout:2033 read 0xd47d8c7 thru 0xd47ff1c (0x2656 bytes) 2024-09-18T05:14:18.590 INFO:teuthology.orchestra.run.smithi017.stdout:2034 clone 15 order 22 su 524288 sc 6 2024-09-18T05:14:18.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:14:18.643 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:18.642+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:18.706 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:18.706+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:18.766 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:18.766 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:18.780 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:14:18.823 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:18.822+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:18.909 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:18.902+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:18.949 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:18.949 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:18.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:19.010 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:19.010+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:19.031 INFO:teuthology.orchestra.run.smithi017.stdout:flattening image image_client.0-clone14 2024-09-18T05:14:19.108 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:19.108 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:19.110 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:19.110+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:19.126 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:19.214 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:19.214+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:19.287 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:19.287 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:19.301 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:19.347 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:19.346+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:19.380 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-18T05:14:19.413 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:19.410+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:19.469 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:19.469 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:19.483 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:19.490 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:19.527 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:19.526+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:19.615 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:19.614+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:19.616 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:19.617 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:19.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:19.671 INFO:teuthology.orchestra.run.smithi017.stdout:2035 read 0xe11534b thru 0xe122337 (0xcfed bytes) 2024-09-18T05:14:19.673 INFO:teuthology.orchestra.run.smithi017.stdout:2036 read 0xa46c474 thru 0xa4741d3 (0x7d60 bytes) 2024-09-18T05:14:19.673 INFO:teuthology.orchestra.run.smithi017.stdout:2037 writesame 0x1f8ad5c thru 0x1f92981 data_size 0x3(0x7c26 bytes) 2024-09-18T05:14:19.677 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:19.678 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:19.695 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:19.695 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:19.697 INFO:teuthology.orchestra.run.smithi017.stdout:2038 read 0x119fda thru 0x1224fe (0x8525 bytes) 2024-09-18T05:14:19.697 INFO:teuthology.orchestra.run.smithi017.stdout:2039 punch from 0x23beec6 to 0x23c3c98, (0x4dd2 bytes) 2024-09-18T05:14:19.697 INFO:teuthology.orchestra.run.smithi017.stdout:2041 punch from 0x42f19ae to 0x42f9107, (0x7759 bytes) 2024-09-18T05:14:19.697 INFO:teuthology.orchestra.run.smithi017.stdout:2042 read 0x42000c thru 0x4219b2 (0x19a7 bytes) 2024-09-18T05:14:19.697 INFO:teuthology.orchestra.run.smithi017.stdout:2043 writesame 0xd4613f7 thru 0xd46ada7 data_size 0x5(0x99b1 bytes) 2024-09-18T05:14:19.705 INFO:teuthology.orchestra.run.smithi017.stdout:2044 read 0xbbf4fb7 thru 0xbc0206f (0xd0b9 bytes) 2024-09-18T05:14:19.705 INFO:teuthology.orchestra.run.smithi017.stdout:2045 write 0x353df74 thru 0x3541497 (0x3524 bytes) 2024-09-18T05:14:19.712 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:19.712 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:19.713 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:19.713 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:19.713 INFO:teuthology.orchestra.run.smithi017.stdout:2048 writesame 0xb806d79 thru 0xb811efa data_size 0x1(0xb182 bytes) 2024-09-18T05:14:19.715 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:19.710+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:19.729 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:19.755 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:19.755 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:19.755 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:19.755 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:19.755 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:19.766 INFO:teuthology.orchestra.run.smithi017.stdout:2049 writesame 0xa738b7a thru 0xa73f714 data_size 0xd(0x6b9b bytes) 2024-09-18T05:14:19.767 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:19.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:19.773 INFO:teuthology.orchestra.run.smithi017.stdout:2050 write 0x9b9fc6b thru 0x9ba9228 (0x95be bytes) 2024-09-18T05:14:19.783 INFO:teuthology.orchestra.run.smithi017.stdout:2051 trunc from 0xeb3f087 to 0xcbb14ab 2024-09-18T05:14:19.792 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:19.809 INFO:teuthology.orchestra.run.smithi017.stdout:2052 write 0x3ed5462 thru 0x3ed693d (0x14dc bytes) 2024-09-18T05:14:19.815 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:19.815 INFO:teuthology.orchestra.run.smithi017.stdout:2053 write 0x3051fff thru 0x305f76f (0xd771 bytes) 2024-09-18T05:14:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:19.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:19.810+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:19.822 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:19.822 INFO:teuthology.orchestra.run.smithi017.stdout:2055 write 0x9804de1 thru 0x9807c0b (0x2e2b bytes) 2024-09-18T05:14:19.823 INFO:teuthology.orchestra.run.smithi017.stdout:2056 punch from 0x8847cba to 0x88543f2, (0xc738 bytes) 2024-09-18T05:14:19.834 INFO:teuthology.orchestra.run.smithi017.stdout:2059 write 0xee40962 thru 0xee43e4f (0x34ee bytes) 2024-09-18T05:14:19.836 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:19.837 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:19.840 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:19.840 INFO:teuthology.orchestra.run.smithi017.stdout:2062 read 0xade99e0 thru 0xadf6b46 (0xd167 bytes) 2024-09-18T05:14:19.840 INFO:teuthology.orchestra.run.smithi017.stdout:2063 read 0x58b86f7 thru 0x58c1b0e (0x9418 bytes) 2024-09-18T05:14:19.840 INFO:teuthology.orchestra.run.smithi017.stdout:2064 read 0x5d24436 thru 0x5d2545e (0x1029 bytes) 2024-09-18T05:14:19.840 INFO:teuthology.orchestra.run.smithi017.stdout:2065 writesame 0xa34b149 thru 0xa34f6f9 data_size 0x13(0x45b1 bytes) 2024-09-18T05:14:19.846 INFO:teuthology.orchestra.run.smithi017.stdout:2066 read 0xeb64ca4 thru 0xeb6fc95 (0xaff2 bytes) 2024-09-18T05:14:19.848 INFO:teuthology.orchestra.run.smithi017.stdout:2068 read 0x3a938e thru 0x3b3d3c (0xa9af bytes) 2024-09-18T05:14:19.848 INFO:teuthology.orchestra.run.smithi017.stdout:2070 write 0xb3d2cea thru 0xb3d751b (0x4832 bytes) 2024-09-18T05:14:19.855 INFO:teuthology.orchestra.run.smithi017.stdout:2071 punch from 0xb70b7ec to 0xb71181e, (0x6032 bytes) 2024-09-18T05:14:19.855 INFO:teuthology.orchestra.run.smithi017.stdout:2073 read 0xa71f3ae thru 0xa722548 (0x319b bytes) 2024-09-18T05:14:19.855 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:19.855 INFO:teuthology.orchestra.run.smithi017.stdout:2077 punch from 0x515fb66 to 0x5167bf1, (0x808b bytes) 2024-09-18T05:14:19.856 INFO:teuthology.orchestra.run.smithi017.stdout:2078 write 0xa84f056 thru 0xa85d1ab (0xe156 bytes) 2024-09-18T05:14:19.861 INFO:teuthology.orchestra.run.smithi017.stdout:2079 read 0x18dcfbd thru 0x18e8d39 (0xbd7d bytes) 2024-09-18T05:14:19.861 INFO:teuthology.orchestra.run.smithi017.stdout:2080 write 0xdf74b6a thru 0xdf7ad63 (0x61fa bytes) 2024-09-18T05:14:19.864 INFO:teuthology.orchestra.run.smithi017.stdout:2082 writesame 0x5dc4913 thru 0x5dc4d48 data_size 0xe(0x436 bytes) 2024-09-18T05:14:19.870 INFO:teuthology.orchestra.run.smithi017.stdout:2084 write 0x265311a thru 0x2653bd9 (0xac0 bytes) 2024-09-18T05:14:19.876 INFO:teuthology.orchestra.run.smithi017.stdout:2085 write 0x9bfb289 thru 0x9c0551f (0xa297 bytes) 2024-09-18T05:14:19.883 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:19.883 INFO:teuthology.orchestra.run.smithi017.stdout:2088 writesame 0xe6397b4 thru 0xe642222 data_size 0x1(0x8a6f bytes) 2024-09-18T05:14:19.900 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:19.900 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:19.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:19.900 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16825 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1474560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.676040508, 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026210823000000001, 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16825 2024-09-18T05:14:19.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.902 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:19.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219596+0000", 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219602+0000", 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999999e-06 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219620+0000", 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7920000000000001e-05 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219633+0000", 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3113e-05 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245513+0000", 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025879669000000001 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245662+0000", 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149009 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245807+0000", 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145589 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16826 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.675991152000002, 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026570620999999999, 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16826 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219645+0000", 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219652+0000", 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4570000000000002e-06 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219670+0000", 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8295999999999999e-05 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219704+0000", 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4536000000000003e-05 2024-09-18T05:14:19.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245864+0000", 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026159953 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246030+0000", 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016550899999999999 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246217+0000", 2024-09-18T05:14:19.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018675300000000001 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16885 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2752512~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.674242418999999, 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026057257, 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.912 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16885 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221394+0000", 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221400+0000", 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.533e-06 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221418+0000", 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8029999999999998e-05 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221432+0000", 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3453e-05 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247088+0000", 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025655971999999999 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247255+0000", 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167066 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247452+0000", 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019720600000000001 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16886 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.674193638999999, 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026360268999999999, 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16886 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221442+0000", 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221455+0000", 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2116000000000001e-05 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221472+0000", 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.787e-05 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221486+0000", 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3573e-05 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247512+0000", 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026025942999999999 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247647+0000", 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000134859 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247804+0000", 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015688099999999999 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16887 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.920 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.674138880000001, 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026704731999999998, 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16887 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221497+0000", 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221503+0000", 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2700000000000001e-06 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221522+0000", 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221535+0000", 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3556e-05 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247862+0000", 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026326385000000001 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248014+0000", 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152168 2024-09-18T05:14:19.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248203+0000", 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000189276 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16888 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.925 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.674088853000001, 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027263773000000002, 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16888 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221547+0000", 2024-09-18T05:14:19.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221554+0000", 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1430000000000001e-06 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221572+0000", 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7609999999999999e-05 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221585+0000", 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2639999999999999e-05 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248308+0000", 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026723558000000001 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248546+0000", 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000237741 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248812+0000", 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026612100000000002 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16889 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.674040543, 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027689516000000001, 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16889 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.931 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221595+0000", 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221602+0000", 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0169999999999999e-06 2024-09-18T05:14:19.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221621+0000", 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8386e-05 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221634+0000", 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.341e-05 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248882+0000", 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027247771 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249066+0000", 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018403000000000001 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249286+0000", 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219986 2024-09-18T05:14:19.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16890 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.673991497999999, 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028101418999999999, 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16890 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221645+0000", 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221650+0000", 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7939999999999999e-06 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221667+0000", 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6616000000000002e-05 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221680+0000", 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2663999999999999e-05 2024-09-18T05:14:19.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249351+0000", 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027670808000000002 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249539+0000", 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000188505 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249747+0000", 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020795199999999999 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16947 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2654208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.672812807, 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027363044999999999, 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.941 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16947 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:19.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222822+0000", 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222856+0000", 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316999999999997e-05 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222891+0000", 2024-09-18T05:14:19.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4273000000000002e-05 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222914+0000", 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3119e-05 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249808+0000", 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026894668 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249979+0000", 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017036699999999999 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250187+0000", 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020850400000000001 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16948 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.672703061, 2024-09-18T05:14:19.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027712835000000002, 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16948 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222933+0000", 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222941+0000", 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2330000000000006e-06 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222961+0000", 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9933999999999999e-05 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222976+0000", 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5486e-05 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250249+0000", 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027272951 2024-09-18T05:14:19.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250424+0000", 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017490999999999999 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250647+0000", 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000222761 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16949 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.672647827999999, 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028222578000000002, 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16949 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222988+0000", 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222995+0000", 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7059999999999998e-06 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223013+0000", 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8267e-05 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223027+0000", 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3852999999999999e-05 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250733+0000", 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027705456 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250935+0000", 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020255800000000001 2024-09-18T05:14:19.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251212+0000", 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027678400000000003 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16950 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.672597488000001, 2024-09-18T05:14:19.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028659265999999999, 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16950 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:19.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223039+0000", 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223045+0000", 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1500000000000004e-06 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223062+0000", 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223076+0000", 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3495999999999999e-05 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251277+0000", 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028201066 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251460+0000", 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018261199999999999 2024-09-18T05:14:19.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251699+0000", 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000239359 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16951 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.672549095000001, 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029073671999999998, 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16951 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223087+0000", 2024-09-18T05:14:19.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223093+0000", 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.003e-06 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223110+0000", 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7024000000000002e-05 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223124+0000", 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3682999999999999e-05 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251760+0000", 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028636582000000001 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251957+0000", 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019702399999999999 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252162+0000", 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020431299999999999 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16952 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.672499412000001, 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029652123999999998, 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16952 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223136+0000", 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223143+0000", 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9600000000000003e-06 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223160+0000", 2024-09-18T05:14:19.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.721e-05 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223173+0000", 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2486e-05 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252238+0000", 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029065160999999999 2024-09-18T05:14:19.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252459+0000", 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022082100000000001 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252790+0000", 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033094299999999999 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.969 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16953 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.672453349000001, 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030055742999999999, 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16953 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223183+0000", 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223188+0000", 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223205+0000", 2024-09-18T05:14:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6359999999999999e-05 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223217+0000", 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2296000000000001e-05 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252853+0000", 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029636077 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253035+0000", 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018143900000000001 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253239+0000", 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000204878 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16954 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.672410172999999, 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030518435, 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16954 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223226+0000", 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223231+0000", 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9529999999999998e-06 2024-09-18T05:14:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223249+0000", 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7754e-05 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223261+0000", 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.198e-05 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253312+0000", 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030051123999999999 2024-09-18T05:14:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253507+0000", 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019456700000000001 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253745+0000", 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023878699999999999 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17135 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.665960085999998, 2024-09-18T05:14:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026407401, 2024-09-18T05:14:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17135 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229676+0000", 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229683+0000", 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0400000000000004e-06 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229701+0000", 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8182999999999999e-05 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229714+0000", 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3193000000000001e-05 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255689+0000", 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025974962000000001 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255873+0000", 2024-09-18T05:14:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018339300000000001 2024-09-18T05:14:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256084+0000", 2024-09-18T05:14:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021176999999999999 2024-09-18T05:14:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17136 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.665911789999999, 2024-09-18T05:14:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026860747000000001, 2024-09-18T05:14:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17136 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229724+0000", 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229730+0000", 2024-09-18T05:14:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6629999999999998e-06 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229746+0000", 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6293000000000001e-05 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229759+0000", 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2747e-05 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256148+0000", 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026389072999999999 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256345+0000", 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019683799999999999 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256586+0000", 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024106999999999999 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17137 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.665867321, 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027322796999999999, 2024-09-18T05:14:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17137 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229769+0000", 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229775+0000", 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6169999999999998e-06 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229791+0000", 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6126000000000001e-05 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229804+0000", 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2917e-05 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256654+0000", 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026850816 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256857+0000", 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020282399999999999 2024-09-18T05:14:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257093+0000", 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023535 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17138 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.665821477000001, 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027760476999999999, 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17138 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229815+0000", 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229820+0000", 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7729999999999996e-06 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229838+0000", 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7113e-05 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229850+0000", 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2320000000000001e-05 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257154+0000", 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027304357000000001 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257348+0000", 2024-09-18T05:14:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000193322 2024-09-18T05:14:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257576+0000", 2024-09-18T05:14:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000228569 2024-09-18T05:14:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.001 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:20.001 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:14:20.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:20.004 INFO:teuthology.orchestra.run.smithi017.stdout:2089 writesame 0xe6cd194 thru 0xe6d9d10 data_size 0x1(0xcb7d bytes) 2024-09-18T05:14:20.004 INFO:teuthology.orchestra.run.smithi017.stdout:2091 read 0x806fec6 thru 0x807185a (0x1995 bytes) 2024-09-18T05:14:20.004 INFO:teuthology.orchestra.run.smithi017.stdout:2092 clone 16 order 19 su 2048 sc 5 2024-09-18T05:14:20.004 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:19.998+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:20.104 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:20.098+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:20.171 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:20.171 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:20.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:20.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:20.230+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:20.307 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:20.306+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:20.351 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:20.351 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:20.351 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:20.351 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:20.351 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:20.366 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:20.411 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:20.406+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:20.486 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.250796880999999, 2024-09-18T05:14:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:20.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:20.490 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.250729271000001, 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.491 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:20.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.250681884999999, 2024-09-18T05:14:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:20.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:20.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:20.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.250636479000001, 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:20.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.250591189000001, 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:20.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248956637999999, 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:20.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:20.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:20.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248904319000001, 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:20.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.524 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248786676000002, 2024-09-18T05:14:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:20.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248724757000002, 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:20.535 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248666337, 2024-09-18T05:14:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.536 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248612711, 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248565648, 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248505568999999, 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248445281999999, 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248377966, 2024-09-18T05:14:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248329363, 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248255744000001, 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248182261, 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248125671, 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.248079538999999, 2024-09-18T05:14:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:20.589 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:20.590 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:20.590 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:20.582+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:20.691 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:20.686+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:20.762 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:20.762 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:20.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:20.819 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:20.814+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:20.894 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:20.890+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:20.913 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:14:20.954 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:20.955 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:20.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:20.994 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:20.994+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:21.015 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone15 from 0xee43e50 (overlap 0xcbb14ab) to 0x145e877 2024-09-18T05:14:21.098 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:21.094+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:21.155 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1059 3.4 e26/22 3:2547571c:::rbd_data.118b4598dbfb.0000000000000108:head v 26'5, mlcod=25'3)", 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.657474612000001, 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021306210000000001, 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494008+0000", 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494034+0000", 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5865999999999999e-05 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494066+0000", 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2317999999999998e-05 2024-09-18T05:14:21.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494080+0000", 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4482e-05 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494200+0000", 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119744 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494258+0000", 2024-09-18T05:14:21.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8082999999999999e-05 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.496043+0000", 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001784887 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.496140+0000", 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7351999999999999e-05 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1160 3.9 e26/22 3:93ecdcc7:::rbd_data.118b4598dbfb.000000000000005f:head v 26'6, mlcod=26'4)", 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.587047953999999, 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020475789999999999, 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564434+0000", 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564473+0000", 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8977000000000003e-05 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564501+0000", 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7582000000000001e-05 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564514+0000", 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3134e-05 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564633+0000", 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011863500000000001 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564699+0000", 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6447999999999998e-05 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.566372+0000", 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016731459999999999 2024-09-18T05:14:21.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.566484+0000", 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011178799999999999 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1175 3.0 e26/22 3:0163bb0f:::rbd_data.118b4598dbfb.00000000000000ee:head v 26'9, mlcod=26'7)", 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.558891268, 2024-09-18T05:14:21.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021239800000000001, 2024-09-18T05:14:21.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.167 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592590+0000", 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592614+0000", 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3220000000000001e-05 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592670+0000", 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5939000000000001e-05 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592717+0000", 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7647e-05 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592964+0000", 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024644400000000001 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.593019+0000", 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5457000000000001e-05 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.594550+0000", 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015306510000000001 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.594717+0000", 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016734900000000001 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1432 3.4 e26/22 3:207a8b3d:::rbd_data.118b4598dbfb.000000000000005b:head v 26'7, mlcod=26'5)", 2024-09-18T05:14:21.171 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.386402260000001, 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020916770000000001, 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765080+0000", 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765140+0000", 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0813000000000002e-05 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765182+0000", 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1480000000000003e-05 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765203+0000", 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1126000000000001e-05 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765334+0000", 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000130636 2024-09-18T05:14:21.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765403+0000", 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9096000000000004e-05 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.767072+0000", 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001668861 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.767174+0000", 2024-09-18T05:14:21.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000102132 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.329047626000001, 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:21.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:21.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:14:21.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:21.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:14:21.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:14:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.181 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1476 3.4 e26/22 3:207a8b3d:::rbd_data.118b4598dbfb.000000000000005b:head v 26'8, mlcod=26'6)", 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.318627837000001, 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022241629999999999, 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:21.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:21.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832855+0000", 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832871+0000", 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5862000000000002e-05 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832903+0000", 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832919+0000", 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6277e-05 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.833081+0000", 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016194899999999999 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.833154+0000", 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3226000000000007e-05 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834997+0000", 2024-09-18T05:14:21.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018433340000000001 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.835081+0000", 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3354000000000002e-05 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:2097 3.4 e26/22 3:2079477c:::rbd_data.118b4598dbfb.00000000000001d4:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:21.187 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.964797694000001, 2024-09-18T05:14:21.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021624840000000001, 2024-09-18T05:14:21.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.188 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186684+0000", 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186707+0000", 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2823000000000002e-05 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186756+0000", 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9459999999999997e-05 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186777+0000", 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0809999999999999e-05 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.187161+0000", 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038411000000000001 2024-09-18T05:14:21.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.187218+0000", 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7065999999999999e-05 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.188759+0000", 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001540535 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.188849+0000", 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0489999999999996e-05 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:9001 3.4 e29/22 3:224b1375:::rbd_data.118beb25b049.0000000000000128:head v 29'42, mlcod=29'40)", 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.18952341, 2024-09-18T05:14:21.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002309742, 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:21.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961959+0000", 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962023+0000", 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3678999999999998e-05 2024-09-18T05:14:21.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962057+0000", 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4606e-05 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962078+0000", 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1109999999999999e-05 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962204+0000", 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125306 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962271+0000", 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7009999999999997e-05 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964181+0000", 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019100619999999999 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964271+0000", 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9819000000000002e-05 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16114 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'50, mlcod=32'48)", 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 20.431344809999999, 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020637609999999999, 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.198 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720138+0000", 2024-09-18T05:14:21.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720178+0000", 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0635e-05 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720204+0000", 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5660000000000002e-05 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720215+0000", 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1222e-05 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720390+0000", 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017476300000000001 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720431+0000", 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.108e-05 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.722119+0000", 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016880269999999999 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.722203+0000", 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4419000000000006e-05 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:14:21.202 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 20.335409883000001, 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:21.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 20.332793085999999, 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:21.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:14:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16290 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'52, mlcod=32'49)", 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 20.331702382, 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023378159999999999, 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819780+0000", 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819796+0000", 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325999999999999e-05 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819826+0000", 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9583000000000001e-05 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819845+0000", 2024-09-18T05:14:21.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8597000000000002e-05 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819950+0000", 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105356 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820003+0000", 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3295999999999999e-05 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822018+0000", 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020151779999999998 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822120+0000", 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101316 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 20.250257573999999, 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:21.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:21.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:14:21.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.875719880999998, 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.222 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:14:21.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:14:21.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17196 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'90, mlcod=32'86)", 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.867833299000001, 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023459290000000001, 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283650+0000", 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283663+0000", 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2697999999999999e-05 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283682+0000", 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9012999999999999e-05 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283691+0000", 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7720000000000006e-06 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283777+0000", 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5923999999999999e-05 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283830+0000", 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2320000000000001e-05 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285942+0000", 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002112039 2024-09-18T05:14:21.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285997+0000", 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5322000000000003e-05 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21826 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'62, mlcod=36'60)", 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.834090058999999, 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002048064, 2024-09-18T05:14:21.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317391+0000", 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317425+0000", 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3492999999999999e-05 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317462+0000", 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7543000000000003e-05 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317480+0000", 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7960000000000001e-05 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317588+0000", 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107654 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317641+0000", 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2675e-05 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.319355+0000", 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017144059999999999 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.319442+0000", 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7349999999999995e-05 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21886 3.9 e36/22 3:969ecc48:::rbd_data.118ba5d0bdf6.000000000000010b:head v 36'64, mlcod=36'62)", 2024-09-18T05:14:21.235 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.681992709999999, 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021557630000000002, 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:21.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469489+0000", 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469514+0000", 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5269000000000002e-05 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469558+0000", 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.401e-05 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469581+0000", 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2422999999999999e-05 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469722+0000", 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014086900000000001 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469780+0000", 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8362999999999997e-05 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471554+0000", 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001774156 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471647+0000", 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3256000000000003e-05 2024-09-18T05:14:21.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21891 3.0 e36/22 3:04d4c8a4:::rbd_data.118ba5d0bdf6.0000000000000259:head v 36'100, mlcod=36'98)", 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.681711416000001, 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022905260000000002, 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469771+0000", 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469789+0000", 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.821e-05 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469821+0000", 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1335999999999999e-05 2024-09-18T05:14:21.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469839+0000", 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-05 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469944+0000", 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104576 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469996+0000", 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2102999999999999e-05 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471954+0000", 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019575980000000001 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472063+0000", 2024-09-18T05:14:21.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010984600000000001 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21892 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'65, mlcod=36'62)", 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.680747390000001, 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023311389999999999, 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.246 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:21.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470735+0000", 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470750+0000", 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470788+0000", 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7252999999999997e-05 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470806+0000", 2024-09-18T05:14:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8105999999999999e-05 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470949+0000", 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014359600000000001 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471048+0000", 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8888999999999995e-05 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472956+0000", 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019074820000000001 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.473068+0000", 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011240599999999999 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.184790699000001, 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:14:21.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:14:21.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:14:21.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.256 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:21.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:21.258 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-18T05:14:21.258 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:21.250+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:21.359 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:21.354+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:21.423 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:21.423 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:21.423 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:21.423 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:21.439 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:21.487 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:21.482+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:21.561 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:21.558+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:21.610 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:21.610 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:21.610 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:21.610 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:21.610 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:21.618 INFO:teuthology.orchestra.run.smithi017.stdout:2093 read 0x2823c77 thru 0x282ca15 (0x8d9f bytes) 2024-09-18T05:14:21.619 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:21.619 INFO:teuthology.orchestra.run.smithi017.stdout:2096 punch from 0x544176e to 0x544c0e1, (0xa973 bytes) 2024-09-18T05:14:21.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:21.629 INFO:teuthology.orchestra.run.smithi017.stdout:2097 read 0xc4581fa thru 0xc45829d (0xa4 bytes) 2024-09-18T05:14:21.630 INFO:teuthology.orchestra.run.smithi017.stdout:2098 write 0x12c3981 thru 0x12c8a43 (0x50c3 bytes) 2024-09-18T05:14:21.663 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:21.658+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:21.741 INFO:teuthology.orchestra.run.smithi017.stdout:2101 writesame 0xe4ce3b7 thru 0xe4d74ec data_size 0x1(0x9136 bytes) 2024-09-18T05:14:21.763 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:21.758+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:21.779 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:21.779 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:21.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:21.779 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:21.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.779 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.779 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:21.779 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.865612264999999, 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:14:21.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:14:21.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:14:21.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:14:21.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.865581322000001, 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:21.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.788 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.865555757999999, 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:14:21.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:14:21.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:14:21.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:14:21.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.793 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.865531042000001, 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.865504808000001, 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:21.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.802 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.865475899, 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.806 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.865452069, 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:14:21.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.865427593, 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:21.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:21.815 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.865309794000002, 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:14:21.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:14:21.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.862317838999999, 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.823 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.862239776999999, 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:14:21.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.86220849, 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.862182477000001, 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:14:21.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.862154704000002, 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.837 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:21.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.862129640999999, 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:14:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.862104610999999, 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:14:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:14:21.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1854 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 540672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916718+0000", 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.858003592999999, 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097779173999999996, 2024-09-18T05:14:21.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1854 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916718+0000", 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916718+0000", 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916717+0000", 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916723+0000", 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6470000000000003e-06 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916730+0000", 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2049999999999996e-06 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916736+0000", 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014179+0000", 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097443396000000002 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014342+0000", 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016297600000000001 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014497+0000", 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015457900000000001 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.854 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.857980283, 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.857959738000002, 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:14:21.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.857940056, 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:21.863 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:21.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:14:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:14:21.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:21.867 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:21.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:21.869 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:21.870 INFO:teuthology.orchestra.run.smithi017.stdout:2102 writesame 0x1f20a79 thru 0x1f278f1 data_size 0xb(0x6e79 bytes) 2024-09-18T05:14:21.870 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:21.866+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:21.872 INFO:teuthology.orchestra.run.smithi017.stdout:2103 write 0xa4d53b5 thru 0xa4d623e (0xe8a bytes) 2024-09-18T05:14:21.945 INFO:teuthology.orchestra.run.smithi017.stdout:2104 write 0x4a5148e thru 0x4a5dcca (0xc83d bytes) 2024-09-18T05:14:21.969 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:21.962+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:21.998 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:21.999 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:22.014 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:22.022 INFO:teuthology.orchestra.run.smithi017.stdout:2107 trunc from 0xee43e50 to 0x2db8b00 2024-09-18T05:14:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:22.056 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:22.056 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:22.070 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:22.066+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:22.073 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:22.073 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:22.089 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:22.089 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:22.103 INFO:teuthology.orchestra.run.smithi017.stdout:2108 write 0x7980f43 thru 0x798bfee (0xb0ac bytes) 2024-09-18T05:14:22.107 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:22.111 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:22.111 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:22.111 INFO:teuthology.orchestra.run.smithi017.stdout:2111 punch from 0x5eb40b6 to 0x5eb559b, (0x14e5 bytes) 2024-09-18T05:14:22.121 INFO:teuthology.orchestra.run.smithi017.stdout:2112 trunc from 0x798bfef to 0xe37f64c 2024-09-18T05:14:22.125 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:22.125 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:22.126 INFO:teuthology.orchestra.run.smithi017.stdout:2113 writesame 0xc44dfad thru 0xc45b9ca data_size 0x1(0xda1e bytes) 2024-09-18T05:14:22.144 INFO:teuthology.orchestra.run.smithi017.stdout:2115 write 0x2d34be5 thru 0x2d3c7ce (0x7bea bytes) 2024-09-18T05:14:22.149 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:22.150 INFO:teuthology.orchestra.run.smithi017.stdout:2117 read 0x3f28f3b thru 0x3f35ee4 (0xcfaa bytes) 2024-09-18T05:14:22.150 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:22.150 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:22.150 INFO:teuthology.orchestra.run.smithi017.stdout:2118 trunc from 0xe37f64c to 0xb04d63e 2024-09-18T05:14:22.162 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:22.162 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:22.168 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:22.168 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:22.169 INFO:teuthology.orchestra.run.smithi017.stdout:2119 trunc from 0xb04d63e to 0x66d152a 2024-09-18T05:14:22.171 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:22.170+0000 7ff533706640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26330) UID: 0 2024-09-18T05:14:22.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:2123 read 0x5381f49 thru 0x5389dcb (0x7e83 bytes) 2024-09-18T05:14:22.192 INFO:teuthology.orchestra.run.smithi017.stdout:2125 write 0x9b4e861 thru 0x9b57e7d (0x961d bytes) 2024-09-18T05:14:22.246 INFO:teuthology.orchestra.run.smithi017.stdout:2127 read 0x1465a84 thru 0x14672bb (0x1838 bytes) 2024-09-18T05:14:22.247 INFO:teuthology.orchestra.run.smithi017.stdout:2128 read 0x186a003 thru 0x186b103 (0x1101 bytes) 2024-09-18T05:14:22.249 INFO:teuthology.orchestra.run.smithi017.stdout:2129 read 0x61fdea thru 0x62f5ef (0xf806 bytes) 2024-09-18T05:14:22.261 INFO:teuthology.orchestra.run.smithi017.stdout:2130 read 0x94a8ef4 thru 0x94ae11d (0x522a bytes) 2024-09-18T05:14:22.272 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:22.266+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:22.278 INFO:teuthology.orchestra.run.smithi017.stdout:2131 write 0xc32b044 thru 0xc32eca7 (0x3c64 bytes) 2024-09-18T05:14:22.308 INFO:teuthology.orchestra.run.smithi017.stdout:2132 trunc from 0xc32eca8 to 0x4b4f98f 2024-09-18T05:14:22.331 INFO:teuthology.orchestra.run.smithi017.stdout:2133 read 0x30e2ff4 thru 0x30ea5b2 (0x75bf bytes) 2024-09-18T05:14:22.331 INFO:teuthology.orchestra.run.smithi017.stdout:2134 punch from 0x46c96b4 to 0x46c9760, (0xac bytes) 2024-09-18T05:14:22.334 INFO:teuthology.orchestra.run.smithi017.stdout:2136 trunc from 0x4b4f98f to 0x386d885 2024-09-18T05:14:22.339 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T05:14:22.339 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:14:22.340 INFO:tasks.thrashosds.thrasher:Killing osd 6, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T05:14:22.340 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-18T05:14:22.340 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:14:22.347 INFO:teuthology.orchestra.run.smithi017.stdout:2138 read 0x3043823 thru 0x304c707 (0x8ee5 bytes) 2024-09-18T05:14:22.347 INFO:teuthology.orchestra.run.smithi017.stdout:2141 read 0x258f00c thru 0x25965f0 (0x75e5 bytes) 2024-09-18T05:14:22.347 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:22.348 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:22.349 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:22.359 INFO:teuthology.orchestra.run.smithi017.stdout:2143 write 0x3a671fc thru 0x3a75907 (0xe70c bytes) 2024-09-18T05:14:22.363 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:22.371 INFO:teuthology.orchestra.run.smithi017.stdout:2145 read 0x2e14123 thru 0x2e1b48d (0x736b bytes) 2024-09-18T05:14:22.372 INFO:teuthology.orchestra.run.smithi017.stdout:2148 writesame 0x9d7b97 thru 0x9de91f data_size 0x3(0x6d89 bytes) 2024-09-18T05:14:22.410 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:22.406+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:22.413 INFO:tasks.ceph.osd.6:Stopped 2024-09-18T05:14:22.413 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.6 2024-09-18T05:14:22.413 INFO:tasks.thrashosds.thrasher:remote for osd 6 is ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:14:22.413 DEBUG:teuthology.orchestra.run.smithi086:> type ceph-objectstore-tool 2024-09-18T05:14:22.458 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T05:14:22.458 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --op list-pgs 2024-09-18T05:14:22.505 INFO:teuthology.orchestra.run.smithi017.stdout:2149 write 0x17557c5 thru 0x175f7cf (0xa00b bytes) 2024-09-18T05:14:22.507 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:22.506+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:22.557 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:22.557 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:22.575 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:22.570+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:22.576 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:22.675 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:22.674+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:22.692 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:22.692 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:22.706 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:22.791 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:22.790+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:22.868 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:22.868 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:22.878 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:22.870+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:22.886 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:22.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:14:22.979 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:22.978+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:23.054 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:23.054 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:23.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:23.079 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:23.074+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:23.181 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:23.178+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:23.226 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:23.227 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:23.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:23.287 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:23.286+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:23.386 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:23.382+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:23.409 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:23.409 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:23.424 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:23.487 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:23.482+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:23.557 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:23.557 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:23.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:23.619 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:23.614+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:23.689 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:23.686+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:23.728 INFO:teuthology.orchestra.run.smithi086.stdout:3.a 2024-09-18T05:14:23.728 INFO:teuthology.orchestra.run.smithi086.stdout:3.1e 2024-09-18T05:14:23.728 INFO:teuthology.orchestra.run.smithi086.stdout:3.10 2024-09-18T05:14:23.728 INFO:teuthology.orchestra.run.smithi086.stdout:2.7 2024-09-18T05:14:23.728 INFO:teuthology.orchestra.run.smithi086.stdout:2.6 2024-09-18T05:14:23.750 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:23.750 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:23.764 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:23.791 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:23.786+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:23.892 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:23.886+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:23.892 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:23.892 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:23.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:23.927 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:14:23.987 INFO:teuthology.orchestra.run.smithi017.stdout:2152 read 0x1c102ee thru 0x1c19bc6 (0x98d9 bytes) 2024-09-18T05:14:23.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:23.986+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:24.008 INFO:teuthology.orchestra.run.smithi017.stdout:2154 writesame 0xb8908fc thru 0xb8968ba data_size 0x1(0x5fbf bytes) 2024-09-18T05:14:24.019 INFO:teuthology.orchestra.run.smithi017.stdout:2155 write 0xc04a350 thru 0xc05933f (0xeff0 bytes) 2024-09-18T05:14:24.035 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:24.035 INFO:teuthology.orchestra.run.smithi017.stdout:2159 punch from 0x87c0345 to 0x87c5bcc, (0x5887 bytes) 2024-09-18T05:14:24.050 INFO:teuthology.orchestra.run.smithi017.stdout:2160 trunc from 0xc059340 to 0x1be60bb 2024-09-18T05:14:24.068 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:24.068 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:24.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:24.093 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:24.090+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:24.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:24.194 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:24.186+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:24.219 INFO:teuthology.orchestra.run.smithi017.stdout:2162 write 0xc5b0991 thru 0xc5b4a74 (0x40e4 bytes) 2024-09-18T05:14:24.229 INFO:teuthology.orchestra.run.smithi017.stdout:2163 read 0x23e5ecd thru 0x23e80e5 (0x2219 bytes) 2024-09-18T05:14:24.229 INFO:teuthology.orchestra.run.smithi017.stdout:2167 write 0xa6afe4 thru 0xa75ec9 (0xaee6 bytes) 2024-09-18T05:14:24.285 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --op export --pgid 2.7 --file /var/log/ceph/exp.2.7.6 2024-09-18T05:14:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:24.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:24.331 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:24.330+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:24.333 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:24.343 INFO:teuthology.orchestra.run.smithi017.stdout:2169 write 0xe6c17a3 thru 0xe6c2bbc (0x141a bytes) 2024-09-18T05:14:24.353 INFO:teuthology.orchestra.run.smithi017.stdout:2170 write 0x9b82a9 thru 0x9c46b0 (0xc408 bytes) 2024-09-18T05:14:24.358 INFO:teuthology.orchestra.run.smithi017.stdout:2171 writesame 0xaaf8dae thru 0xaafe3da data_size 0x1(0x562d bytes) 2024-09-18T05:14:24.368 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:24.368 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:24.371 INFO:teuthology.orchestra.run.smithi017.stdout:2173 read 0xae92c66 thru 0xae93301 (0x69c bytes) 2024-09-18T05:14:24.386 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:24.387 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:24.390 INFO:teuthology.orchestra.run.smithi017.stdout:2175 trunc from 0xe6c2bbd to 0xcddde4 2024-09-18T05:14:24.395 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:24.390+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:24.418 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:24.449 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:24.473 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.253498078, 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.491 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.253430468000001, 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.495 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.253383081999999, 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.496 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:24.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:24.500 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.253337676000001, 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:24.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.253292385999998, 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:24.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251657835, 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.509 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:24.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:24.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:24.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:24.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251605516000001, 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:24.518 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251487872999999, 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:24.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251425953999998, 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:24.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251367534, 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.527 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:24.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:24.531 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251313908, 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:24.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.535 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251266845, 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:24.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:24.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251206765999999, 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:24.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251146478999999, 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.251079163, 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.25103056, 2024-09-18T05:14:24.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:24.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.250956940999998, 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.250883458000001, 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.562 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:24.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.250826868000001, 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.567 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:24.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.250780735999999, 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:24.575 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:24.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:24.577 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:24.577 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-18T05:14:24.577 INFO:teuthology.orchestra.run.smithi017.stdout:2176 read 0x44d28b thru 0x451fd9 (0x4d4f bytes) 2024-09-18T05:14:24.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:24.578 INFO:teuthology.orchestra.run.smithi017.stdout:2179 trunc from 0xcddde4 to 0x873c78f 2024-09-18T05:14:24.579 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:24.579 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:24.579 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:24.580 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:24.580 INFO:teuthology.orchestra.run.smithi017.stdout:2182 read 0x412a255 thru 0x412b660 (0x140c bytes) 2024-09-18T05:14:24.580 INFO:teuthology.orchestra.run.smithi017.stdout:2183 write 0x1b508e0 thru 0x1b5ad9a (0xa4bb bytes) 2024-09-18T05:14:24.580 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:14:24.581 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:14:24.581 INFO:teuthology.orchestra.run.smithi017.stdout:2184 read 0xae9274 thru 0xaf4ff7 (0xbd84 bytes) 2024-09-18T05:14:24.581 INFO:teuthology.orchestra.run.smithi017.stdout:2185 read 0x18b4956 thru 0x18c3fee (0xf699 bytes) 2024-09-18T05:14:24.581 INFO:teuthology.orchestra.run.smithi017.stdout:2186 read 0x497894 thru 0x4a6f33 (0xf6a0 bytes) 2024-09-18T05:14:24.582 INFO:teuthology.orchestra.run.smithi017.stdout:2187 trunc from 0x873c78f to 0x5e31e77 2024-09-18T05:14:24.582 INFO:teuthology.orchestra.run.smithi017.stdout:2188 trunc from 0x5e31e77 to 0x3dde7a5 2024-09-18T05:14:24.582 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:24.570+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:24.582 INFO:teuthology.orchestra.run.smithi017.stdout:2192 writesame 0xebb9354 thru 0xebc1806 data_size 0x17(0x84b3 bytes) 2024-09-18T05:14:24.582 INFO:teuthology.orchestra.run.smithi017.stdout:2193 punch from 0x2826b89 to 0x2828887, (0x1cfe bytes) 2024-09-18T05:14:24.583 INFO:teuthology.orchestra.run.smithi017.stdout:2195 read 0x4ee495 thru 0x4fb68a (0xd1f6 bytes) 2024-09-18T05:14:24.589 INFO:teuthology.orchestra.run.smithi017.stdout:2196 writesame 0xe051a5b thru 0xe056637 data_size 0x1(0x4bdd bytes) 2024-09-18T05:14:24.631 INFO:teuthology.orchestra.run.smithi017.stdout:2197 trunc from 0xebc1807 to 0x277351 2024-09-18T05:14:24.678 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:24.674+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:24.725 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:24.725 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:24.740 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:24.762 INFO:teuthology.orchestra.run.smithi017.stdout:2198 write 0x5a7359e thru 0x5a7f7f7 (0xc25a bytes) 2024-09-18T05:14:24.774 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:24.778 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:24.774+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:24.780 INFO:teuthology.orchestra.run.smithi017.stdout:2200 write 0x601e0a8 thru 0x6020ea1 (0x2dfa bytes) 2024-09-18T05:14:24.792 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:24.792 INFO:teuthology.orchestra.run.smithi017.stdout:2204 punch from 0x1933bc4 to 0x194320c, (0xf648 bytes) 2024-09-18T05:14:24.800 INFO:teuthology.orchestra.run.smithi017.stdout:2205 trunc from 0x6020ea2 to 0x7f7e23 2024-09-18T05:14:24.816 INFO:teuthology.orchestra.run.smithi017.stdout:2206 read 0x1afe05 thru 0x1b31da (0x33d6 bytes) 2024-09-18T05:14:24.834 INFO:teuthology.orchestra.run.smithi017.stdout:2207 write 0x830e017 thru 0x83139f4 (0x59de bytes) 2024-09-18T05:14:24.842 INFO:teuthology.orchestra.run.smithi017.stdout:2208 punch from 0x77eddda to 0x77f0756, (0x297c bytes) 2024-09-18T05:14:24.856 INFO:teuthology.orchestra.run.smithi017.stdout:2210 write 0xcc3b260 thru 0xcc3b4a0 (0x241 bytes) 2024-09-18T05:14:24.860 INFO:teuthology.orchestra.run.smithi017.stdout:2211 writesame 0x53e33ab thru 0x53ed540 data_size 0x25(0xa196 bytes) 2024-09-18T05:14:24.871 INFO:teuthology.orchestra.run.smithi017.stdout:2212 writesame 0x7b920f9 thru 0x7ba16cb data_size 0xb(0xf5d3 bytes) 2024-09-18T05:14:24.879 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:24.874+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:24.886 INFO:teuthology.orchestra.run.smithi017.stdout:2213 writesame 0x4eeba6b thru 0x4eeca53 data_size 0x1(0xfe9 bytes) 2024-09-18T05:14:24.889 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:24.890 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:24.890 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:24.897 INFO:teuthology.orchestra.run.smithi017.stdout:2214 write 0xb3d6703 thru 0xb3e36e3 (0xcfe1 bytes) 2024-09-18T05:14:24.905 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:2217 writesame 0xd2c89e2 thru 0xd2d11e8 data_size 0x1(0x8807 bytes) 2024-09-18T05:14:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:2220 write 0x6282f59 thru 0x6292287 (0xf32f bytes) 2024-09-18T05:14:24.934 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:24.934 INFO:teuthology.orchestra.run.smithi017.stdout:2224 read 0xe74689 thru 0xe7fe87 (0xb7ff bytes) 2024-09-18T05:14:24.934 INFO:teuthology.orchestra.run.smithi017.stdout:2225 punch from 0x6efff2c to 0x6f0c0c3, (0xc197 bytes) 2024-09-18T05:14:24.935 INFO:teuthology.orchestra.run.smithi017.stdout:2226 punch from 0x6b6c647 to 0x6b718ab, (0x5264 bytes) 2024-09-18T05:14:24.942 INFO:teuthology.orchestra.run.smithi017.stdout:2227 trunc from 0xd2d11e9 to 0x899a87a 2024-09-18T05:14:24.964 INFO:teuthology.orchestra.run.smithi017.stdout:2230 trunc from 0x899a87a to 0xb952cf5 2024-09-18T05:14:24.972 INFO:teuthology.orchestra.run.smithi017.stdout:2231 punch from 0x69941ac to 0x699ff70, (0xbdc4 bytes) 2024-09-18T05:14:24.972 INFO:teuthology.orchestra.run.smithi017.stdout:2232 read 0x5ac711e thru 0x5ace5fb (0x74de bytes) 2024-09-18T05:14:24.972 INFO:teuthology.orchestra.run.smithi017.stdout:2233 read 0xa89444f thru 0xa8a2a07 (0xe5b9 bytes) 2024-09-18T05:14:24.972 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:24.972 INFO:teuthology.orchestra.run.smithi017.stdout:2237 punch from 0xb34aea6 to 0xb35ac51, (0xfdab bytes) 2024-09-18T05:14:24.978 INFO:teuthology.orchestra.run.smithi017.stdout:2238 trunc from 0xb952cf5 to 0xe332e35 2024-09-18T05:14:24.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:24.974+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:24.986 INFO:teuthology.orchestra.run.smithi017.stdout:2239 writesame 0x8b187b6 thru 0x8b22028 data_size 0x1(0x9873 bytes) 2024-09-18T05:14:25.011 INFO:teuthology.orchestra.run.smithi017.stdout:2240 read 0x60b19e9 thru 0x60b570f (0x3d27 bytes) 2024-09-18T05:14:25.011 INFO:teuthology.orchestra.run.smithi017.stdout:2241 write 0xd8447c7 thru 0xd85022b (0xba65 bytes) 2024-09-18T05:14:25.025 INFO:teuthology.orchestra.run.smithi017.stdout:2243 read 0xbbc46dd thru 0xbbc47b0 (0xd4 bytes) 2024-09-18T05:14:25.025 INFO:teuthology.orchestra.run.smithi017.stdout:2245 punch from 0x5510f9 to 0x55f09d, (0xdfa4 bytes) 2024-09-18T05:14:25.025 INFO:teuthology.orchestra.run.smithi017.stdout:2248 writesame 0x5c19a26 thru 0x5c19cfd data_size 0xe(0x2d8 bytes) 2024-09-18T05:14:25.030 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:25.030 INFO:teuthology.orchestra.run.smithi017.stdout:2251 read 0xb417ef5 thru 0xb4184c2 (0x5ce bytes) 2024-09-18T05:14:25.030 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:25.030 INFO:teuthology.orchestra.run.smithi017.stdout:2254 writesame 0x19455e8 thru 0x194771c data_size 0x1(0x2135 bytes) 2024-09-18T05:14:25.041 INFO:teuthology.orchestra.run.smithi017.stdout:truncating to largest ever: 0xed64a64 2024-09-18T05:14:25.043 INFO:teuthology.orchestra.run.smithi017.stdout:2255 trunc from 0xe332e35 to 0xed64a64 2024-09-18T05:14:25.050 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1059 3.4 e26/22 3:2547571c:::rbd_data.118b4598dbfb.0000000000000108:head v 26'5, mlcod=25'3)", 2024-09-18T05:14:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.551812349999999, 2024-09-18T05:14:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021306210000000001, 2024-09-18T05:14:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494010+0000", 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494008+0000", 2024-09-18T05:14:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494034+0000", 2024-09-18T05:14:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5865999999999999e-05 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494066+0000", 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2317999999999998e-05 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494080+0000", 2024-09-18T05:14:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4482e-05 2024-09-18T05:14:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494200+0000", 2024-09-18T05:14:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119744 2024-09-18T05:14:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.494258+0000", 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8082999999999999e-05 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.496043+0000", 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001784887 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.496140+0000", 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7351999999999999e-05 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1160 3.9 e26/22 3:93ecdcc7:::rbd_data.118b4598dbfb.000000000000005f:head v 26'6, mlcod=26'4)", 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.481385692000003, 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020475789999999999, 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564436+0000", 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564434+0000", 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564473+0000", 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8977000000000003e-05 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564501+0000", 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7582000000000001e-05 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564514+0000", 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3134e-05 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564633+0000", 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011863500000000001 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.564699+0000", 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6447999999999998e-05 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.566372+0000", 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016731459999999999 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.566484+0000", 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011178799999999999 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1175 3.0 e26/22 3:0163bb0f:::rbd_data.118b4598dbfb.00000000000000ee:head v 26'9, mlcod=26'7)", 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.453229006000001, 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021239800000000001, 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592593+0000", 2024-09-18T05:14:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592590+0000", 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592614+0000", 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3220000000000001e-05 2024-09-18T05:14:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592670+0000", 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5939000000000001e-05 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592717+0000", 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7647e-05 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.592964+0000", 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024644400000000001 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.593019+0000", 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5457000000000001e-05 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.594550+0000", 2024-09-18T05:14:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015306510000000001 2024-09-18T05:14:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.594717+0000", 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016734900000000001 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1432 3.4 e26/22 3:207a8b3d:::rbd_data.118b4598dbfb.000000000000005b:head v 26'7, mlcod=26'5)", 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.280739998000001, 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020916770000000001, 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765082+0000", 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765080+0000", 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765140+0000", 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0813000000000002e-05 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765182+0000", 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1480000000000003e-05 2024-09-18T05:14:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765203+0000", 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1126000000000001e-05 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765334+0000", 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000130636 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.765403+0000", 2024-09-18T05:14:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9096000000000004e-05 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.767072+0000", 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001668861 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.767174+0000", 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000102132 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.223385364000002, 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:14:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:14:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:14:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1476 3.4 e26/22 3:207a8b3d:::rbd_data.118b4598dbfb.000000000000005b:head v 26'8, mlcod=26'6)", 2024-09-18T05:14:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.212965574999998, 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022241629999999999, 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832857+0000", 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832855+0000", 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832871+0000", 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5862000000000002e-05 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832903+0000", 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.832919+0000", 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6277e-05 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.833081+0000", 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016194899999999999 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.833154+0000", 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3226000000000007e-05 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.834997+0000", 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018433340000000001 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.835081+0000", 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3354000000000002e-05 2024-09-18T05:14:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:2097 3.4 e26/22 3:2079477c:::rbd_data.118b4598dbfb.00000000000001d4:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.859135432000002, 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021624840000000001, 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186687+0000", 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186684+0000", 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186707+0000", 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2823000000000002e-05 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186756+0000", 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9459999999999997e-05 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.186777+0000", 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0809999999999999e-05 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.187161+0000", 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038411000000000001 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.187218+0000", 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7065999999999999e-05 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.188759+0000", 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001540535 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.188849+0000", 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0489999999999996e-05 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:9001 3.4 e29/22 3:224b1375:::rbd_data.118beb25b049.0000000000000128:head v 29'42, mlcod=29'40)", 2024-09-18T05:14:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.083861148, 2024-09-18T05:14:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002309742, 2024-09-18T05:14:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961959+0000", 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962023+0000", 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3678999999999998e-05 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962057+0000", 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4606e-05 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962078+0000", 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1109999999999999e-05 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962204+0000", 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125306 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962271+0000", 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7009999999999997e-05 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964181+0000", 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019100619999999999 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964271+0000", 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9819000000000002e-05 2024-09-18T05:14:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16114 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'50, mlcod=32'48)", 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.325682548, 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020637609999999999, 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720140+0000", 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720138+0000", 2024-09-18T05:14:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720178+0000", 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0635e-05 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720204+0000", 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5660000000000002e-05 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720215+0000", 2024-09-18T05:14:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1222e-05 2024-09-18T05:14:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720390+0000", 2024-09-18T05:14:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017476300000000001 2024-09-18T05:14:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.720431+0000", 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.108e-05 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.722119+0000", 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016880269999999999 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.722203+0000", 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4419000000000006e-05 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.095 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.229747621000001, 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.096 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:14:25.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:14:25.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.227130824, 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:14:25.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:14:25.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:14:25.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:14:25.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:14:25.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:14:25.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16290 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'52, mlcod=32'49)", 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:25.107 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.22604012, 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023378159999999999, 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:25.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819780+0000", 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819796+0000", 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325999999999999e-05 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819826+0000", 2024-09-18T05:14:25.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9583000000000001e-05 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819845+0000", 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8597000000000002e-05 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819950+0000", 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105356 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820003+0000", 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3295999999999999e-05 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822018+0000", 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020151779999999998 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822120+0000", 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101316 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.144595312, 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:25.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:14:25.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:14:25.116 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.770057618999999, 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:14:25.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:14:25.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17196 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'90, mlcod=32'86)", 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.762171037000002, 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023459290000000001, 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283650+0000", 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283663+0000", 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2697999999999999e-05 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283682+0000", 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9012999999999999e-05 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283691+0000", 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7720000000000006e-06 2024-09-18T05:14:25.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283777+0000", 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5923999999999999e-05 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283830+0000", 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2320000000000001e-05 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285942+0000", 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002112039 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285997+0000", 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5322000000000003e-05 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21826 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'62, mlcod=36'60)", 2024-09-18T05:14:25.125 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.728427796999998, 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002048064, 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317394+0000", 2024-09-18T05:14:25.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317391+0000", 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317425+0000", 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3492999999999999e-05 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317462+0000", 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7543000000000003e-05 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317480+0000", 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7960000000000001e-05 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317588+0000", 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107654 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.317641+0000", 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2675e-05 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.319355+0000", 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017144059999999999 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.319442+0000", 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7349999999999995e-05 2024-09-18T05:14:25.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21886 3.9 e36/22 3:969ecc48:::rbd_data.118ba5d0bdf6.000000000000010b:head v 36'64, mlcod=36'62)", 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.576330448, 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021557630000000002, 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469492+0000", 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469489+0000", 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469514+0000", 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5269000000000002e-05 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469558+0000", 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.401e-05 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469581+0000", 2024-09-18T05:14:25.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2422999999999999e-05 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469722+0000", 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014086900000000001 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469780+0000", 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8362999999999997e-05 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471554+0000", 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001774156 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471647+0000", 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3256000000000003e-05 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21891 3.0 e36/22 3:04d4c8a4:::rbd_data.118ba5d0bdf6.0000000000000259:head v 36'100, mlcod=36'98)", 2024-09-18T05:14:25.134 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.576049154, 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022905260000000002, 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469771+0000", 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469789+0000", 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.821e-05 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469821+0000", 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1335999999999999e-05 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469839+0000", 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-05 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469944+0000", 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104576 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469996+0000", 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2102999999999999e-05 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471954+0000", 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019575980000000001 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472063+0000", 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010984600000000001 2024-09-18T05:14:25.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21892 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'65, mlcod=36'62)", 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.575085128000001, 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023311389999999999, 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470735+0000", 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470750+0000", 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470788+0000", 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7252999999999997e-05 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470806+0000", 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8105999999999999e-05 2024-09-18T05:14:25.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470949+0000", 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014359600000000001 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471048+0000", 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8888999999999995e-05 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472956+0000", 2024-09-18T05:14:25.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019074820000000001 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.473068+0000", 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011240599999999999 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.079128437, 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:14:25.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:14:25.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.148 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:25.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:25.150 INFO:teuthology.orchestra.run.smithi017.stdout:2256 trunc from 0xed64a64 to 0x2747186 2024-09-18T05:14:25.150 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:25.150 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:25.150 INFO:teuthology.orchestra.run.smithi017.stdout:2259 clone 17 order 21 su 131072 sc 10 2024-09-18T05:14:25.150 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:25.142+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:25.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:25.242+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:25.324 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:25.324 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:25.324 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:25.324 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:25.338 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:25.351 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:25.350+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:25.452 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:25.450+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:25.476 INFO:teuthology.orchestra.run.smithi086.stderr:Exporting 2.7 info 2.7( empty local-lis/les=18/19 n=0 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-18T05:14:25.482 INFO:teuthology.orchestra.run.smithi086.stderr:Export successful 2024-09-18T05:14:25.507 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:25.507 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:25.507 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:25.507 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:25.507 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:25.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:25.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:25.562+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:25.642 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.727918959999997, 2024-09-18T05:14:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:14:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.727888016999998, 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:14:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.727862453, 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:14:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.727837737000002, 2024-09-18T05:14:25.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:14:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.727811502999998, 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:14:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:14:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:14:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:14:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:14:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.727782593999997, 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:14:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.727758764000001, 2024-09-18T05:14:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:14:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:14:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:14:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.727734288000001, 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:14:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.727616488999999, 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:14:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:14:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.724624534, 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:14:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.724546472, 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.724515185000001, 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.724489171999998, 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:14:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:14:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.724461398999999, 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:14:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.724436335999997, 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:14:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.724411306, 2024-09-18T05:14:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:14:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:14:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1854 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 540672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916718+0000", 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.720310288, 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097779173999999996, 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1854 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916718+0000", 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916718+0000", 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916717+0000", 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916723+0000", 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6470000000000003e-06 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916730+0000", 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2049999999999996e-06 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916736+0000", 2024-09-18T05:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014179+0000", 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097443396000000002 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014342+0000", 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016297600000000001 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014497+0000", 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015457900000000001 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.720286977999997, 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.720266432999999, 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.720246750999998, 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:14:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:14:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:25.732 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:25.733 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:25.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:25.726+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:25.835 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:25.834+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:25.865 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:25.866 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:25.866 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:25.866 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:25.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:25.952 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:14:25.967 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:25.966+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:26.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --force --op remove --pgid 2.7 2024-09-18T05:14:26.036 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:26.030+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:26.045 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:26.045 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:26.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:26.066 INFO:teuthology.orchestra.run.smithi017.stdout:leaving image image_client.0-clone16 intact 2024-09-18T05:14:26.137 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:26.130+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:26.174 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-18T05:14:26.225 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:34842 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.642468+0000", 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5802273400000004, 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054921899000000003, 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 34842 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642468+0000", 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642468+0000", 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642467+0000", 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642488+0000", 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1195e-05 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642506+0000", 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7589e-05 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642519+0000", 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3478999999999999e-05 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697373+0000", 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054853784000000003 2024-09-18T05:14:26.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697390+0000", 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6949e-05 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:34843 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.642531+0000", 2024-09-18T05:14:26.230 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5801642490000001, 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054916773000000002, 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 34843 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642531+0000", 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642531+0000", 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642530+0000", 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642548+0000", 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7317999999999999e-05 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642565+0000", 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7405e-05 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642608+0000", 2024-09-18T05:14:26.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2471e-05 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697434+0000", 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054826248000000001 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697448+0000", 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4207e-05 2024-09-18T05:14:26.234 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35040 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644793+0000", 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5779028569999998, 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054897967999999998, 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35040 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644793+0000", 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644793+0000", 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644792+0000", 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644802+0000", 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0053e-05 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644811+0000", 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7590000000000003e-06 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644818+0000", 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9129999999999997e-06 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699682+0000", 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054864582000000002 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699691+0000", 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3010000000000007e-06 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.239 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35041 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644824+0000", 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5778719900000002, 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054909866000000002, 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35041 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644824+0000", 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644824+0000", 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644823+0000", 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644826+0000", 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3000000000000002e-06 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644835+0000", 2024-09-18T05:14:26.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3429999999999996e-06 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644841+0000", 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.793e-06 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699718+0000", 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054876552000000002 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699733+0000", 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5571000000000001e-05 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35042 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5778481849999997, 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054947252000000002, 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35042 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:26.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644850+0000", 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.089e-06 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644858+0000", 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2470000000000008e-06 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644865+0000", 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8220000000000001e-06 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699785+0000", 2024-09-18T05:14:26.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054920552999999997 2024-09-18T05:14:26.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699795+0000", 2024-09-18T05:14:26.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1970000000000002e-06 2024-09-18T05:14:26.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35043 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644871+0000", 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5778249530000004, 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05500414, 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35043 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644871+0000", 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644871+0000", 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644870+0000", 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644883+0000", 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2592000000000001e-05 2024-09-18T05:14:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644892+0000", 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1190000000000003e-06 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644907+0000", 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839e-05 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699859+0000", 2024-09-18T05:14:26.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054952913999999999 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699875+0000", 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5328999999999998e-05 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35044 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644913+0000", 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5777829429999999, 2024-09-18T05:14:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055016171000000003, 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35044 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644913+0000", 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644913+0000", 2024-09-18T05:14:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644912+0000", 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644928+0000", 2024-09-18T05:14:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5911999999999999e-05 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644937+0000", 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0359999999999995e-06 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644944+0000", 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5859999999999999e-06 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699920+0000", 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054975475000000003 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699929+0000", 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8619999999999992e-06 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35045 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645001+0000", 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5776950999999997, 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054993128000000002, 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35045 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645001+0000", 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645001+0000", 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644999+0000", 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645004+0000", 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.386e-06 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645025+0000", 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1072000000000001e-05 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645033+0000", 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4929999999999998e-06 2024-09-18T05:14:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699978+0000", 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054944686999999999 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699994+0000", 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5642999999999999e-05 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35046 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645043+0000", 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5776525130000003, 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055002748999999997, 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35046 2024-09-18T05:14:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645043+0000", 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645043+0000", 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645042+0000", 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645046+0000", 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8399999999999997e-06 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645055+0000", 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8230000000000001e-06 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645062+0000", 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6889999999999998e-06 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700035+0000", 2024-09-18T05:14:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054973889999999997 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700046+0000", 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0441e-05 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35047 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645068+0000", 2024-09-18T05:14:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5776279520000003, 2024-09-18T05:14:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055041751, 2024-09-18T05:14:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35047 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645068+0000", 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645068+0000", 2024-09-18T05:14:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645067+0000", 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645070+0000", 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5700000000000001e-06 2024-09-18T05:14:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645078+0000", 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0320000000000003e-06 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645085+0000", 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6540000000000002e-06 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700094+0000", 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055009007999999998 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700109+0000", 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5316999999999999e-05 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35048 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645092+0000", 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.577603774, 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055077814000000003, 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35048 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645092+0000", 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645092+0000", 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645091+0000", 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645094+0000", 2024-09-18T05:14:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0800000000000002e-06 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645103+0000", 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3529999999999995e-06 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645110+0000", 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9059999999999996e-06 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700160+0000", 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055050864999999997 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700170+0000", 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2569999999999996e-06 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35049 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5775803929999999, 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055117828000000001, 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35049 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645118+0000", 2024-09-18T05:14:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0900000000000001e-06 2024-09-18T05:14:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645126+0000", 2024-09-18T05:14:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3829999999999992e-06 2024-09-18T05:14:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645133+0000", 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5760000000000002e-06 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700218+0000", 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055085150999999999 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700233+0000", 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5291e-05 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35050 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5775572140000005, 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055144048000000001, 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35050 2024-09-18T05:14:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645141+0000", 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.129e-06 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645149+0000", 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.32e-06 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645156+0000", 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5560000000000004e-06 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700273+0000", 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055117753999999998 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700282+0000", 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.969e-06 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35051 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5775342590000001, 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055189845000000001, 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35051 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645164+0000", 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.083e-06 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645172+0000", 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2500000000000006e-06 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645182+0000", 2024-09-18T05:14:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7389999999999994e-06 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700330+0000", 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055147843000000002 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700351+0000", 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1577e-05 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35053 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645188+0000", 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5775078540000003, 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055212911000000003, 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35053 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645188+0000", 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645188+0000", 2024-09-18T05:14:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645187+0000", 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645212+0000", 2024-09-18T05:14:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4607999999999999e-05 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645228+0000", 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6631999999999999e-05 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645247+0000", 2024-09-18T05:14:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8748000000000001e-05 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700392+0000", 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055144679000000002 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700401+0000", 2024-09-18T05:14:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8810000000000002e-06 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35055 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5774412599999996, 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055212430999999999, 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35055 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645257+0000", 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645266+0000", 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.816e-06 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645273+0000", 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5799999999999997e-06 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700449+0000", 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055176493 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700467+0000", 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7589e-05 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35057 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645279+0000", 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5774166520000001, 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055246213000000002, 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35057 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645279+0000", 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645279+0000", 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645278+0000", 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645281+0000", 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1319999999999998e-06 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645290+0000", 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3499999999999997e-06 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645296+0000", 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4790000000000001e-06 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700516+0000", 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055219621000000003 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700525+0000", 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2969999999999992e-06 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35059 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5773932070000001, 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055288944, 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35059 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645305+0000", 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0960000000000001e-06 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645313+0000", 2024-09-18T05:14:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3399999999999998e-06 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645322+0000", 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5259999999999993e-06 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700574+0000", 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055251888999999998 2024-09-18T05:14:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700591+0000", 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7753000000000001e-05 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35061 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645328+0000", 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5773677660000001, 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055293502000000001, 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35061 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645328+0000", 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645328+0000", 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645327+0000", 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645339+0000", 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1432e-05 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645348+0000", 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2520000000000005e-06 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645355+0000", 2024-09-18T05:14:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0929999999999997e-06 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700613+0000", 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055258003 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700621+0000", 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3909999999999998e-06 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35063 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645361+0000", 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5773346249999998, 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055301707999999998, 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35063 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645361+0000", 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645361+0000", 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645360+0000", 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645364+0000", 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3160000000000001e-06 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645372+0000", 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7830000000000004e-06 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645379+0000", 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5629999999999997e-06 2024-09-18T05:14:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700648+0000", 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055268912000000003 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700663+0000", 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4807000000000001e-05 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.321 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:26.322 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:26.322 INFO:teuthology.orchestra.run.smithi017.stdout:2261 write 0x8169ba4 thru 0x817220c (0x8669 bytes) 2024-09-18T05:14:26.322 INFO:teuthology.orchestra.run.smithi017.stdout:2262 writesame 0xd59e914 thru 0xd5a523e data_size 0x13(0x692b bytes) 2024-09-18T05:14:26.322 INFO:teuthology.orchestra.run.smithi017.stdout:2264 trunc from 0xd5a523f to 0x414b01f 2024-09-18T05:14:26.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:26.323 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:26.318+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:2266 writesame 0xb1a377d thru 0xb1b048d data_size 0x39(0xcd11 bytes) 2024-09-18T05:14:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:2267 read 0x223ce56 thru 0x2241034 (0x41df bytes) 2024-09-18T05:14:26.380 INFO:teuthology.orchestra.run.smithi017.stdout:2268 trunc from 0xb1b048e to 0x1c5b01c 2024-09-18T05:14:26.423 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:26.418+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:26.431 INFO:teuthology.orchestra.run.smithi017.stdout:2270 trunc from 0x1c5b01c to 0x7190622 2024-09-18T05:14:26.440 INFO:teuthology.orchestra.run.smithi017.stdout:2273 read 0x4811612 thru 0x481b2b7 (0x9ca6 bytes) 2024-09-18T05:14:26.440 INFO:teuthology.orchestra.run.smithi017.stdout:2274 writesame 0x5ac4507 thru 0x5ac8cd7 data_size 0x1(0x47d1 bytes) 2024-09-18T05:14:26.471 INFO:teuthology.orchestra.run.smithi017.stdout:2275 trunc from 0x7190622 to 0xa0d4095 2024-09-18T05:14:26.480 INFO:teuthology.orchestra.run.smithi017.stdout:2276 read 0x85745e6 thru 0x85749ca (0x3e5 bytes) 2024-09-18T05:14:26.480 INFO:teuthology.orchestra.run.smithi017.stdout:2277 punch from 0x3088daf to 0x308ac39, (0x1e8a bytes) 2024-09-18T05:14:26.480 INFO:teuthology.orchestra.run.smithi017.stdout:2278 write 0xa0055f0 thru 0xa010d27 (0xb738 bytes) 2024-09-18T05:14:26.510 INFO:teuthology.orchestra.run.smithi017.stdout:2280 write 0xedc3ab0 thru 0xedc665a (0x2bab bytes) 2024-09-18T05:14:26.513 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:26.513 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:26.513 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:26.514 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:26.515 INFO:teuthology.orchestra.run.smithi017.stdout:2283 read 0xc05ed6f thru 0xc069491 (0xa723 bytes) 2024-09-18T05:14:26.516 INFO:teuthology.orchestra.run.smithi017.stdout:2286 writesame 0xe0e5012 thru 0xe0e596f data_size 0xb(0x95e bytes) 2024-09-18T05:14:26.521 INFO:teuthology.orchestra.run.smithi017.stdout:2288 clone 18 order 21 su 65536 sc 10 2024-09-18T05:14:26.523 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:26.522+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:26.529 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:26.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:26.627 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:26.622+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:26.686 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:26.687 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:26.700 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:26.738 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:26.747 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:26.746+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:26.754 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:26.772 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:26.788 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:26.789 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:26.806 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:26.817 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1549215520000002, 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:14:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1548546340000003, 2024-09-18T05:14:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:14:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:14:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:14:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:14:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:14:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:14:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:14:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:14:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:14:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.154766124, 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:14:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:14:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1547155680000003, 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:14:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:14:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:14:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1546524529999997, 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:14:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:14:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1546055329999998, 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:14:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1545516539999996, 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:14:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1545045209999998, 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:14:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1544568990000004, 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1543340779999998, 2024-09-18T05:14:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:14:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:14:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:14:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:14:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1542527480000002, 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:14:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:14:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:14:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1541815050000004, 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:14:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1541312939999999, 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:14:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1540540999999997, 2024-09-18T05:14:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:14:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:14:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.15400423, 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:14:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1539296590000001, 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:14:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:14:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:14:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1538638810000004, 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:14:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:14:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1538168449999997, 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.905 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:14:26.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1537547520000002, 2024-09-18T05:14:26.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.914 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1537083729999997, 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:14:26.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:26.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:26.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:14:26.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:14:26.919 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.919 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.919 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.919 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:26.919 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:26.919 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:26.920 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:26.921 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:26.921 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-18T05:14:26.922 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:26.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:26.923 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:14:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:26.924 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:14:26.924 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:26.914+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:14:27.022 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:27.018+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:27.091 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:27.091 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:27.101 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone17 from 0xedc665b (overlap 0x1c5b01c) to 0x13d94e0 2024-09-18T05:14:27.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:27.123 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:27.118+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:27.201 INFO:teuthology.orchestra.run.smithi086.stdout: marking collection for removal 2024-09-18T05:14:27.201 INFO:teuthology.orchestra.run.smithi086.stdout:setting '_remove' omap key 2024-09-18T05:14:27.201 INFO:teuthology.orchestra.run.smithi086.stdout:finish_remove_pgs 2.7_head removing 2.7 2024-09-18T05:14:27.206 INFO:teuthology.orchestra.run.smithi086.stdout:Remove successful 2024-09-18T05:14:27.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:27.218+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:27.276 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:27.277 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:27.291 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:27.312 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-18T05:14:27.335 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:27.334+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:27.412 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:27.412 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:27.425 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:27.418+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:27.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:27.462 INFO:teuthology.orchestra.run.smithi017.stdout:2290 write 0x79aab56 thru 0x79ab87f (0xd2a bytes) 2024-09-18T05:14:27.473 INFO:teuthology.orchestra.run.smithi017.stdout:2291 read 0x1f02531 thru 0x1f04f76 (0x2a46 bytes) 2024-09-18T05:14:27.474 INFO:teuthology.orchestra.run.smithi017.stdout:2292 read 0x41fa95a thru 0x4204378 (0x9a1f bytes) 2024-09-18T05:14:27.474 INFO:teuthology.orchestra.run.smithi017.stdout:2293 writesame 0x3a597d1 thru 0x3a5f408 data_size 0x8(0x5c38 bytes) 2024-09-18T05:14:27.482 INFO:teuthology.orchestra.run.smithi017.stdout:2294 writesame 0xb0dae9a thru 0xb0e7c0d data_size 0x36(0xcd74 bytes) 2024-09-18T05:14:27.494 INFO:teuthology.orchestra.run.smithi017.stdout:2296 read 0x38bae8e thru 0x38c56f9 (0xa86c bytes) 2024-09-18T05:14:27.494 INFO:teuthology.orchestra.run.smithi017.stdout:2298 read 0x98f4c08 thru 0x9900a9a (0xbe93 bytes) 2024-09-18T05:14:27.494 INFO:teuthology.orchestra.run.smithi017.stdout:2299 read 0x7a6bb15 thru 0x7a72b7d (0x7069 bytes) 2024-09-18T05:14:27.494 INFO:teuthology.orchestra.run.smithi017.stdout:2300 read 0xc1bf048 thru 0xc1bf6dd (0x696 bytes) 2024-09-18T05:14:27.497 INFO:teuthology.orchestra.run.smithi017.stdout:2301 trunc from 0xedc665b to 0xd7ea513 2024-09-18T05:14:27.525 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:27.522+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:27.537 INFO:teuthology.orchestra.run.smithi017.stdout:2302 trunc from 0xd7ea513 to 0x580ef9d 2024-09-18T05:14:27.578 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:27.578 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:27.600 INFO:teuthology.orchestra.run.smithi017.stdout:2303 write 0xa0fe5aa thru 0xa10c87d (0xe2d4 bytes) 2024-09-18T05:14:27.604 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:27.615 INFO:teuthology.orchestra.run.smithi017.stdout:2304 trunc from 0xa10c87e to 0xd9a9180 2024-09-18T05:14:27.626 INFO:teuthology.orchestra.run.smithi017.stdout:2306 trunc from 0xd9a9180 to 0xc234c6a 2024-09-18T05:14:27.627 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:27.622+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:27.635 INFO:teuthology.orchestra.run.smithi017.stdout:2307 read 0xd222b1 thru 0xd31f7d (0xfccd bytes) 2024-09-18T05:14:27.635 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:27.650 INFO:teuthology.orchestra.run.smithi017.stdout:2309 trunc from 0xc234c6a to 0x195c5e8 2024-09-18T05:14:27.703 INFO:teuthology.orchestra.run.smithi017.stdout:2310 read 0x9b89c5 thru 0x9c76a6 (0xece2 bytes) 2024-09-18T05:14:27.718 INFO:teuthology.orchestra.run.smithi017.stdout:2311 write 0x6af0df1 thru 0x6afee26 (0xe036 bytes) 2024-09-18T05:14:27.723 INFO:teuthology.orchestra.run.smithi017.stdout:2313 read 0x50abe48 thru 0x50b8c77 (0xce30 bytes) 2024-09-18T05:14:27.727 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:27.722+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:27.727 INFO:teuthology.orchestra.run.smithi017.stdout:2315 trunc from 0x6afee27 to 0x97184e6 2024-09-18T05:14:27.734 INFO:teuthology.orchestra.run.smithi017.stdout:2316 write 0x49859cb thru 0x4989434 (0x3a6a bytes) 2024-09-18T05:14:27.738 INFO:teuthology.orchestra.run.smithi017.stdout:2317 punch from 0x1afce2f to 0x1b00a41, (0x3c12 bytes) 2024-09-18T05:14:27.739 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:27.749 INFO:teuthology.orchestra.run.smithi017.stdout:2322 write 0xba4cc26 thru 0xba4eeb0 (0x228b bytes) 2024-09-18T05:14:27.751 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.7.6 2024-09-18T05:14:27.753 INFO:teuthology.orchestra.run.smithi017.stdout:2323 write 0xaaa3737 thru 0xaaa8db6 (0x5680 bytes) 2024-09-18T05:14:27.756 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:27.756 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:27.758 INFO:teuthology.orchestra.run.smithi017.stdout:2324 write 0x2c1ba04 thru 0x2c1eb63 (0x3160 bytes) 2024-09-18T05:14:27.764 INFO:teuthology.orchestra.run.smithi017.stdout:2325 write 0xb545767 thru 0xb5519ba (0xc254 bytes) 2024-09-18T05:14:27.770 INFO:teuthology.orchestra.run.smithi017.stdout:2326 writesame 0x37256a3 thru 0x372c68e data_size 0x26(0x6fec bytes) 2024-09-18T05:14:27.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:27.777 INFO:teuthology.orchestra.run.smithi017.stdout:2327 read 0x8c9c0e8 thru 0x8ca1cb8 (0x5bd1 bytes) 2024-09-18T05:14:27.777 INFO:teuthology.orchestra.run.smithi017.stdout:2328 punch from 0x4c7792b to 0x4c81249, (0x991e bytes) 2024-09-18T05:14:27.777 INFO:teuthology.orchestra.run.smithi017.stdout:2330 punch from 0x906ce08 to 0x9070217, (0x340f bytes) 2024-09-18T05:14:27.778 INFO:teuthology.orchestra.run.smithi017.stdout:2331 write 0x6dbbb70 thru 0x6dc43de (0x886f bytes) 2024-09-18T05:14:27.785 INFO:teuthology.orchestra.run.smithi017.stdout:2332 trunc from 0xba4eeb1 to 0xc85fea0 2024-09-18T05:14:27.792 INFO:teuthology.orchestra.run.smithi017.stdout:2333 punch from 0xa1c64f5 to 0xa1ca1d9, (0x3ce4 bytes) 2024-09-18T05:14:27.793 INFO:teuthology.orchestra.run.smithi017.stdout:2334 read 0x1b8f5f2 thru 0x1b9284f (0x325e bytes) 2024-09-18T05:14:27.793 INFO:teuthology.orchestra.run.smithi017.stdout:2335 write 0x4028998 thru 0x402a9e7 (0x2050 bytes) 2024-09-18T05:14:27.795 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:27.795 INFO:teuthology.orchestra.run.smithi017.stdout:2337 write 0x161726c thru 0x162260c (0xb3a1 bytes) 2024-09-18T05:14:27.813 INFO:teuthology.orchestra.run.smithi017.stdout:2339 trunc from 0xc85fea0 to 0x502fac5 2024-09-18T05:14:27.823 INFO:teuthology.orchestra.run.smithi017.stdout:2340 punch from 0x41c3429 to 0x41c60e5, (0x2cbc bytes) 2024-09-18T05:14:27.827 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:27.822+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:27.835 INFO:teuthology.orchestra.run.smithi017.stdout:2341 trunc from 0x502fac5 to 0xdc4ef2f 2024-09-18T05:14:27.842 INFO:teuthology.orchestra.run.smithi017.stdout:2342 read 0x454b67c thru 0x455a910 (0xf295 bytes) 2024-09-18T05:14:27.842 INFO:teuthology.orchestra.run.smithi017.stdout:2343 writesame 0x2a70332 thru 0x2a71718 data_size 0x1(0x13e7 bytes) 2024-09-18T05:14:27.847 INFO:teuthology.orchestra.run.smithi017.stdout:2344 write 0x57e95ca thru 0x57f1b42 (0x8579 bytes) 2024-09-18T05:14:27.852 INFO:teuthology.orchestra.run.smithi017.stdout:2345 write 0xd857b44 thru 0xd85a1e1 (0x269e bytes) 2024-09-18T05:14:27.855 INFO:teuthology.orchestra.run.smithi017.stdout:2346 read 0x5749455 thru 0x575321a (0x9dc6 bytes) 2024-09-18T05:14:27.855 INFO:teuthology.orchestra.run.smithi017.stdout:2347 read 0x3eee159 thru 0x3ef890d (0xa7b5 bytes) 2024-09-18T05:14:27.856 INFO:teuthology.orchestra.run.smithi017.stdout:2348 read 0xbf7a743 thru 0xbf7b4a6 (0xd64 bytes) 2024-09-18T05:14:27.856 INFO:teuthology.orchestra.run.smithi017.stdout:2349 writesame 0x4f46e82 thru 0x4f4e6e2 data_size 0x1(0x7861 bytes) 2024-09-18T05:14:27.874 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:27.874 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:27.874 INFO:teuthology.orchestra.run.smithi017.stdout:2352 read 0xa82df67 thru 0xa83c536 (0xe5d0 bytes) 2024-09-18T05:14:27.874 INFO:teuthology.orchestra.run.smithi017.stdout:2354 writesame 0x146930d thru 0x146bb8d data_size 0x1(0x2881 bytes) 2024-09-18T05:14:27.897 INFO:teuthology.orchestra.run.smithi017.stdout:2355 write 0xe8e847e thru 0xe8eb0d8 (0x2c5b bytes) 2024-09-18T05:14:27.908 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:27.908 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:27.913 INFO:teuthology.orchestra.run.smithi017.stdout:2357 trunc from 0xe8eb0d9 to 0x9913149 2024-09-18T05:14:27.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:27.932 INFO:teuthology.orchestra.run.smithi017.stdout:2358 read 0x6c642da thru 0x6c6d614 (0x933b bytes) 2024-09-18T05:14:27.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:27.926+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:2360 write 0xa97cb59 thru 0xa985977 (0x8e1f bytes) 2024-09-18T05:14:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:2361 trunc from 0xa985978 to 0xe56c824 2024-09-18T05:14:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:2365 write 0x3af91a5 thru 0x3afbe92 (0x2cee bytes) 2024-09-18T05:14:27.974 INFO:teuthology.orchestra.run.smithi017.stdout:2368 read 0x31532fc thru 0x3154ca0 (0x19a5 bytes) 2024-09-18T05:14:27.975 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:27.975 INFO:teuthology.orchestra.run.smithi017.stdout:2375 read 0xb574447 thru 0xb5823b5 (0xdf6f bytes) 2024-09-18T05:14:27.976 INFO:teuthology.orchestra.run.smithi017.stdout:2377 write 0x2a39b41 thru 0x2a463df (0xc89f bytes) 2024-09-18T05:14:27.981 INFO:teuthology.orchestra.run.smithi017.stdout:2378 writesame 0x6e05fae thru 0x6e11251 data_size 0x25(0xb2a4 bytes) 2024-09-18T05:14:27.990 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:27.990 INFO:teuthology.orchestra.run.smithi017.stdout:2381 write 0xc0f720e thru 0xc1011ac (0x9f9f bytes) 2024-09-18T05:14:27.996 INFO:teuthology.orchestra.run.smithi017.stdout:2382 read 0xe4b6a8a thru 0xe4c4e1d (0xe394 bytes) 2024-09-18T05:14:27.996 INFO:teuthology.orchestra.run.smithi017.stdout:2383 write 0x22ee286 thru 0x22f9741 (0xb4bc bytes) 2024-09-18T05:14:28.000 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:28.000 INFO:teuthology.orchestra.run.smithi017.stdout:2386 read 0x82a29b8 thru 0x82a7750 (0x4d99 bytes) 2024-09-18T05:14:28.000 INFO:teuthology.orchestra.run.smithi017.stdout:2388 read 0x5a5f093 thru 0x5a680e4 (0x9052 bytes) 2024-09-18T05:14:28.001 INFO:teuthology.orchestra.run.smithi017.stdout:2389 read 0x6f30430 thru 0x6f31258 (0xe29 bytes) 2024-09-18T05:14:28.001 INFO:teuthology.orchestra.run.smithi017.stdout:2390 read 0xb0e58ce thru 0xb0ec302 (0x6a35 bytes) 2024-09-18T05:14:28.001 INFO:teuthology.orchestra.run.smithi017.stdout:2393 write 0xccca7dc thru 0xccd93b9 (0xebde bytes) 2024-09-18T05:14:28.009 INFO:teuthology.orchestra.run.smithi017.stdout:2395 trunc from 0xe56c824 to 0xd85b35c 2024-09-18T05:14:28.030 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:28.026+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:28.033 INFO:teuthology.orchestra.run.smithi017.stdout:2396 trunc from 0xd85b35c to 0x56a3dc2 2024-09-18T05:14:28.051 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:28.052 INFO:teuthology.orchestra.run.smithi017.stdout:2398 trunc from 0x56a3dc2 to 0x5b0202d 2024-09-18T05:14:28.059 INFO:teuthology.orchestra.run.smithi017.stdout:2399 writesame 0x546844c thru 0x54774f8 data_size 0x1(0xf0ad bytes) 2024-09-18T05:14:28.076 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:28.077 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:28.088 INFO:teuthology.orchestra.run.smithi017.stdout:2400 read 0x59dc5fd thru 0x59eb82d (0xf231 bytes) 2024-09-18T05:14:28.089 INFO:teuthology.orchestra.run.smithi017.stdout:2401 punch from 0x1686ea4 to 0x1687427, (0x583 bytes) 2024-09-18T05:14:28.093 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:28.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:28.106 INFO:teuthology.orchestra.run.smithi017.stdout:2405 write 0xaa98c10 thru 0xaa9f842 (0x6c33 bytes) 2024-09-18T05:14:28.123 INFO:teuthology.orchestra.run.smithi017.stdout:2406 write 0xc97d1c0 thru 0xc989313 (0xc154 bytes) 2024-09-18T05:14:28.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:28.122+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:28.130 INFO:teuthology.orchestra.run.smithi017.stdout:2407 writesame 0x5096f65 thru 0x509eb66 data_size 0x6f(0x7c02 bytes) 2024-09-18T05:14:28.142 INFO:teuthology.orchestra.run.smithi017.stdout:2408 trunc from 0xc989314 to 0x909fc6b 2024-09-18T05:14:28.165 INFO:teuthology.orchestra.run.smithi017.stdout:2410 trunc from 0x909fc6b to 0x32791a8 2024-09-18T05:14:28.199 INFO:teuthology.orchestra.run.smithi017.stdout:2411 write 0x8db83cb thru 0x8dbf8b1 (0x74e7 bytes) 2024-09-18T05:14:28.204 INFO:teuthology.orchestra.run.smithi017.stdout:2413 writesame 0x8d331e0 thru 0x8d429b9 data_size 0x1e(0xf7da bytes) 2024-09-18T05:14:28.209 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:28.209 INFO:teuthology.orchestra.run.smithi017.stdout:2416 writesame 0x10df8f7 thru 0x10e5071 data_size 0x5(0x577b bytes) 2024-09-18T05:14:28.229 INFO:teuthology.orchestra.run.smithi017.stdout:2417 trunc from 0x8dbf8b2 to 0x22e88d8 2024-09-18T05:14:28.231 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:28.226+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:28.250 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:28.250 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:28.251 INFO:teuthology.orchestra.run.smithi017.stdout:2420 read 0x32d207 thru 0x337e70 (0xac6a bytes) 2024-09-18T05:14:28.268 INFO:teuthology.orchestra.run.smithi017.stdout:2422 trunc from 0x22e88d8 to 0xaa77c36 2024-09-18T05:14:28.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:28.275 INFO:teuthology.orchestra.run.smithi017.stdout:2423 punch from 0x9f14688 to 0x9f1ef44, (0xa8bc bytes) 2024-09-18T05:14:28.276 INFO:teuthology.orchestra.run.smithi017.stdout:2424 writesame 0x627d28e thru 0x628c3ca data_size 0x1(0xf13d bytes) 2024-09-18T05:14:28.318 INFO:teuthology.orchestra.run.smithi017.stdout:2425 trunc from 0xaa77c36 to 0x7e6261c 2024-09-18T05:14:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:28.326 INFO:teuthology.orchestra.run.smithi017.stdout:2428 punch from 0x633b757 to 0x6346228, (0xaad1 bytes) 2024-09-18T05:14:28.326 INFO:teuthology.orchestra.run.smithi017.stdout:2429 read 0x5dd1ebf thru 0x5dd6bc0 (0x4d02 bytes) 2024-09-18T05:14:28.326 INFO:teuthology.orchestra.run.smithi017.stdout:2432 punch from 0x39b5b33 to 0x39bf61d, (0x9aea bytes) 2024-09-18T05:14:28.331 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:28.326+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:28.339 INFO:teuthology.orchestra.run.smithi017.stdout:2433 writesame 0xb9861f7 thru 0xb987d09 data_size 0x1(0x1b13 bytes) 2024-09-18T05:14:28.348 INFO:teuthology.orchestra.run.smithi017.stdout:2434 trunc from 0xb987d0a to 0x62598d2 2024-09-18T05:14:28.359 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:28.359 INFO:teuthology.orchestra.run.smithi017.stdout:2436 read 0x5251f0e thru 0x525504e (0x3141 bytes) 2024-09-18T05:14:28.376 INFO:teuthology.orchestra.run.smithi017.stdout:2437 write 0xb574e13 thru 0xb57f5b1 (0xa79f bytes) 2024-09-18T05:14:28.383 INFO:teuthology.orchestra.run.smithi017.stdout:2440 read 0x4b7ebc3 thru 0x4b84861 (0x5c9f bytes) 2024-09-18T05:14:28.383 INFO:teuthology.orchestra.run.smithi017.stdout:2443 write 0x222e72e thru 0x22357c8 (0x709b bytes) 2024-09-18T05:14:28.385 INFO:teuthology.orchestra.run.smithi017.stdout:2444 punch from 0x2f0b885 to 0x2f0e78c, (0x2f07 bytes) 2024-09-18T05:14:28.385 INFO:teuthology.orchestra.run.smithi017.stdout:2447 write 0x47e0418 thru 0x47ebc7e (0xb867 bytes) 2024-09-18T05:14:28.392 INFO:teuthology.orchestra.run.smithi017.stdout:2448 punch from 0x31e4c39 to 0x31e9086, (0x444d bytes) 2024-09-18T05:14:28.392 INFO:teuthology.orchestra.run.smithi017.stdout:2449 read 0x9203b24 thru 0x920a0c8 (0x65a5 bytes) 2024-09-18T05:14:28.392 INFO:teuthology.orchestra.run.smithi017.stdout:2450 punch from 0x6297388 to 0x6299c3e, (0x28b6 bytes) 2024-09-18T05:14:28.392 INFO:teuthology.orchestra.run.smithi017.stdout:2452 write 0x8be09c9 thru 0x8beecaf (0xe2e7 bytes) 2024-09-18T05:14:28.398 INFO:teuthology.orchestra.run.smithi017.stdout:2453 trunc from 0xb57f5b2 to 0xad14f05 2024-09-18T05:14:28.408 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:28.408 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:28.416 INFO:teuthology.orchestra.run.smithi017.stdout:2454 trunc from 0xad14f05 to 0xaa0c213 2024-09-18T05:14:28.423 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:28.432 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:28.430+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:28.441 INFO:teuthology.orchestra.run.smithi017.stdout:2455 trunc from 0xaa0c213 to 0xf45fdb 2024-09-18T05:14:28.511 INFO:teuthology.orchestra.run.smithi017.stdout:2457 writesame 0xceabd6b thru 0xceba7af data_size 0x1(0xea45 bytes) 2024-09-18T05:14:28.511 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:28.511 INFO:teuthology.orchestra.run.smithi017.stdout:2460 writesame 0x77fa550 thru 0x78023e2 data_size 0x7(0x7e93 bytes) 2024-09-18T05:14:28.518 INFO:teuthology.orchestra.run.smithi017.stdout:2462 write 0xea552 thru 0xf1279 (0x6d28 bytes) 2024-09-18T05:14:28.528 INFO:teuthology.orchestra.run.smithi017.stdout:2463 write 0xd2051ff thru 0xd20deae (0x8cb0 bytes) 2024-09-18T05:14:28.533 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:28.526+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:28.534 INFO:teuthology.orchestra.run.smithi017.stdout:2464 write 0x6238881 thru 0x6246a34 (0xe1b4 bytes) 2024-09-18T05:14:28.540 INFO:teuthology.orchestra.run.smithi017.stdout:2465 write 0xe33f75 thru 0xe376b2 (0x373e bytes) 2024-09-18T05:14:28.543 INFO:teuthology.orchestra.run.smithi017.stdout:2467 write 0xbaf337a thru 0xbb02cf1 (0xf978 bytes) 2024-09-18T05:14:28.550 INFO:teuthology.orchestra.run.smithi017.stdout:2469 read 0xcbd6060 thru 0xcbda565 (0x4506 bytes) 2024-09-18T05:14:28.550 INFO:teuthology.orchestra.run.smithi017.stdout:2471 writesame 0x5f3f9a9 thru 0x5f4becb data_size 0x1(0xc523 bytes) 2024-09-18T05:14:28.589 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:28.589 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:28.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:28.616 INFO:teuthology.orchestra.run.smithi017.stdout:2472 write 0x305a6d4 thru 0x3064524 (0x9e51 bytes) 2024-09-18T05:14:28.639 INFO:teuthology.orchestra.run.smithi017.stdout:2473 trunc from 0xd20deaf to 0x6a1ea81 2024-09-18T05:14:28.640 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:28.634+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:2475 read 0x632242 thru 0x635562 (0x3321 bytes) 2024-09-18T05:14:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:2476 write 0x5ba72e2 thru 0x5bac9df (0x56fe bytes) 2024-09-18T05:14:28.659 INFO:teuthology.orchestra.run.smithi017.stdout:2477 punch from 0x350882d to 0x350e9be, (0x6191 bytes) 2024-09-18T05:14:28.659 INFO:teuthology.orchestra.run.smithi017.stdout:2478 punch from 0x1533785 to 0x153e6c5, (0xaf40 bytes) 2024-09-18T05:14:28.672 INFO:teuthology.orchestra.run.smithi017.stdout:2480 write 0x93eaa1f thru 0x93eda7d (0x305f bytes) 2024-09-18T05:14:28.679 INFO:teuthology.orchestra.run.smithi017.stdout:2481 trunc from 0x93eda7e to 0xa1c0d35 2024-09-18T05:14:28.688 INFO:teuthology.orchestra.run.smithi017.stdout:2482 read 0x76b3b97 thru 0x76b5ea1 (0x230b bytes) 2024-09-18T05:14:28.689 INFO:teuthology.orchestra.run.smithi017.stdout:2484 write 0x2776ece thru 0x2780475 (0x95a8 bytes) 2024-09-18T05:14:28.694 INFO:teuthology.orchestra.run.smithi017.stdout:2485 write 0x490ffd5 thru 0x4919deb (0x9e17 bytes) 2024-09-18T05:14:28.715 INFO:teuthology.orchestra.run.smithi017.stdout:2487 trunc from 0xa1c0d35 to 0x3c9f863 2024-09-18T05:14:28.735 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:28.730+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:28.750 INFO:teuthology.orchestra.run.smithi017.stdout:2488 writesame 0x58ae0f6 thru 0x58b0f4e data_size 0x15(0x2e59 bytes) 2024-09-18T05:14:28.750 INFO:teuthology.orchestra.run.smithi017.stdout:2489 punch from 0x24ff143 to 0x2508535, (0x93f2 bytes) 2024-09-18T05:14:28.750 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:28.752 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:28.752 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:28.771 INFO:teuthology.orchestra.run.smithi017.stdout:2492 writesame 0xae8a1d1 thru 0xae941f3 data_size 0xf(0xa023 bytes) 2024-09-18T05:14:28.771 INFO:teuthology.orchestra.run.smithi017.stdout:2493 write 0x7fcf2fe thru 0x7fd6b32 (0x7835 bytes) 2024-09-18T05:14:28.773 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:28.778 INFO:teuthology.orchestra.run.smithi017.stdout:2494 read 0x79e980f thru 0x79f2506 (0x8cf8 bytes) 2024-09-18T05:14:28.778 INFO:teuthology.orchestra.run.smithi017.stdout:2496 read 0x91cd5b4 thru 0x91d8a7e (0xb4cb bytes) 2024-09-18T05:14:28.779 INFO:teuthology.orchestra.run.smithi017.stdout:2499 clone 19 order 21 su 1048576 sc 12 2024-09-18T05:14:28.836 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:28.830+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:28.899 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:28.899 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:28.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:28.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:28.936 INFO:teuthology.orchestra.run.smithi086.stdout:get_pg_num_history pg_num_history pg_num_history(e47 pg_nums {1={15=1},2={18=8},3={22=32}} deleted_pools ) 2024-09-18T05:14:28.937 INFO:teuthology.orchestra.run.smithi086.stdout:Importing pgid 2.7 2024-09-18T05:14:28.937 INFO:teuthology.orchestra.run.smithi086.stdout:write_pg epoch 22 info 2.7( empty local-lis/les=18/19 n=0 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-18T05:14:28.941 INFO:teuthology.orchestra.run.smithi086.stdout:Import successful 2024-09-18T05:14:28.959 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:28.954+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:28.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:14:29.047 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:29.042+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:29.093 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:29.093 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:29.104 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone18 from 0xae941f4 (overlap 0xf45fdb) to 0xab0fe6 2024-09-18T05:14:29.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:29.135 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:29.135 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:29.138 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:29.134+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:29.156 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:29.157 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:29.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:29.173 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:29.191 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:29.212 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:29.212 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:29.233 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:29.234 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:29.234 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-18T05:14:29.239 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:29.234+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:29.266 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:29.267 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-18T05:14:29.269 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:29.273 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:14:29.274 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:14:29.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:29.307 INFO:teuthology.orchestra.run.smithi017.stdout:2500 writesame 0x34ea938 thru 0x34f7029 data_size 0x37(0xc6f2 bytes) 2024-09-18T05:14:29.326 INFO:teuthology.orchestra.run.smithi017.stdout:2501 write 0x615f5ca thru 0x615f7d6 (0x20d bytes) 2024-09-18T05:14:29.331 INFO:teuthology.orchestra.run.smithi017.stdout:2502 punch from 0x91b3cf1 to 0x91b8ad3, (0x4de2 bytes) 2024-09-18T05:14:29.331 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:29.340 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:29.334+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:29.347 INFO:teuthology.orchestra.run.smithi017.stdout:2505 write 0xe114ce8 thru 0xe11f068 (0xa381 bytes) 2024-09-18T05:14:29.354 INFO:teuthology.orchestra.run.smithi017.stdout:2506 write 0x7531666 thru 0x753da32 (0xc3cd bytes) 2024-09-18T05:14:29.361 INFO:teuthology.orchestra.run.smithi017.stdout:2507 read 0xb98f788 thru 0xb996f40 (0x77b9 bytes) 2024-09-18T05:14:29.368 INFO:teuthology.orchestra.run.smithi017.stdout:2508 trunc from 0xe11f069 to 0x921742f 2024-09-18T05:14:29.404 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:29.422 INFO:teuthology.orchestra.run.smithi017.stdout:2510 writesame 0xc795d45 thru 0xc7a0afa data_size 0x5(0xadb6 bytes) 2024-09-18T05:14:29.422 INFO:teuthology.orchestra.run.smithi017.stdout:2511 punch from 0xb42ca7a to 0xb430e14, (0x439a bytes) 2024-09-18T05:14:29.423 INFO:teuthology.orchestra.run.smithi017.stdout:2512 read 0xbb616f thru 0xbbc47f (0x6311 bytes) 2024-09-18T05:14:29.423 INFO:teuthology.orchestra.run.smithi017.stdout:2513 read 0x4097c9a thru 0x409b48e (0x37f5 bytes) 2024-09-18T05:14:29.423 INFO:teuthology.orchestra.run.smithi017.stdout:2515 read 0xc2110ca thru 0xc21cd21 (0xbc58 bytes) 2024-09-18T05:14:29.423 INFO:teuthology.orchestra.run.smithi017.stdout:2517 read 0x9674fb3 thru 0x967dbc5 (0x8c13 bytes) 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.516643137999999, 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:29.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:14:29.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.437 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.516612195, 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:14:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:14:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:14:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:14:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.516586631000003, 2024-09-18T05:14:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:14:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:14:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:14:29.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:14:29.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.516561914999997, 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:14:29.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.449 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:29.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:29.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:29.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:14:29.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.454 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.516535681000001, 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.516506772, 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.459 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:29.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:14:29.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.516482942000003, 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.516458466000003, 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:14:29.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.516340667000001, 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.473 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:14:29.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.474 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:29.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:14:29.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:14:29.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.513348712000003, 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:14:29.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.479 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:14:29.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.479 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:29.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:29.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:14:29.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:14:29.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:14:29.484 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.484 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.484 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.484 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.513270650000003, 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:29.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:14:29.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:14:29.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:14:29.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:14:29.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.489 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.513239362999997, 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:29.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:14:29.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:14:29.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.513213350000001, 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:29.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:14:29.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.513185577000002, 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.499 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:14:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.513160513999999, 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:14:29.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:14:29.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:14:29.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.513135484000003, 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1854 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 540672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916718+0000", 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.509034466000003, 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097779173999999996, 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1854 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916718+0000", 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916718+0000", 2024-09-18T05:14:29.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916717+0000", 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916723+0000", 2024-09-18T05:14:29.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6470000000000003e-06 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916730+0000", 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2049999999999996e-06 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916736+0000", 2024-09-18T05:14:29.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8510000000000004e-06 2024-09-18T05:14:29.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014179+0000", 2024-09-18T05:14:29.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097443396000000002 2024-09-18T05:14:29.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014342+0000", 2024-09-18T05:14:29.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016297600000000001 2024-09-18T05:14:29.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014497+0000", 2024-09-18T05:14:29.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015457900000000001 2024-09-18T05:14:29.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.520 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.520 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:29.520 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.509011156, 2024-09-18T05:14:29.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:14:29.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:14:29.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:14:29.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.525 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.526 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.526 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:29.527 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.508990611000002, 2024-09-18T05:14:29.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:14:29.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.527 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.527 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.527 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.527 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:14:29.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:29.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:14:29.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.508970929, 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:14:29.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:29.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:29.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:29.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:14:29.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:14:29.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.536 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:29.536 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:29.536 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:29.537 INFO:teuthology.orchestra.run.smithi017.stdout:2518 trunc from 0xc7a0afb to 0x22cb1f2 2024-09-18T05:14:29.538 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /var/log/ceph/exp.2.7.6 2024-09-18T05:14:29.539 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:2519 punch from 0xae2ad2 to 0xae841f, (0x594d bytes) 2024-09-18T05:14:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:2520 trunc from 0x22cb1f2 to 0x63a8e1c 2024-09-18T05:14:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:2521 read 0x34af7bf thru 0x34b4c5d (0x549f bytes) 2024-09-18T05:14:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:2523 writesame 0x3f05071 thru 0x3f080e5 data_size 0x5(0x3075 bytes) 2024-09-18T05:14:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:2525 write 0xbb6c45b thru 0xbb70e4d (0x49f3 bytes) 2024-09-18T05:14:29.540 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:29.530+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:29.544 INFO:teuthology.orchestra.run.smithi017.stdout:2526 punch from 0x446ed70 to 0x447190c, (0x2b9c bytes) 2024-09-18T05:14:29.544 INFO:teuthology.orchestra.run.smithi017.stdout:2527 write 0x3699773 thru 0x36a3759 (0x9fe7 bytes) 2024-09-18T05:14:29.551 INFO:teuthology.orchestra.run.smithi017.stdout:2528 read 0x424eb99 thru 0x4257e90 (0x92f8 bytes) 2024-09-18T05:14:29.552 INFO:teuthology.orchestra.run.smithi017.stdout:2530 writesame 0x2471215 thru 0x2479631 data_size 0x1(0x841d bytes) 2024-09-18T05:14:29.577 INFO:teuthology.orchestra.run.smithi017.stdout:2531 punch from 0x500e4db to 0x5014607, (0x612c bytes) 2024-09-18T05:14:29.577 INFO:teuthology.orchestra.run.smithi017.stdout:2532 read 0x78cbcea thru 0x78d6d91 (0xb0a8 bytes) 2024-09-18T05:14:29.577 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:29.577 INFO:teuthology.orchestra.run.smithi017.stdout:2535 punch from 0x5fe5ad2 to 0x5fe62a4, (0x7d2 bytes) 2024-09-18T05:14:29.578 INFO:teuthology.orchestra.run.smithi017.stdout:2536 punch from 0x75ea4eb to 0x75ebbde, (0x16f3 bytes) 2024-09-18T05:14:29.578 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:29.578 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:29.578 INFO:teuthology.orchestra.run.smithi017.stdout:2539 punch from 0xa1864f1 to 0xa18f062, (0x8b71 bytes) 2024-09-18T05:14:29.578 INFO:teuthology.orchestra.run.smithi017.stdout:2541 write 0x31df01 thru 0x31ea87 (0xb87 bytes) 2024-09-18T05:14:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:2542 write 0xa72fce7 thru 0xa739b6a (0x9e84 bytes) 2024-09-18T05:14:29.596 INFO:teuthology.orchestra.run.smithi017.stdout:2543 trunc from 0xbb70e4e to 0x9f1dc0c 2024-09-18T05:14:29.614 INFO:teuthology.orchestra.run.smithi017.stdout:2544 writesame 0x4bd368a thru 0x4bd3b2c data_size 0x1(0x4a3 bytes) 2024-09-18T05:14:29.623 INFO:teuthology.orchestra.run.smithi017.stdout:2545 trunc from 0x9f1dc0c to 0x848162c 2024-09-18T05:14:29.638 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:29.634+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:29.661 INFO:teuthology.orchestra.run.smithi017.stdout:2547 trunc from 0x848162c to 0x979cf 2024-09-18T05:14:29.718 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:29.718 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:29.728 INFO:teuthology.orchestra.run.smithi017.stdout:2548 write 0x2d82f2a thru 0x2d85cf8 (0x2dcf bytes) 2024-09-18T05:14:29.734 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:29.736 INFO:teuthology.orchestra.run.smithi017.stdout:2549 punch from 0x196a2ab to 0x1973c5d, (0x99b2 bytes) 2024-09-18T05:14:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:2552 read 0x1aaecec thru 0x1ab69b7 (0x7ccc bytes) 2024-09-18T05:14:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:2553 read 0x1d863e0 thru 0x1d8f8c9 (0x94ea bytes) 2024-09-18T05:14:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:2554 read 0x2aa345a thru 0x2aa371e (0x2c5 bytes) 2024-09-18T05:14:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:2555 punch from 0x247e420 to 0x248c2ee, (0xdece bytes) 2024-09-18T05:14:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:2556 punch from 0x10f970b to 0x10fe117, (0x4a0c bytes) 2024-09-18T05:14:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:2560 read 0x1c84af4 thru 0x1c8fc6f (0xb17c bytes) 2024-09-18T05:14:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:2561 punch from 0xc68de9 to 0xc7264d, (0x9864 bytes) 2024-09-18T05:14:29.755 INFO:teuthology.orchestra.run.smithi017.stdout:2563 write 0x5984036 thru 0x5986247 (0x2212 bytes) 2024-09-18T05:14:29.762 INFO:teuthology.orchestra.run.smithi017.stdout:2564 read 0x3546cb thru 0x35734d (0x2c83 bytes) 2024-09-18T05:14:29.762 INFO:teuthology.orchestra.run.smithi017.stdout:2566 punch from 0x469057 to 0x470db9, (0x7d62 bytes) 2024-09-18T05:14:29.762 INFO:teuthology.orchestra.run.smithi017.stdout:2568 punch from 0x186e5a2 to 0x187587e, (0x72dc bytes) 2024-09-18T05:14:29.775 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:29.774+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:29.781 INFO:teuthology.orchestra.run.smithi017.stdout:2569 write 0x7fb4264 thru 0x7fbfb06 (0xb8a3 bytes) 2024-09-18T05:14:29.788 INFO:teuthology.orchestra.run.smithi017.stdout:2570 punch from 0x4c60439 to 0x4c6b802, (0xb3c9 bytes) 2024-09-18T05:14:29.807 INFO:teuthology.orchestra.run.smithi017.stdout:2571 trunc from 0x7fbfb07 to 0x1228e1a 2024-09-18T05:14:29.836 INFO:teuthology.orchestra.run.smithi017.stdout:2573 writesame 0x22e4c7a thru 0x22f298e data_size 0x1(0xdd15 bytes) 2024-09-18T05:14:29.840 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:29.837+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:29.862 INFO:teuthology.orchestra.run.smithi017.stdout:2575 trunc from 0x22f298f to 0xbea0b2c 2024-09-18T05:14:29.873 INFO:teuthology.orchestra.run.smithi017.stdout:2576 writesame 0xb2a0ec0 thru 0xb2a2d40 data_size 0x3(0x1e81 bytes) 2024-09-18T05:14:29.882 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:29.882 INFO:teuthology.orchestra.run.smithi017.stdout:2578 read 0x283e349 thru 0x28468b3 (0x856b bytes) 2024-09-18T05:14:29.899 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:29.899 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:29.903 INFO:teuthology.orchestra.run.smithi017.stdout:2579 trunc from 0xbea0b2c to 0x4ae2608 2024-09-18T05:14:29.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:29.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:29.934+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:29.945 INFO:teuthology.orchestra.run.smithi017.stdout:2580 trunc from 0x4ae2608 to 0xcd03e67 2024-09-18T05:14:29.955 INFO:teuthology.orchestra.run.smithi017.stdout:2581 read 0x2188cc5 thru 0x218e07f (0x53bb bytes) 2024-09-18T05:14:29.956 INFO:teuthology.orchestra.run.smithi017.stdout:2583 write 0x7679357 thru 0x76878de (0xe588 bytes) 2024-09-18T05:14:29.962 INFO:teuthology.orchestra.run.smithi017.stdout:2584 read 0x3c1da41 thru 0x3c284e4 (0xaaa4 bytes) 2024-09-18T05:14:29.962 INFO:teuthology.orchestra.run.smithi017.stdout:2585 writesame 0x8e75950 thru 0x8e7f121 data_size 0x1(0x97d2 bytes) 2024-09-18T05:14:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:14:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:2586 write 0xde369d2 thru 0xde42347 (0xb976 bytes) 2024-09-18T05:14:30.036 INFO:teuthology.orchestra.run.smithi017.stdout:2587 clone 20 order 25 su 524288 sc 7 2024-09-18T05:14:30.083 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:30.078+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:30.089 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:30.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:34842 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.642468+0000", 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4438284229999994, 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054921899000000003, 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 34842 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642468+0000", 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642468+0000", 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642467+0000", 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642488+0000", 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1195e-05 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642506+0000", 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7589e-05 2024-09-18T05:14:30.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642519+0000", 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3478999999999999e-05 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697373+0000", 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054853784000000003 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697390+0000", 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6949e-05 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:34843 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.642531+0000", 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4437653319999999, 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054916773000000002, 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 34843 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642531+0000", 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642531+0000", 2024-09-18T05:14:30.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642530+0000", 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642548+0000", 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7317999999999999e-05 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642565+0000", 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7405e-05 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642608+0000", 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2471e-05 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697434+0000", 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054826248000000001 2024-09-18T05:14:30.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697448+0000", 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4207e-05 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35040 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644793+0000", 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4415039400000005, 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054897967999999998, 2024-09-18T05:14:30.098 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35040 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644793+0000", 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644793+0000", 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644792+0000", 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644802+0000", 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0053e-05 2024-09-18T05:14:30.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644811+0000", 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7590000000000003e-06 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644818+0000", 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9129999999999997e-06 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699682+0000", 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054864582000000002 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699691+0000", 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3010000000000007e-06 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35041 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.102 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644824+0000", 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4414730729999992, 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054909866000000002, 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35041 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644824+0000", 2024-09-18T05:14:30.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644824+0000", 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644823+0000", 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644826+0000", 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3000000000000002e-06 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644835+0000", 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3429999999999996e-06 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644841+0000", 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.793e-06 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699718+0000", 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054876552000000002 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699733+0000", 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5571000000000001e-05 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35042 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.106 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4414492679999995, 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054947252000000002, 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35042 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644850+0000", 2024-09-18T05:14:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.089e-06 2024-09-18T05:14:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644858+0000", 2024-09-18T05:14:30.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2470000000000008e-06 2024-09-18T05:14:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644865+0000", 2024-09-18T05:14:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8220000000000001e-06 2024-09-18T05:14:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699785+0000", 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054920552999999997 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699795+0000", 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1970000000000002e-06 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35043 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644871+0000", 2024-09-18T05:14:30.111 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4414260359999993, 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05500414, 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35043 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644871+0000", 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644871+0000", 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644870+0000", 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644883+0000", 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2592000000000001e-05 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644892+0000", 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1190000000000003e-06 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644907+0000", 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839e-05 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699859+0000", 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054952913999999999 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699875+0000", 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5328999999999998e-05 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35044 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.115 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644913+0000", 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4413840259999997, 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055016171000000003, 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35044 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644913+0000", 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644913+0000", 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644912+0000", 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644928+0000", 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5911999999999999e-05 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644937+0000", 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0359999999999995e-06 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644944+0000", 2024-09-18T05:14:30.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5859999999999999e-06 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699920+0000", 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054975475000000003 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699929+0000", 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8619999999999992e-06 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35045 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645001+0000", 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4412961830000004, 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054993128000000002, 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35045 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645001+0000", 2024-09-18T05:14:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645001+0000", 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644999+0000", 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645004+0000", 2024-09-18T05:14:30.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.386e-06 2024-09-18T05:14:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645025+0000", 2024-09-18T05:14:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1072000000000001e-05 2024-09-18T05:14:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645033+0000", 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4929999999999998e-06 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699978+0000", 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054944686999999999 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699994+0000", 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5642999999999999e-05 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35046 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645043+0000", 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4412535959999992, 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055002748999999997, 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.125 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35046 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645043+0000", 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645043+0000", 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645042+0000", 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645046+0000", 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8399999999999997e-06 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645055+0000", 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8230000000000001e-06 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645062+0000", 2024-09-18T05:14:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6889999999999998e-06 2024-09-18T05:14:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700035+0000", 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054973889999999997 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700046+0000", 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0441e-05 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35047 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645068+0000", 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4412290349999992, 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055041751, 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35047 2024-09-18T05:14:30.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645068+0000", 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645068+0000", 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645067+0000", 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645070+0000", 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5700000000000001e-06 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645078+0000", 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0320000000000003e-06 2024-09-18T05:14:30.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645085+0000", 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6540000000000002e-06 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700094+0000", 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055009007999999998 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700109+0000", 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5316999999999999e-05 2024-09-18T05:14:30.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35048 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645092+0000", 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4412048570000007, 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055077814000000003, 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.134 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35048 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645092+0000", 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645092+0000", 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645091+0000", 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645094+0000", 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0800000000000002e-06 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645103+0000", 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3529999999999995e-06 2024-09-18T05:14:30.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645110+0000", 2024-09-18T05:14:30.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9059999999999996e-06 2024-09-18T05:14:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700160+0000", 2024-09-18T05:14:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055050864999999997 2024-09-18T05:14:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700170+0000", 2024-09-18T05:14:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2569999999999996e-06 2024-09-18T05:14:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35049 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4411814760000006, 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055117828000000001, 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35049 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645118+0000", 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0900000000000001e-06 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645126+0000", 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3829999999999992e-06 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645133+0000", 2024-09-18T05:14:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5760000000000002e-06 2024-09-18T05:14:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700218+0000", 2024-09-18T05:14:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055085150999999999 2024-09-18T05:14:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700233+0000", 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5291e-05 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35050 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.149 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4411582969999994, 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055144048000000001, 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35050 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.150 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:30.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645141+0000", 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.129e-06 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645149+0000", 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.32e-06 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645156+0000", 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5560000000000004e-06 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700273+0000", 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055117753999999998 2024-09-18T05:14:30.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700282+0000", 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.969e-06 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35051 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4411353420000008, 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055189845000000001, 2024-09-18T05:14:30.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35051 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645164+0000", 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.083e-06 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645172+0000", 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2500000000000006e-06 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645182+0000", 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7389999999999994e-06 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700330+0000", 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055147843000000002 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700351+0000", 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1577e-05 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35053 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645188+0000", 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4411089369999992, 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055212911000000003, 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.158 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35053 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645188+0000", 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645188+0000", 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645187+0000", 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645212+0000", 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4607999999999999e-05 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645228+0000", 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6631999999999999e-05 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645247+0000", 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8748000000000001e-05 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700392+0000", 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055144679000000002 2024-09-18T05:14:30.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700401+0000", 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8810000000000002e-06 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35055 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4410423429999994, 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055212430999999999, 2024-09-18T05:14:30.162 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35055 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645257+0000", 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645266+0000", 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.816e-06 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645273+0000", 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5799999999999997e-06 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700449+0000", 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055176493 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700467+0000", 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7589e-05 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.166 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35057 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645279+0000", 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4410177350000009, 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055246213000000002, 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35057 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645279+0000", 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645279+0000", 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645278+0000", 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645281+0000", 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1319999999999998e-06 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645290+0000", 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3499999999999997e-06 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645296+0000", 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4790000000000001e-06 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700516+0000", 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055219621000000003 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700525+0000", 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2969999999999992e-06 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35059 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4409942900000008, 2024-09-18T05:14:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055288944, 2024-09-18T05:14:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35059 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645305+0000", 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0960000000000001e-06 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645313+0000", 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3399999999999998e-06 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645322+0000", 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5259999999999993e-06 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700574+0000", 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055251888999999998 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700591+0000", 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7753000000000001e-05 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35061 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645328+0000", 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4409688490000008, 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055293502000000001, 2024-09-18T05:14:30.175 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35061 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645328+0000", 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645328+0000", 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645327+0000", 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645339+0000", 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1432e-05 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645348+0000", 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2520000000000005e-06 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645355+0000", 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0929999999999997e-06 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700613+0000", 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055258003 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700621+0000", 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3909999999999998e-06 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35063 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.179 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645361+0000", 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4409357079999996, 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055301707999999998, 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35063 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645361+0000", 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645361+0000", 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645360+0000", 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645364+0000", 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3160000000000001e-06 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645372+0000", 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7830000000000004e-06 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645379+0000", 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5629999999999997e-06 2024-09-18T05:14:30.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700648+0000", 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055268912000000003 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700663+0000", 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4807000000000001e-05 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.184 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.184 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:30.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:30.186 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:30.178+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:30.285 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:30.278+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:30.313 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:30.313 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:30.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:30.387 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:30.382+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:30.445 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:30.446 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:30.460 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:30.488 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:30.482+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:30.584 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.584 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9220616130000003, 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:14:30.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:14:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:14:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:14:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:14:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:14:30.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:14:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9219946950000004, 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:14:30.591 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:14:30.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:14:30.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9219061849999992, 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9218556289999995, 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.600 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:14:30.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9217925139999998, 2024-09-18T05:14:30.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:14:30.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:14:30.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.608 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9217455940000008, 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.612 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9216917149999997, 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:14:30.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:14:30.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9216445820000008, 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:14:30.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:14:30.621 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9215969600000005, 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:14:30.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9214741390000007, 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:14:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:14:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:14:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:14:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:14:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9213928090000003, 2024-09-18T05:14:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:14:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:14:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:14:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9213215659999996, 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.921271355, 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:14:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:14:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9211941610000007, 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:14:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9211442909999992, 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:14:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9210697200000002, 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:14:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9210039420000005, 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:14:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:14:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:14:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9209569060000007, 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:14:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9208948130000003, 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:14:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9208484339999998, 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:14:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:30.674 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:30.676 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:30.676 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:30.670+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:30.777 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:30.773+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:30.804 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:30.804 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:30.804 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:30.818 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:30.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:30.870+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:30.978 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:30.970+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:30.979 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:30.979 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:30.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:31.079 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:31.074+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:31.115 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:27144 3.e 3:72e631ab:::rbd_data.118b9f2c0487.000000000000003c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T05:14:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.650760803000001, 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053442387000000001, 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 27144 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:14:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462530+0000", 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999957 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462560+0000", 2024-09-18T05:14:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9933e-05 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462596+0000", 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5936000000000003e-05 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462621+0000", 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4644e-05 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462748+0000", 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126892 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.463025+0000", 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027756100000000001 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.471585+0000", 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085600780000000005 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515712+0000", 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.044127 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515824+0000", 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112002 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515915+0000", 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0105999999999994e-05 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515977+0000", 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2521999999999995e-05 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36312 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.3047352270000001, 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050924795000000002, 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36312 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808562+0000", 2024-09-18T05:14:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.522e-06 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808566+0000", 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0459999999999999e-06 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808569+0000", 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1580000000000001e-06 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859475+0000", 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050906734000000002 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859485+0000", 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6029999999999994e-06 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36313 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.3047240680000005, 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050958802999999997, 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36313 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808573+0000", 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4720000000000001e-06 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808577+0000", 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9899999999999999e-06 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808581+0000", 2024-09-18T05:14:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.301e-06 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859521+0000", 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939971000000001 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859530+0000", 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3309999999999993e-06 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36314 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.3047118859999998, 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050974481000000002, 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36314 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808583+0000", 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808585+0000", 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839999999999999e-06 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808589+0000", 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0149999999999997e-06 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808592+0000", 2024-09-18T05:14:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2100000000000002e-06 2024-09-18T05:14:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859552+0000", 2024-09-18T05:14:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050959971999999999 2024-09-18T05:14:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859558+0000", 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0809999999999999e-06 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37032 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 366592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1661955549999998, 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050948475, 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37032 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947099+0000", 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947102+0000", 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3140000000000002e-06 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947107+0000", 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947112+0000", 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6500000000000004e-06 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997959+0000", 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050847106000000003 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997999+0000", 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0049000000000002e-05 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998048+0000", 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9211e-05 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37033 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 376832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1661687670000003, 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051119236999999998, 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37033 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:14:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947126+0000", 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947129+0000", 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5469999999999999e-06 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947135+0000", 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5069999999999997e-06 2024-09-18T05:14:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947140+0000", 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7350000000000004e-06 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998080+0000", 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939401000000002 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998158+0000", 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8753999999999998e-05 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998246+0000", 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7682999999999994e-05 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37034 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 387072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.166151545, 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05121883, 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37034 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947146+0000", 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.12e-06 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947152+0000", 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8560000000000003e-06 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947156+0000", 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5970000000000002e-06 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998271+0000", 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051114764 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998312+0000", 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1258999999999999e-05 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998363+0000", 2024-09-18T05:14:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0581999999999998e-05 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37035 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1661351750000009, 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051399043999999998, 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37035 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947162+0000", 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1619999999999998e-06 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947168+0000", 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7640000000000002e-06 2024-09-18T05:14:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947172+0000", 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4750000000000004e-06 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998394+0000", 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051222202000000001 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998472+0000", 2024-09-18T05:14:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7228e-05 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998559+0000", 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7699000000000002e-05 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37036 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 407552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1661196080000007, 2024-09-18T05:14:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051565297000000003, 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37036 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947178+0000", 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0169999999999999e-06 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947183+0000", 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947188+0000", 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998583+0000", 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051394678999999999 2024-09-18T05:14:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998661+0000", 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8631e-05 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998741+0000", 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0054000000000003e-05 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37037 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 417792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1661034109999999, 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051746031999999997, 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37037 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947194+0000", 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1100000000000001e-06 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947200+0000", 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2530000000000001e-06 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947205+0000", 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8319999999999996e-06 2024-09-18T05:14:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998775+0000", 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051569934999999997 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998850+0000", 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4783999999999994e-05 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998938+0000", 2024-09-18T05:14:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8442999999999993e-05 2024-09-18T05:14:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37038 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1660858469999997, 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851468999999997, 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37038 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947209+0000", 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947212+0000", 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947218+0000", 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2319999999999998e-06 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947223+0000", 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8590000000000004e-06 2024-09-18T05:14:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998966+0000", 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051743193999999999 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999009+0000", 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999997e-05 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999061+0000", 2024-09-18T05:14:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2216999999999998e-05 2024-09-18T05:14:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37039 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1660687030000005, 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052037513000000001, 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37039 2024-09-18T05:14:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947226+0000", 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947229+0000", 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.198e-06 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947235+0000", 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.319e-06 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947240+0000", 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7260000000000002e-06 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999092+0000", 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851928999999998 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999162+0000", 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0115000000000002e-05 2024-09-18T05:14:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999264+0000", 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010256599999999999 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37040 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 448512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.166049933, 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052135867000000002, 2024-09-18T05:14:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37040 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947245+0000", 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947248+0000", 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4439999999999998e-06 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947256+0000", 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9410000000000007e-06 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947260+0000", 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999286+0000", 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052025350999999997 2024-09-18T05:14:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999330+0000", 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4226e-05 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999381+0000", 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1529000000000001e-05 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37041 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 458752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1660306380000005, 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052321965999999998, 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37041 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947275+0000", 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0175e-05 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947283+0000", 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8660000000000006e-06 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947287+0000", 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6369999999999998e-06 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999414+0000", 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052126541999999998 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999494+0000", 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:14:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999587+0000", 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2795999999999997e-05 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37042 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1660038089999993, 2024-09-18T05:14:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052411412999999997, 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37042 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947291+0000", 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947294+0000", 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4559999999999999e-06 2024-09-18T05:14:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947300+0000", 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5189999999999998e-06 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947305+0000", 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9049999999999996e-06 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999614+0000", 2024-09-18T05:14:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052308353000000002 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999653+0000", 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9879000000000002e-05 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999703+0000", 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9710999999999999e-05 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37043 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 479232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1659818590000004, 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052588113999999998, 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37043 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947313+0000", 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947316+0000", 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4059999999999999e-06 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947322+0000", 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2999999999999998e-06 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947327+0000", 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7119999999999999e-06 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999735+0000", 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052408145000000003 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999812+0000", 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7540999999999995e-05 2024-09-18T05:14:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999902+0000", 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9413000000000006e-05 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37044 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 489472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1659646709999993, 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052688817999999998, 2024-09-18T05:14:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37044 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947333+0000", 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.396e-06 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947339+0000", 2024-09-18T05:14:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:14:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947344+0000", 2024-09-18T05:14:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9359999999999998e-06 2024-09-18T05:14:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999929+0000", 2024-09-18T05:14:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052584371999999997 2024-09-18T05:14:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999969+0000", 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0315000000000003e-05 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000020+0000", 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0807000000000003e-05 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37045 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 499712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1659468620000002, 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052875286000000001, 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37045 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947348+0000", 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947351+0000", 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3130000000000001e-06 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947357+0000", 2024-09-18T05:14:31.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2040000000000002e-06 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947362+0000", 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9269999999999996e-06 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000054+0000", 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052691799999999997 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000133+0000", 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9134999999999994e-05 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000224+0000", 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1315000000000002e-05 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37046 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1659295079999996, 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052973012999999999, 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37046 2024-09-18T05:14:31.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947368+0000", 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3190000000000002e-06 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947374+0000", 2024-09-18T05:14:31.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1569999999999997e-06 2024-09-18T05:14:31.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947379+0000", 2024-09-18T05:14:31.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6949999999999999e-06 2024-09-18T05:14:31.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000250+0000", 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052870752999999999 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000291+0000", 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0975e-05 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000339+0000", 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8511999999999999e-05 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37047 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1659125170000006, 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053159397999999997, 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:31.209 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37047 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:31.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947385+0000", 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3070000000000001e-06 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947391+0000", 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947396+0000", 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.921e-06 2024-09-18T05:14:31.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000373+0000", 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052976957999999998 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000451+0000", 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8250000000000005e-05 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:31.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000542+0000", 2024-09-18T05:14:31.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1242999999999994e-05 2024-09-18T05:14:31.214 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.214 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.214 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.214 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:31.214 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:31.214 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:31.216 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:31.213+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:31.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:31.234 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone19 from 0xde42348 (overlap 0x979cf) to 0x794a5 2024-09-18T05:14:31.275 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:31.323 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:31.318+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:31.350 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:31.350 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:31.351 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:31.367 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:31.430 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-18T05:14:31.430 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:31.422+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:31.433 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:31.433 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:31.446 INFO:teuthology.orchestra.run.smithi017.stdout:2588 read 0x1765396 thru 0x17717bf (0xc42a bytes) 2024-09-18T05:14:31.447 INFO:teuthology.orchestra.run.smithi017.stdout:2589 write 0x5fa96fa thru 0x5fb72ba (0xdbc1 bytes) 2024-09-18T05:14:31.451 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:31.459 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:31.459 INFO:teuthology.orchestra.run.smithi017.stdout:2591 read 0x139efae thru 0x13a1456 (0x24a9 bytes) 2024-09-18T05:14:31.459 INFO:teuthology.orchestra.run.smithi017.stdout:2592 punch from 0x6b930f to 0x6bdc80, (0x4971 bytes) 2024-09-18T05:14:31.459 INFO:teuthology.orchestra.run.smithi017.stdout:2593 write 0x2812819 thru 0x281b173 (0x895b bytes) 2024-09-18T05:14:31.467 INFO:teuthology.orchestra.run.smithi017.stdout:2594 read 0xd2ef79c thru 0xd2fa369 (0xabce bytes) 2024-09-18T05:14:31.467 INFO:teuthology.orchestra.run.smithi017.stdout:2596 punch from 0xccb2672 to 0xccb4aed, (0x247b bytes) 2024-09-18T05:14:31.467 INFO:teuthology.orchestra.run.smithi017.stdout:2598 read 0x448f7c0 thru 0x449d12f (0xd970 bytes) 2024-09-18T05:14:31.468 INFO:teuthology.orchestra.run.smithi017.stdout:2599 writesame 0x94673c7 thru 0x946eb09 data_size 0x1(0x7743 bytes) 2024-09-18T05:14:31.470 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:31.483 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:31.484 INFO:teuthology.orchestra.run.smithi017.stdout:2601 writesame 0xcd59e42 thru 0xcd60469 data_size 0x8(0x6628 bytes) 2024-09-18T05:14:31.487 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:31.494 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:31.494 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:31.494 INFO:teuthology.orchestra.run.smithi017.stdout:2604 write 0x365009 thru 0x368b80 (0x3b78 bytes) 2024-09-18T05:14:31.508 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:31.508 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:31.511 INFO:teuthology.orchestra.run.smithi017.stdout:2605 trunc from 0xde42348 to 0x5b85a48 2024-09-18T05:14:31.517 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:31.510+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:31.532 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:31.532 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:31.532 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-18T05:14:31.545 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:31.545 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:31.548 INFO:teuthology.orchestra.run.smithi017.stdout:2606 writesame 0x8e5a3a2 thru 0x8e5db5b data_size 0x7(0x37ba bytes) 2024-09-18T05:14:31.553 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:31.553 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:31.554 INFO:teuthology.orchestra.run.smithi017.stdout:2607 trunc from 0x8e5db5c to 0xc1cf354 2024-09-18T05:14:31.557 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:14:31.557 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:14:31.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:31.566 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:31.566 INFO:teuthology.orchestra.run.smithi017.stdout:2611 write 0x883c86c thru 0x88472e9 (0xaa7e bytes) 2024-09-18T05:14:31.568 INFO:teuthology.orchestra.run.smithi017.stdout:2612 read 0x1009e09 thru 0x1011b53 (0x7d4b bytes) 2024-09-18T05:14:31.569 INFO:teuthology.orchestra.run.smithi017.stdout:2613 punch from 0x89460ed to 0x8950e62, (0xad75 bytes) 2024-09-18T05:14:31.579 INFO:teuthology.orchestra.run.smithi017.stdout:2616 trunc from 0xc1cf354 to 0x52bc5b9 2024-09-18T05:14:31.614 INFO:teuthology.orchestra.run.smithi017.stdout:2618 write 0xb5b9d49 thru 0xb5c71c4 (0xd47c bytes) 2024-09-18T05:14:31.616 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:31.616 INFO:teuthology.orchestra.run.smithi017.stdout:2623 write 0x7ae90fa thru 0x7af71fc (0xe103 bytes) 2024-09-18T05:14:31.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:31.610+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:31.619 INFO:teuthology.orchestra.run.smithi017.stdout:2624 write 0x924abd0 thru 0x9251033 (0x6464 bytes) 2024-09-18T05:14:31.638 INFO:teuthology.orchestra.run.smithi017.stdout:2625 writesame 0xe3b91e8 thru 0xe3b9f95 data_size 0x11(0xdae bytes) 2024-09-18T05:14:31.639 INFO:teuthology.orchestra.run.smithi017.stdout:2626 writesame 0xb2b1bba thru 0xb2b74bd data_size 0x36(0x5904 bytes) 2024-09-18T05:14:31.653 INFO:teuthology.orchestra.run.smithi017.stdout:2627 trunc from 0xe3b9f96 to 0x694ad68 2024-09-18T05:14:31.668 INFO:teuthology.orchestra.run.smithi017.stdout:2629 punch from 0xac4164 to 0xad1595, (0xd431 bytes) 2024-09-18T05:14:31.669 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:31.669 INFO:teuthology.orchestra.run.smithi017.stdout:2632 read 0x19424ea thru 0x19470bd (0x4bd4 bytes) 2024-09-18T05:14:31.669 INFO:teuthology.orchestra.run.smithi017.stdout:2634 writesame 0x1199e9a thru 0x11a49d4 data_size 0xb(0xab3b bytes) 2024-09-18T05:14:31.675 INFO:teuthology.orchestra.run.smithi017.stdout:2635 punch from 0x4aa0b09 to 0x4aae159, (0xd650 bytes) 2024-09-18T05:14:31.675 INFO:teuthology.orchestra.run.smithi017.stdout:2636 punch from 0xc8bd78 to 0xc990c4, (0xd34c bytes) 2024-09-18T05:14:31.675 INFO:teuthology.orchestra.run.smithi017.stdout:2637 punch from 0x12a9dec to 0x12b3b73, (0x9d87 bytes) 2024-09-18T05:14:31.676 INFO:teuthology.orchestra.run.smithi017.stdout:2638 read 0x4ff64bc thru 0x4fffb00 (0x9645 bytes) 2024-09-18T05:14:31.691 INFO:teuthology.orchestra.run.smithi017.stdout:2639 writesame 0x80b0869 thru 0x80b2a6c data_size 0xe(0x2204 bytes) 2024-09-18T05:14:31.694 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:31.694 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:31.694 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:31.701 INFO:teuthology.orchestra.run.smithi017.stdout:2641 trunc from 0x80b2a6d to 0x40fb6bc 2024-09-18T05:14:31.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:31.717 INFO:teuthology.orchestra.run.smithi017.stdout:2642 read 0x3b53475 thru 0x3b56400 (0x2f8c bytes) 2024-09-18T05:14:31.718 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:31.719 INFO:teuthology.orchestra.run.smithi017.stdout:2645 clone 21 order 20 su 32768 sc 14 2024-09-18T05:14:31.720 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:31.714+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:31.820 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:31.814+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:31.846 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:31.846 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:31.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:31.947 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:31.942+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:32.022 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:32.018+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:32.036 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:32.037 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:32.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:14:32.053 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:32.124 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:32.121+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:32.217 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone20 from 0x40fb6bc (overlap 0x40fb6bc) to 0x2d7ccb6 2024-09-18T05:14:32.225 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:32.218+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:32.226 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:32.226 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:32.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:32.326 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:32.321+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:32.421 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:32.421 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:32.427 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:32.422+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:32.439 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:32.446 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-18T05:14:32.468 INFO:teuthology.orchestra.run.smithi017.stdout:2646 trunc from 0x40fb6bc to 0xd546e75 2024-09-18T05:14:32.482 INFO:teuthology.orchestra.run.smithi017.stdout:2647 read 0xd515738 thru 0xd52440b (0xecd4 bytes) 2024-09-18T05:14:32.482 INFO:teuthology.orchestra.run.smithi017.stdout:2648 write 0x20919e7 thru 0x209e7a7 (0xcdc1 bytes) 2024-09-18T05:14:32.498 INFO:teuthology.orchestra.run.smithi017.stdout:2650 write 0x92e7d07 thru 0x92ebf96 (0x4290 bytes) 2024-09-18T05:14:32.505 INFO:teuthology.orchestra.run.smithi017.stdout:2654 read 0x51e6ce2 thru 0x51f5118 (0xe437 bytes) 2024-09-18T05:14:32.506 INFO:teuthology.orchestra.run.smithi017.stdout:2655 punch from 0xaf2b9c to 0xaf996c, (0x6dd0 bytes) 2024-09-18T05:14:32.506 INFO:teuthology.orchestra.run.smithi017.stdout:2656 writesame 0x6e22ae1 thru 0x6e2b7bf data_size 0x3(0x8cdf bytes) 2024-09-18T05:14:32.524 INFO:teuthology.orchestra.run.smithi017.stdout:2657 trunc from 0xd546e75 to 0x7bff4fc 2024-09-18T05:14:32.527 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:32.522+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:32.559 INFO:teuthology.orchestra.run.smithi017.stdout:2658 writesame 0xb00370c thru 0xb0135eb data_size 0x10(0xfee0 bytes) 2024-09-18T05:14:32.560 INFO:teuthology.orchestra.run.smithi017.stdout:2659 punch from 0xf28bad to 0xf32844, (0x9c97 bytes) 2024-09-18T05:14:32.560 INFO:teuthology.orchestra.run.smithi017.stdout:2660 write 0x5fd5917 thru 0x5fdd207 (0x78f1 bytes) 2024-09-18T05:14:32.568 INFO:teuthology.orchestra.run.smithi017.stdout:2661 punch from 0x571c7fa to 0x57281b6, (0xb9bc bytes) 2024-09-18T05:14:32.568 INFO:teuthology.orchestra.run.smithi017.stdout:2663 writesame 0x2170d49 thru 0x2177788 data_size 0x40(0x6a40 bytes) 2024-09-18T05:14:32.572 INFO:teuthology.orchestra.run.smithi017.stdout:2665 read 0x911ef58 thru 0x9125253 (0x62fc bytes) 2024-09-18T05:14:32.572 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:32.572 INFO:teuthology.orchestra.run.smithi017.stdout:2667 read 0xacc431e thru 0xacc49b1 (0x694 bytes) 2024-09-18T05:14:32.585 INFO:teuthology.orchestra.run.smithi017.stdout:2672 trunc from 0xb0135ec to 0x572c01f 2024-09-18T05:14:32.587 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:32.587 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:32.604 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:32.628 INFO:teuthology.orchestra.run.smithi017.stdout:2673 writesame 0xbf0e712 thru 0xbf1496a data_size 0x1(0x6259 bytes) 2024-09-18T05:14:32.628 INFO:teuthology.orchestra.run.smithi017.stdout:2674 write 0xbdd18a3 thru 0xbde0812 (0xef70 bytes) 2024-09-18T05:14:32.629 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:32.622+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:32.636 INFO:teuthology.orchestra.run.smithi017.stdout:2675 read 0x92575ca thru 0x925a28e (0x2cc5 bytes) 2024-09-18T05:14:32.648 INFO:teuthology.orchestra.run.smithi017.stdout:2677 write 0xdcf5039 thru 0xdcff512 (0xa4da bytes) 2024-09-18T05:14:32.655 INFO:teuthology.orchestra.run.smithi017.stdout:2678 write 0xbf0fe1b thru 0xbf186a9 (0x888f bytes) 2024-09-18T05:14:32.684 INFO:teuthology.orchestra.run.smithi017.stdout:2679 trunc from 0xdcff513 to 0x40f1b4b 2024-09-18T05:14:32.729 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:32.722+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:32.776 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:32.777 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:32.782 INFO:teuthology.orchestra.run.smithi017.stdout:2680 write 0xe4d3a8c thru 0xe4dc70b (0x8c80 bytes) 2024-09-18T05:14:32.792 INFO:teuthology.orchestra.run.smithi017.stdout:2683 trunc from 0xe4dc70c to 0xe2d3c2d 2024-09-18T05:14:32.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:32.803 INFO:teuthology.orchestra.run.smithi017.stdout:2684 punch from 0xa074fb0 to 0xa08244c, (0xd49c bytes) 2024-09-18T05:14:32.803 INFO:teuthology.orchestra.run.smithi017.stdout:2686 write 0x5c0bd30 thru 0x5c12753 (0x6a24 bytes) 2024-09-18T05:14:32.812 INFO:teuthology.orchestra.run.smithi017.stdout:2688 write 0x60a457 thru 0x60fed2 (0x5a7c bytes) 2024-09-18T05:14:32.827 INFO:teuthology.orchestra.run.smithi017.stdout:2689 writesame 0x56949a thru 0x5766b2 data_size 0x1f(0xd219 bytes) 2024-09-18T05:14:32.831 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:32.826+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:32.841 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:32.841 INFO:teuthology.orchestra.run.smithi017.stdout:2691 write 0x46c584e thru 0x46ced8a (0x953d bytes) 2024-09-18T05:14:32.856 INFO:teuthology.orchestra.run.smithi017.stdout:2692 write 0xed2c7a0 thru 0xed3230d (0x5b6e bytes) 2024-09-18T05:14:32.863 INFO:teuthology.orchestra.run.smithi017.stdout:2694 punch from 0xb4b446a to 0xb4b57ac, (0x1342 bytes) 2024-09-18T05:14:32.870 INFO:teuthology.orchestra.run.smithi017.stdout:2697 trunc from 0xed3230e to 0xa515cb9 2024-09-18T05:14:32.889 INFO:teuthology.orchestra.run.smithi017.stdout:2698 read 0x4a044c thru 0x4aa19f (0x9d54 bytes) 2024-09-18T05:14:32.890 INFO:teuthology.orchestra.run.smithi017.stdout:2699 punch from 0x5687378 to 0x5691eff, (0xab87 bytes) 2024-09-18T05:14:32.890 INFO:teuthology.orchestra.run.smithi017.stdout:2700 read 0x322a38e thru 0x322fd2a (0x599d bytes) 2024-09-18T05:14:32.891 INFO:teuthology.orchestra.run.smithi017.stdout:2701 write 0x2bdce97 thru 0x2bde7b0 (0x191a bytes) 2024-09-18T05:14:32.901 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:32.901 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:32.905 INFO:teuthology.orchestra.run.smithi017.stdout:2706 trunc from 0xa515cb9 to 0xd2f0842 2024-09-18T05:14:32.915 INFO:teuthology.orchestra.run.smithi017.stdout:2708 punch from 0xa3b1664 to 0xa3b7991, (0x632d bytes) 2024-09-18T05:14:32.926 INFO:teuthology.orchestra.run.smithi017.stdout:2710 write 0xd5fea60 thru 0xd60965b (0xabfc bytes) 2024-09-18T05:14:32.932 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:32.926+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:32.937 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:32.937 INFO:teuthology.orchestra.run.smithi017.stdout:2712 writesame 0x139266c thru 0x139caf4 data_size 0x1(0xa489 bytes) 2024-09-18T05:14:32.948 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:32.948 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:32.963 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:32.985 INFO:teuthology.orchestra.run.smithi017.stdout:2713 write 0x73d6b74 thru 0x73e0810 (0x9c9d bytes) 2024-09-18T05:14:32.995 INFO:teuthology.orchestra.run.smithi017.stdout:2714 writesame 0x876385 thru 0x87c96b data_size 0x1(0x65e7 bytes) 2024-09-18T05:14:33.022 INFO:teuthology.orchestra.run.smithi017.stdout:2715 punch from 0xc079ab6 to 0xc082093, (0x85dd bytes) 2024-09-18T05:14:33.022 INFO:teuthology.orchestra.run.smithi017.stdout:2716 read 0xc62e371 thru 0xc634c70 (0x6900 bytes) 2024-09-18T05:14:33.023 INFO:teuthology.orchestra.run.smithi017.stdout:2717 punch from 0x1c5e066 to 0x1c6aea9, (0xce43 bytes) 2024-09-18T05:14:33.023 INFO:teuthology.orchestra.run.smithi017.stdout:2718 write 0xaf74ac0 thru 0xaf7a939 (0x5e7a bytes) 2024-09-18T05:14:33.030 INFO:teuthology.orchestra.run.smithi017.stdout:2719 write 0xb208bc3 thru 0xb2178ce (0xed0c bytes) 2024-09-18T05:14:33.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:33.026+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:33.035 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.035 INFO:teuthology.orchestra.run.smithi017.stdout:2721 writesame 0x55ea60a thru 0x55eda32 data_size 0x1(0x3429 bytes) 2024-09-18T05:14:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:14:33.045 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.046 INFO:teuthology.orchestra.run.smithi017.stdout:2723 punch from 0x1462278 to 0x1469567, (0x72ef bytes) 2024-09-18T05:14:33.046 INFO:teuthology.orchestra.run.smithi017.stdout:2726 read 0x72d2809 thru 0x72db355 (0x8b4d bytes) 2024-09-18T05:14:33.046 INFO:teuthology.orchestra.run.smithi017.stdout:2727 write 0xc2b467d thru 0xc2bf608 (0xaf8c bytes) 2024-09-18T05:14:33.054 INFO:teuthology.orchestra.run.smithi017.stdout:2729 write 0x3c0c682 thru 0x3c13e8d (0x780c bytes) 2024-09-18T05:14:33.062 INFO:teuthology.orchestra.run.smithi017.stdout:2730 read 0x7dee540 thru 0x7deffb9 (0x1a7a bytes) 2024-09-18T05:14:33.062 INFO:teuthology.orchestra.run.smithi017.stdout:2731 write 0x7b181bf thru 0x7b20e8f (0x8cd1 bytes) 2024-09-18T05:14:33.071 INFO:teuthology.orchestra.run.smithi017.stdout:2733 write 0x6d8cdb6 thru 0x6d93fc2 (0x720d bytes) 2024-09-18T05:14:33.095 INFO:teuthology.orchestra.run.smithi017.stdout:2734 trunc from 0xd60965c to 0x2548a4f 2024-09-18T05:14:33.134 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:33.129+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:33.138 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:33.138 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:33.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:33.170 INFO:teuthology.orchestra.run.smithi017.stdout:2735 read 0x10d6193 thru 0x10e0b50 (0xa9be bytes) 2024-09-18T05:14:33.182 INFO:teuthology.orchestra.run.smithi017.stdout:2736 write 0x45bae10 thru 0x45c52fa (0xa4eb bytes) 2024-09-18T05:14:33.193 INFO:teuthology.orchestra.run.smithi017.stdout:2737 trunc from 0x45c52fb to 0x6d615a1 2024-09-18T05:14:33.210 INFO:teuthology.orchestra.run.smithi017.stdout:2738 trunc from 0x6d615a1 to 0xd5a880d 2024-09-18T05:14:33.218 INFO:teuthology.orchestra.run.smithi017.stdout:2741 read 0x88d8e7e thru 0x88d96c7 (0x84a bytes) 2024-09-18T05:14:33.228 INFO:teuthology.orchestra.run.smithi017.stdout:2742 trunc from 0xd5a880d to 0x770816c 2024-09-18T05:14:33.235 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:33.230+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:33.257 INFO:teuthology.orchestra.run.smithi017.stdout:2745 write 0xcf6c3e5 thru 0xcf6e925 (0x2541 bytes) 2024-09-18T05:14:33.265 INFO:teuthology.orchestra.run.smithi017.stdout:2746 punch from 0xacc61fd to 0xaccc0da, (0x5edd bytes) 2024-09-18T05:14:33.265 INFO:teuthology.orchestra.run.smithi017.stdout:2748 write 0x78bddac thru 0x78c8490 (0xa6e5 bytes) 2024-09-18T05:14:33.277 INFO:teuthology.orchestra.run.smithi017.stdout:2749 read 0x9fa6822 thru 0x9fa76c3 (0xea2 bytes) 2024-09-18T05:14:33.277 INFO:teuthology.orchestra.run.smithi017.stdout:2750 writesame 0x8550a76 thru 0x855ec2e data_size 0x41(0xe1b9 bytes) 2024-09-18T05:14:33.291 INFO:teuthology.orchestra.run.smithi017.stdout:2751 trunc from 0xcf6e926 to 0x9480db4 2024-09-18T05:14:33.308 INFO:teuthology.orchestra.run.smithi017.stdout:2752 read 0x211ef23 thru 0x21208b9 (0x1997 bytes) 2024-09-18T05:14:33.309 INFO:teuthology.orchestra.run.smithi017.stdout:2753 read 0x8011cc9 thru 0x8016d69 (0x50a1 bytes) 2024-09-18T05:14:33.314 INFO:teuthology.orchestra.run.smithi017.stdout:2754 trunc from 0x9480db4 to 0x779b0cd 2024-09-18T05:14:33.319 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:33.319 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:33.337 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:33.337 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:33.330+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:33.339 INFO:teuthology.orchestra.run.smithi017.stdout:2755 write 0x2eaa637 thru 0x2eb42e6 (0x9cb0 bytes) 2024-09-18T05:14:33.349 INFO:teuthology.orchestra.run.smithi017.stdout:2756 read 0x241ec79 thru 0x2427e14 (0x919c bytes) 2024-09-18T05:14:33.350 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.350 INFO:teuthology.orchestra.run.smithi017.stdout:2758 write 0x40e0b80 thru 0x40ee371 (0xd7f2 bytes) 2024-09-18T05:14:33.372 INFO:teuthology.orchestra.run.smithi017.stdout:2759 write 0xb736fed thru 0xb745b74 (0xeb88 bytes) 2024-09-18T05:14:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:2761 read 0x775e1d4 thru 0x776d12e (0xef5b bytes) 2024-09-18T05:14:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:2762 punch from 0xace6915 to 0xaced1e9, (0x68d4 bytes) 2024-09-18T05:14:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:2763 read 0x4cf230f thru 0x4d009c7 (0xe6b9 bytes) 2024-09-18T05:14:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:2767 read 0x174d4b4 thru 0x1751630 (0x417d bytes) 2024-09-18T05:14:33.384 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.384 INFO:teuthology.orchestra.run.smithi017.stdout:2770 write 0x7e845de thru 0x7e9420d (0xfc30 bytes) 2024-09-18T05:14:33.405 INFO:teuthology.orchestra.run.smithi017.stdout:2773 writesame 0xcb1739f thru 0xcb24450 data_size 0x1(0xd0b2 bytes) 2024-09-18T05:14:33.422 INFO:teuthology.orchestra.run.smithi017.stdout:2774 write 0xeba07ab thru 0xeba3cbf (0x3515 bytes) 2024-09-18T05:14:33.428 INFO:teuthology.orchestra.run.smithi017.stdout:2775 write 0x46e7030 thru 0x46f266c (0xb63d bytes) 2024-09-18T05:14:33.437 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:33.430+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:33.446 INFO:teuthology.orchestra.run.smithi017.stdout:2780 trunc from 0xeba3cc0 to 0xbbec223 2024-09-18T05:14:33.471 INFO:teuthology.orchestra.run.smithi017.stdout:2781 writesame 0x25cd553 thru 0x25d4a7a data_size 0x4(0x7528 bytes) 2024-09-18T05:14:33.472 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:33.472 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:33.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:33.496 INFO:teuthology.orchestra.run.smithi017.stdout:2782 writesame 0xc4141a9 thru 0xc4239cc data_size 0x2(0xf824 bytes) 2024-09-18T05:14:33.496 INFO:teuthology.orchestra.run.smithi017.stdout:2783 punch from 0x8f57a6f to 0x8f67899, (0xfe2a bytes) 2024-09-18T05:14:33.496 INFO:teuthology.orchestra.run.smithi017.stdout:2784 read 0xf0f834 thru 0xf0fb70 (0x33d bytes) 2024-09-18T05:14:33.517 INFO:teuthology.orchestra.run.smithi017.stdout:2788 writesame 0xe90d5d5 thru 0xe90e23f data_size 0xb(0xc6b bytes) 2024-09-18T05:14:33.517 INFO:teuthology.orchestra.run.smithi017.stdout:2791 read 0xe8292f5 thru 0xe82fcbc (0x69c8 bytes) 2024-09-18T05:14:33.517 INFO:teuthology.orchestra.run.smithi017.stdout:2792 write 0x6a4c692 thru 0x6a53228 (0x6b97 bytes) 2024-09-18T05:14:33.525 INFO:teuthology.orchestra.run.smithi017.stdout:2793 writesame 0x8958fe7 thru 0x8962f78 data_size 0x32(0x9f92 bytes) 2024-09-18T05:14:33.532 INFO:teuthology.orchestra.run.smithi017.stdout:2794 write 0x7db6787 thru 0x7dc1815 (0xb08f bytes) 2024-09-18T05:14:33.537 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:33.533+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:2795 write 0x69edfee thru 0x69fdd54 (0xfd67 bytes) 2024-09-18T05:14:33.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:33.559 INFO:teuthology.orchestra.run.smithi017.stdout:2796 trunc from 0xe90e240 to 0xb9316e5 2024-09-18T05:14:33.574 INFO:teuthology.orchestra.run.smithi017.stdout:2797 punch from 0x371db4c to 0x372bc17, (0xe0cb bytes) 2024-09-18T05:14:33.575 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.596 INFO:teuthology.orchestra.run.smithi017.stdout:2800 trunc from 0xb9316e5 to 0xdade8c 2024-09-18T05:14:33.619 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:33.620 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:33.638 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:33.633+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:33.640 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:33.660 INFO:teuthology.orchestra.run.smithi017.stdout:2801 read 0xb4a24e thru 0xb4e16a (0x3f1d bytes) 2024-09-18T05:14:33.672 INFO:teuthology.orchestra.run.smithi017.stdout:2802 writesame 0x2d9d09e thru 0x2da83e7 data_size 0x35(0xb34a bytes) 2024-09-18T05:14:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:2804 trunc from 0x2da83e8 to 0xd7f9713 2024-09-18T05:14:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:2807 read 0x859d0ba thru 0x85a9f85 (0xcecc bytes) 2024-09-18T05:14:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:2808 write 0x4de119 thru 0x4e9396 (0xb27e bytes) 2024-09-18T05:14:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:2811 write 0x5b72aaa thru 0x5b7bd9e (0x92f5 bytes) 2024-09-18T05:14:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:2812 read 0x27378a3 thru 0x273e032 (0x6790 bytes) 2024-09-18T05:14:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:2818 trunc from 0xd7f9713 to 0x5a6387f 2024-09-18T05:14:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:2819 write 0x314442a thru 0x314fe63 (0xba3a bytes) 2024-09-18T05:14:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:33.738 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:33.734+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:2820 read 0x40b3a4d thru 0x40bce72 (0x9426 bytes) 2024-09-18T05:14:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:33.756 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:2821 write 0xebb01c0 thru 0xebb095a (0x79b bytes) 2024-09-18T05:14:33.771 INFO:teuthology.orchestra.run.smithi017.stdout:2822 trunc from 0xebb095b to 0xc2dc067 2024-09-18T05:14:33.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:33.774 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:33.788 INFO:teuthology.orchestra.run.smithi017.stdout:2823 trunc from 0xc2dc067 to 0x9fbcf84 2024-09-18T05:14:33.794 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:33.795 INFO:teuthology.orchestra.run.smithi017.stdout:2825 punch from 0x68dfd2c to 0x68eac8b, (0xaf5f bytes) 2024-09-18T05:14:33.795 INFO:teuthology.orchestra.run.smithi017.stdout:2826 write 0x4c6ca99 thru 0x4c75a97 (0x8fff bytes) 2024-09-18T05:14:33.803 INFO:teuthology.orchestra.run.smithi017.stdout:2827 read 0x64b6b7f thru 0x64b7328 (0x7aa bytes) 2024-09-18T05:14:33.803 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.803 INFO:teuthology.orchestra.run.smithi017.stdout:2829 read 0x93b16a2 thru 0x93beea5 (0xd804 bytes) 2024-09-18T05:14:33.803 INFO:teuthology.orchestra.run.smithi017.stdout:2831 write 0x37fc74d thru 0x380c3fa (0xfcae bytes) 2024-09-18T05:14:33.809 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:33.809 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:33.813 INFO:teuthology.orchestra.run.smithi017.stdout:2832 write 0x711a1f6 thru 0x711e9d2 (0x47dd bytes) 2024-09-18T05:14:33.814 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:33.814 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:33.816 INFO:teuthology.orchestra.run.smithi017.stdout:2834 read 0x23572a8 thru 0x236221d (0xaf76 bytes) 2024-09-18T05:14:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:2836 read 0x70e62c thru 0x714808 (0x61dd bytes) 2024-09-18T05:14:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:2838 writesame 0x2ab1abc thru 0x2ab80db data_size 0x2b(0x6620 bytes) 2024-09-18T05:14:33.819 INFO:teuthology.orchestra.run.smithi017.stdout:2840 write 0x1b4b51c thru 0x1b50957 (0x543c bytes) 2024-09-18T05:14:33.824 INFO:teuthology.orchestra.run.smithi017.stdout:2843 write 0x6e4ca7d thru 0x6e5c526 (0xfaaa bytes) 2024-09-18T05:14:33.827 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:33.834 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:33.834 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:33.835 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-18T05:14:33.836 INFO:teuthology.orchestra.run.smithi017.stdout:2845 trunc from 0x9fbcf84 to 0xc4f3ff8 2024-09-18T05:14:33.842 INFO:teuthology.orchestra.run.smithi017.stdout:2846 punch from 0xa6f0be6 to 0xa6fd182, (0xc59c bytes) 2024-09-18T05:14:33.848 INFO:teuthology.orchestra.run.smithi017.stdout:2847 trunc from 0xc4f3ff8 to 0x87f9c26 2024-09-18T05:14:33.854 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:33.855 INFO:teuthology.orchestra.run.smithi017.stdout:2848 punch from 0x45af213 to 0x45ba778, (0xb565 bytes) 2024-09-18T05:14:33.855 INFO:teuthology.orchestra.run.smithi017.stdout:2849 write 0x44d616c thru 0x44e065a (0xa4ef bytes) 2024-09-18T05:14:33.858 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:14:33.859 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:14:33.871 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:33.869+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:33.872 INFO:teuthology.orchestra.run.smithi017.stdout:2850 write 0xb56a19b thru 0xb577c0a (0xda70 bytes) 2024-09-18T05:14:33.877 INFO:teuthology.orchestra.run.smithi017.stdout:2851 trunc from 0xb577c0b to 0xbc694f4 2024-09-18T05:14:33.883 INFO:teuthology.orchestra.run.smithi017.stdout:2852 write 0x128106f thru 0x12846bc (0x364e bytes) 2024-09-18T05:14:33.885 INFO:teuthology.orchestra.run.smithi017.stdout:2853 read 0x2e6bcf6 thru 0x2e6d325 (0x1630 bytes) 2024-09-18T05:14:33.897 INFO:teuthology.orchestra.run.smithi017.stdout:2855 writesame 0xe7110d2 thru 0xe7150cb data_size 0x13(0x3ffa bytes) 2024-09-18T05:14:33.897 INFO:teuthology.orchestra.run.smithi017.stdout:2857 read 0xaf1f878 thru 0xaf1fb51 (0x2da bytes) 2024-09-18T05:14:33.897 INFO:teuthology.orchestra.run.smithi017.stdout:2858 read 0x8e874e5 thru 0x8e8c5b5 (0x50d1 bytes) 2024-09-18T05:14:33.897 INFO:teuthology.orchestra.run.smithi017.stdout:2860 write 0x7329fbc thru 0x733210e (0x8153 bytes) 2024-09-18T05:14:33.901 INFO:teuthology.orchestra.run.smithi017.stdout:2861 punch from 0xe2f08d6 to 0xe2f67e4, (0x5f0e bytes) 2024-09-18T05:14:33.901 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.901 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.901 INFO:teuthology.orchestra.run.smithi017.stdout:2864 read 0xbc2ff5c thru 0xbc32af4 (0x2b99 bytes) 2024-09-18T05:14:33.909 INFO:teuthology.orchestra.run.smithi017.stdout:2865 trunc from 0xe7150cc to 0x9d141ed 2024-09-18T05:14:33.921 INFO:teuthology.orchestra.run.smithi017.stdout:2866 read 0x53f4f7 thru 0x54448e (0x4f98 bytes) 2024-09-18T05:14:33.921 INFO:teuthology.orchestra.run.smithi017.stdout:2868 read 0x4942a4d thru 0x4944818 (0x1dcc bytes) 2024-09-18T05:14:33.922 INFO:teuthology.orchestra.run.smithi017.stdout:2869 write 0x17c7c0d thru 0x17cdad7 (0x5ecb bytes) 2024-09-18T05:14:33.923 INFO:teuthology.orchestra.run.smithi017.stdout:2871 read 0x4406138 thru 0x440a7ae (0x4677 bytes) 2024-09-18T05:14:33.923 INFO:teuthology.orchestra.run.smithi017.stdout:2872 writesame 0x1ce2358 thru 0x1ce5fe9 data_size 0x1(0x3c92 bytes) 2024-09-18T05:14:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:2873 read 0x6303256 thru 0x630af57 (0x7d02 bytes) 2024-09-18T05:14:33.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:33.934+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:33.943 INFO:teuthology.orchestra.run.smithi017.stdout:2874 write 0xc9ee2c0 thru 0xc9f2e88 (0x4bc9 bytes) 2024-09-18T05:14:33.948 INFO:teuthology.orchestra.run.smithi017.stdout:2876 writesame 0x1fcd0a7 thru 0x1fd4a17 data_size 0x2b(0x7971 bytes) 2024-09-18T05:14:33.955 INFO:teuthology.orchestra.run.smithi017.stdout:2877 read 0x93301ca thru 0x933fb4f (0xf986 bytes) 2024-09-18T05:14:33.955 INFO:teuthology.orchestra.run.smithi017.stdout:2878 writesame 0x183fbfb thru 0x184b8c8 data_size 0x8f(0xbcce bytes) 2024-09-18T05:14:33.960 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:33.960 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:33.960 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:33.960 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:33.960 INFO:teuthology.orchestra.run.smithi017.stdout:2879 read 0xc4b26f3 thru 0xc4bbfb5 (0x98c3 bytes) 2024-09-18T05:14:33.961 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:33.961 INFO:teuthology.orchestra.run.smithi017.stdout:2881 read 0xadfb476 thru 0xae02b1b (0x76a6 bytes) 2024-09-18T05:14:33.961 INFO:teuthology.orchestra.run.smithi017.stdout:2882 write 0xc854d84 thru 0xc85e5c6 (0x9843 bytes) 2024-09-18T05:14:33.967 INFO:teuthology.orchestra.run.smithi017.stdout:2883 clone 22 order 23 su 524288 sc 2 2024-09-18T05:14:33.974 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:34.059 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:34.057+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:34.141 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:34.141 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:34.143 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:34.137+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:34.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:34.247 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:34.245+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:34.294 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone21 from 0xc9f2e89 (overlap 0xdade8c) to 0x41a92a 2024-09-18T05:14:34.333 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:34.333 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:34.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:34.333 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:34.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.333 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668700317000001, 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668633399000001, 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.338 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668544889, 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:14:34.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:14:34.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:14:34.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:14:34.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:14:34.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668494333, 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.348 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668431218, 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.353 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:14:34.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:14:34.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:14:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:14:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:14:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668384297999999, 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:14:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:14:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668330419, 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:14:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:14:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:14:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:14:34.369 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668283285999999, 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:14:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:14:34.373 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668235664000001, 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.374 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:14:34.378 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668112842999999, 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:14:34.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:14:34.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.668031513000001, 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.383 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:14:34.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:14:34.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.66796027, 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:14:34.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.389 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:14:34.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:14:34.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.667910059, 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.393 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:14:34.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:14:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:14:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:14:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:14:34.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:14:34.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:14:34.398 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.398 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.398 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.667832864999999, 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.399 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:14:34.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:14:34.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:14:34.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:14:34.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.667782995, 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.404 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:14:34.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.408 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.667708424000001, 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.667642646000001, 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:14:34.413 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:14:34.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.667595609999999, 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.418 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:14:34.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.422 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.667533517000001, 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:14:34.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.667487138, 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.427 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:14:34.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:14:34.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.431 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:34.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:34.434 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:34.429+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:34.534 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:34.529+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:34.593 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-18T05:14:34.593 INFO:tasks.thrashosds.thrasher:Reviving osd 6 2024-09-18T05:14:34.593 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-18T05:14:34.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-18T05:14:34.596 INFO:tasks.ceph.osd.6:Started 2024-09-18T05:14:34.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:34.613 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:34.613 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:34.613 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:34.613 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:34.629 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:34.671 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:34.669+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:no valid command found; 10 closest matches: 2024-09-18T05:14:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:0 2024-09-18T05:14:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:1 2024-09-18T05:14:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:2 2024-09-18T05:14:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:abort 2024-09-18T05:14:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:assert 2024-09-18T05:14:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:config diff 2024-09-18T05:14:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:config diff get 2024-09-18T05:14:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:config get 2024-09-18T05:14:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:config help [] 2024-09-18T05:14:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:config set ... 2024-09-18T05:14:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:admin_socket: invalid command 2024-09-18T05:14:34.707 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T05:14:34.707 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-6, ['dump_ops_in_flight'] 2024-09-18T05:14:34.756 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:34.753+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:34.787 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:34.788 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:34.788 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:34.788 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:34.788 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:34.801 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:34.837 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:34.830+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:34.895 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-18T05:14:34.938 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:34.934+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:34.974 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:34.974 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:34.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:34.974 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:34.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:27144 3.e 3:72e631ab:::rbd_data.118b9f2c0487.000000000000003c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.507979678000002, 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053442387000000001, 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 27144 2024-09-18T05:14:34.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.976 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:14:34.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:14:34.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462530+0000", 2024-09-18T05:14:34.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999957 2024-09-18T05:14:34.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462560+0000", 2024-09-18T05:14:34.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9933e-05 2024-09-18T05:14:34.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462596+0000", 2024-09-18T05:14:34.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5936000000000003e-05 2024-09-18T05:14:34.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462621+0000", 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4644e-05 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462748+0000", 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126892 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:34.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.463025+0000", 2024-09-18T05:14:34.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027756100000000001 2024-09-18T05:14:34.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:34.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.471585+0000", 2024-09-18T05:14:34.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085600780000000005 2024-09-18T05:14:34.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:34.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515712+0000", 2024-09-18T05:14:34.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.044127 2024-09-18T05:14:34.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:34.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515824+0000", 2024-09-18T05:14:34.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112002 2024-09-18T05:14:34.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:34.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515915+0000", 2024-09-18T05:14:34.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0105999999999994e-05 2024-09-18T05:14:34.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515977+0000", 2024-09-18T05:14:34.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2521999999999995e-05 2024-09-18T05:14:34.983 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.983 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.983 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36312 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.161954101999999, 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050924795000000002, 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36312 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:34.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:34.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:34.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808562+0000", 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.522e-06 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808566+0000", 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0459999999999999e-06 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808569+0000", 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1580000000000001e-06 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859475+0000", 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050906734000000002 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859485+0000", 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6029999999999994e-06 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36313 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.161942943, 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050958802999999997, 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:34.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36313 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808573+0000", 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4720000000000001e-06 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808577+0000", 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9899999999999999e-06 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808581+0000", 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.301e-06 2024-09-18T05:14:34.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859521+0000", 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939971000000001 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859530+0000", 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3309999999999993e-06 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36314 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.161930761000001, 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050974481000000002, 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36314 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808583+0000", 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:34.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808585+0000", 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839999999999999e-06 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808589+0000", 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0149999999999997e-06 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808592+0000", 2024-09-18T05:14:34.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2100000000000002e-06 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859552+0000", 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050959971999999999 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859558+0000", 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0809999999999999e-06 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:34.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37032 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 366592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023414430000001, 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050948475, 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37032 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:34.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947099+0000", 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947102+0000", 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3140000000000002e-06 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947107+0000", 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947112+0000", 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6500000000000004e-06 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997959+0000", 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050847106000000003 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997999+0000", 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0049000000000002e-05 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998048+0000", 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9211e-05 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37033 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 376832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:14:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023387641999999, 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051119236999999998, 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37033 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947126+0000", 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947129+0000", 2024-09-18T05:14:35.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5469999999999999e-06 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947135+0000", 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5069999999999997e-06 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947140+0000", 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7350000000000004e-06 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998080+0000", 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939401000000002 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998158+0000", 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8753999999999998e-05 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998246+0000", 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7682999999999994e-05 2024-09-18T05:14:35.006 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37034 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 387072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023370419999999, 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05121883, 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.007 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.008 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.008 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37034 2024-09-18T05:14:35.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.008 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:35.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947146+0000", 2024-09-18T05:14:35.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.12e-06 2024-09-18T05:14:35.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947152+0000", 2024-09-18T05:14:35.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8560000000000003e-06 2024-09-18T05:14:35.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947156+0000", 2024-09-18T05:14:35.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5970000000000002e-06 2024-09-18T05:14:35.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998271+0000", 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051114764 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998312+0000", 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1258999999999999e-05 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998363+0000", 2024-09-18T05:14:35.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0581999999999998e-05 2024-09-18T05:14:35.013 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.013 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.013 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.013 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37035 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.013 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:35.014 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.02335405, 2024-09-18T05:14:35.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051399043999999998, 2024-09-18T05:14:35.014 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.014 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.014 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.014 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.014 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.015 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37035 2024-09-18T05:14:35.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.015 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:35.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947162+0000", 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1619999999999998e-06 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947168+0000", 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7640000000000002e-06 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947172+0000", 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4750000000000004e-06 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998394+0000", 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051222202000000001 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998472+0000", 2024-09-18T05:14:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7228e-05 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998559+0000", 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7699000000000002e-05 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37036 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 407552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023338483, 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051565297000000003, 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37036 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947178+0000", 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0169999999999999e-06 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947183+0000", 2024-09-18T05:14:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947188+0000", 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998583+0000", 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051394678999999999 2024-09-18T05:14:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998661+0000", 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8631e-05 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998741+0000", 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0054000000000003e-05 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37037 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 417792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023322286000001, 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051746031999999997, 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37037 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947194+0000", 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1100000000000001e-06 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947200+0000", 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2530000000000001e-06 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947205+0000", 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8319999999999996e-06 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998775+0000", 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051569934999999997 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998850+0000", 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4783999999999994e-05 2024-09-18T05:14:35.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998938+0000", 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8442999999999993e-05 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37038 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023304722000001, 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851468999999997, 2024-09-18T05:14:35.029 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37038 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947209+0000", 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947212+0000", 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947218+0000", 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2319999999999998e-06 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947223+0000", 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8590000000000004e-06 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998966+0000", 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051743193999999999 2024-09-18T05:14:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999009+0000", 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999997e-05 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999061+0000", 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2216999999999998e-05 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37039 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023287578, 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052037513000000001, 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37039 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947226+0000", 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947229+0000", 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.198e-06 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947235+0000", 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.319e-06 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947240+0000", 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7260000000000002e-06 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999092+0000", 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851928999999998 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999162+0000", 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0115000000000002e-05 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999264+0000", 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010256599999999999 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37040 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 448512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023268807999999, 2024-09-18T05:14:35.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052135867000000002, 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37040 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947245+0000", 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947248+0000", 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4439999999999998e-06 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947256+0000", 2024-09-18T05:14:35.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9410000000000007e-06 2024-09-18T05:14:35.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947260+0000", 2024-09-18T05:14:35.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:14:35.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999286+0000", 2024-09-18T05:14:35.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052025350999999997 2024-09-18T05:14:35.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999330+0000", 2024-09-18T05:14:35.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4226e-05 2024-09-18T05:14:35.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999381+0000", 2024-09-18T05:14:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1529000000000001e-05 2024-09-18T05:14:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37041 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 458752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:35.047 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023249513, 2024-09-18T05:14:35.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052321965999999998, 2024-09-18T05:14:35.047 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.047 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37041 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947275+0000", 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0175e-05 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947283+0000", 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8660000000000006e-06 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947287+0000", 2024-09-18T05:14:35.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6369999999999998e-06 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999414+0000", 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052126541999999998 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999494+0000", 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:14:35.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999587+0000", 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2795999999999997e-05 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.052 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37042 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023222684, 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052411412999999997, 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37042 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947291+0000", 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947294+0000", 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4559999999999999e-06 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947300+0000", 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5189999999999998e-06 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947305+0000", 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9049999999999996e-06 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999614+0000", 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052308353000000002 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999653+0000", 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9879000000000002e-05 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999703+0000", 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9710999999999999e-05 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37043 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 479232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023200734, 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052588113999999998, 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.057 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37043 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947313+0000", 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947316+0000", 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4059999999999999e-06 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947322+0000", 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2999999999999998e-06 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947327+0000", 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7119999999999999e-06 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999735+0000", 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052408145000000003 2024-09-18T05:14:35.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999812+0000", 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7540999999999995e-05 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999902+0000", 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9413000000000006e-05 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37044 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 489472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023183546, 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052688817999999998, 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37044 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947333+0000", 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.396e-06 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947339+0000", 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947344+0000", 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9359999999999998e-06 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999929+0000", 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052584371999999997 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999969+0000", 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0315000000000003e-05 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000020+0000", 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0807000000000003e-05 2024-09-18T05:14:35.065 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37045 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 499712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023165736999999, 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052875286000000001, 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.066 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37045 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947348+0000", 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947351+0000", 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3130000000000001e-06 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947357+0000", 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2040000000000002e-06 2024-09-18T05:14:35.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947362+0000", 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9269999999999996e-06 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000054+0000", 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052691799999999997 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000133+0000", 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9134999999999994e-05 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000224+0000", 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1315000000000002e-05 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37046 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023148383000001, 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052973012999999999, 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.072 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37046 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:35.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947368+0000", 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3190000000000002e-06 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947374+0000", 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1569999999999997e-06 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947379+0000", 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6949999999999999e-06 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000250+0000", 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052870752999999999 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000291+0000", 2024-09-18T05:14:35.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0975e-05 2024-09-18T05:14:35.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000339+0000", 2024-09-18T05:14:35.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8511999999999999e-05 2024-09-18T05:14:35.077 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37047 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.023131392, 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053159397999999997, 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:35.078 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:35.079 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:35.079 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:35.079 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.079 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37047 2024-09-18T05:14:35.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.079 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:35.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:35.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:35.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:35.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:35.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:35.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947385+0000", 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3070000000000001e-06 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947391+0000", 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947396+0000", 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.921e-06 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:35.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000373+0000", 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052976957999999998 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000451+0000", 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8250000000000005e-05 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000542+0000", 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1242999999999994e-05 2024-09-18T05:14:35.083 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.084 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.084 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.084 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:35.084 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:35.084 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:35.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:14:35.086 INFO:teuthology.orchestra.run.smithi017.stdout:2885 read 0x3bd0992 thru 0x3be0373 (0xf9e2 bytes) 2024-09-18T05:14:35.087 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:35.081+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:35.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:35.089 INFO:teuthology.orchestra.run.smithi017.stdout:2886 write 0xc5e20da thru 0xc5ed15a (0xb081 bytes) 2024-09-18T05:14:35.104 INFO:teuthology.orchestra.run.smithi017.stdout:2887 punch from 0xa63e3df to 0xa6472fa, (0x8f1b bytes) 2024-09-18T05:14:35.104 INFO:teuthology.orchestra.run.smithi017.stdout:2888 write 0x4f04429 thru 0x4f0e4e3 (0xa0bb bytes) 2024-09-18T05:14:35.120 INFO:teuthology.orchestra.run.smithi017.stdout:2889 write 0x2a72217 thru 0x2a811f6 (0xefe0 bytes) 2024-09-18T05:14:35.139 INFO:teuthology.orchestra.run.smithi017.stdout:2890 punch from 0x5ac3f77 to 0x5ad3766, (0xf7ef bytes) 2024-09-18T05:14:35.139 INFO:teuthology.orchestra.run.smithi017.stdout:2895 write 0x9664c4e thru 0x9671a41 (0xcdf4 bytes) 2024-09-18T05:14:35.145 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.145 INFO:teuthology.orchestra.run.smithi017.stdout:2898 read 0xbd2f584 thru 0xbd3af84 (0xba01 bytes) 2024-09-18T05:14:35.159 INFO:teuthology.orchestra.run.smithi017.stdout:2899 write 0xe793e49 thru 0xe795251 (0x1409 bytes) 2024-09-18T05:14:35.163 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.163 INFO:teuthology.orchestra.run.smithi017.stdout:2901 write 0xa2c9045 thru 0xa2d011c (0x70d8 bytes) 2024-09-18T05:14:35.168 INFO:teuthology.orchestra.run.smithi017.stdout:2902 write 0x539f183 thru 0x53a2774 (0x35f2 bytes) 2024-09-18T05:14:35.179 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.179 INFO:teuthology.orchestra.run.smithi017.stdout:2904 write 0x61d205f thru 0x61d9034 (0x6fd6 bytes) 2024-09-18T05:14:35.186 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:35.181+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:35.191 INFO:teuthology.orchestra.run.smithi017.stdout:2906 write 0x389eaa9 thru 0x38a3a22 (0x4f7a bytes) 2024-09-18T05:14:35.209 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:35.205+0000 7f0b256ca7c0 -1 Falling back to public interface 2024-09-18T05:14:35.213 INFO:teuthology.orchestra.run.smithi017.stdout:2908 punch from 0xd3c62c2 to 0xd3d4c75, (0xe9b3 bytes) 2024-09-18T05:14:35.231 INFO:teuthology.orchestra.run.smithi017.stdout:2909 trunc from 0xe795252 to 0x5ae5c3d 2024-09-18T05:14:35.234 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:35.234 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:35.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:35.264 INFO:teuthology.orchestra.run.smithi017.stdout:2910 write 0x811ae2f thru 0x8121f56 (0x7128 bytes) 2024-09-18T05:14:35.267 INFO:teuthology.orchestra.run.smithi017.stdout:2911 read 0x4908394 thru 0x4911133 (0x8da0 bytes) 2024-09-18T05:14:35.268 INFO:teuthology.orchestra.run.smithi017.stdout:2912 punch from 0x2fe30a8 to 0x2fe71f9, (0x4151 bytes) 2024-09-18T05:14:35.268 INFO:teuthology.orchestra.run.smithi017.stdout:2913 punch from 0x7d74a80 to 0x7d77f2d, (0x34ad bytes) 2024-09-18T05:14:35.279 INFO:teuthology.orchestra.run.smithi017.stdout:2914 write 0xa25c69b thru 0xa26755f (0xaec5 bytes) 2024-09-18T05:14:35.283 INFO:teuthology.orchestra.run.smithi017.stdout:2916 punch from 0x8e50177 to 0x8e5fad9, (0xf962 bytes) 2024-09-18T05:14:35.284 INFO:teuthology.orchestra.run.smithi017.stdout:2917 trunc from 0xa267560 to 0x9808ec6 2024-09-18T05:14:35.287 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:35.285+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:35.298 INFO:teuthology.orchestra.run.smithi017.stdout:2918 read 0x57bae48 thru 0x57c5447 (0xa600 bytes) 2024-09-18T05:14:35.299 INFO:teuthology.orchestra.run.smithi017.stdout:2919 punch from 0xd223be to 0xd2d4de, (0xb120 bytes) 2024-09-18T05:14:35.299 INFO:teuthology.orchestra.run.smithi017.stdout:2921 write 0x82ed677 thru 0x82fc992 (0xf31c bytes) 2024-09-18T05:14:35.303 INFO:teuthology.orchestra.run.smithi017.stdout:2923 read 0x2598cd6 thru 0x25a0a79 (0x7da4 bytes) 2024-09-18T05:14:35.305 INFO:teuthology.orchestra.run.smithi017.stdout:2924 punch from 0x95ff1e9 to 0x96069ad, (0x77c4 bytes) 2024-09-18T05:14:35.305 INFO:teuthology.orchestra.run.smithi017.stdout:2926 write 0x5ed9682 thru 0x5edf0fb (0x5a7a bytes) 2024-09-18T05:14:35.307 INFO:teuthology.orchestra.run.smithi017.stdout:2927 write 0x3ab78a5 thru 0x3ac31fd (0xb959 bytes) 2024-09-18T05:14:35.311 INFO:teuthology.orchestra.run.smithi017.stdout:2928 read 0x65445c7 thru 0x6553a65 (0xf49f bytes) 2024-09-18T05:14:35.311 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.312 INFO:teuthology.orchestra.run.smithi017.stdout:2930 read 0x54f6bd6 thru 0x54ff8d8 (0x8d03 bytes) 2024-09-18T05:14:35.318 INFO:teuthology.orchestra.run.smithi017.stdout:2931 trunc from 0x9808ec6 to 0xd20586b 2024-09-18T05:14:35.330 INFO:teuthology.orchestra.run.smithi017.stdout:2932 trunc from 0xd20586b to 0xcfcbf85 2024-09-18T05:14:35.339 INFO:teuthology.orchestra.run.smithi017.stdout:2933 writesame 0x446d1dc thru 0x44769b7 data_size 0x2(0x97dc bytes) 2024-09-18T05:14:35.351 INFO:teuthology.orchestra.run.smithi017.stdout:2934 writesame 0x840f16c thru 0x840fd1c data_size 0x1(0xbb1 bytes) 2024-09-18T05:14:35.354 INFO:teuthology.orchestra.run.smithi017.stdout:2937 write 0x98648a3 thru 0x98729ea (0xe148 bytes) 2024-09-18T05:14:35.360 INFO:teuthology.orchestra.run.smithi017.stdout:2938 write 0x257c18d thru 0x2580541 (0x43b5 bytes) 2024-09-18T05:14:35.364 INFO:teuthology.orchestra.run.smithi017.stdout:2939 read 0x4a2bb57 thru 0x4a3ad25 (0xf1cf bytes) 2024-09-18T05:14:35.365 INFO:teuthology.orchestra.run.smithi017.stdout:2942 write 0xaa073b7 thru 0xaa13573 (0xc1bd bytes) 2024-09-18T05:14:35.370 INFO:teuthology.orchestra.run.smithi017.stdout:2943 read 0x6e83ea6 thru 0x6e88c03 (0x4d5e bytes) 2024-09-18T05:14:35.370 INFO:teuthology.orchestra.run.smithi017.stdout:2944 punch from 0xc4b989c to 0xc4c1791, (0x7ef5 bytes) 2024-09-18T05:14:35.370 INFO:teuthology.orchestra.run.smithi017.stdout:2945 write 0x938d41 thru 0x93ea4f (0x5d0f bytes) 2024-09-18T05:14:35.388 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:35.385+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:35.393 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:35.393 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:35.393 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:35.394 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:35.394 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:35.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:35.418 INFO:teuthology.orchestra.run.smithi017.stdout:2946 writesame 0x1d3abb5 thru 0x1d45be8 data_size 0x2a(0xb034 bytes) 2024-09-18T05:14:35.459 INFO:teuthology.orchestra.run.smithi017.stdout:2948 trunc from 0xcfcbf85 to 0x50ffa0a 2024-09-18T05:14:35.478 INFO:teuthology.orchestra.run.smithi017.stdout:2949 write 0x34a3799 thru 0x34acd86 (0x95ee bytes) 2024-09-18T05:14:35.489 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:35.485+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:35.495 INFO:teuthology.orchestra.run.smithi017.stdout:2951 writesame 0x6fd52bb thru 0x6fe06d8 data_size 0x1e(0xb41e bytes) 2024-09-18T05:14:35.495 INFO:teuthology.orchestra.run.smithi017.stdout:2952 writesame 0x578975d thru 0x578bc1a data_size 0x1(0x24be bytes) 2024-09-18T05:14:35.507 INFO:teuthology.orchestra.run.smithi017.stdout:2954 writesame 0x17b4c89 thru 0x17b7cfd data_size 0x5(0x3075 bytes) 2024-09-18T05:14:35.528 INFO:teuthology.orchestra.run.smithi017.stdout:2955 write 0x15b09ad thru 0x15bd223 (0xc877 bytes) 2024-09-18T05:14:35.530 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.530 INFO:teuthology.orchestra.run.smithi017.stdout:2957 writesame 0x65aa914 thru 0x65b6679 data_size 0x3(0xbd66 bytes) 2024-09-18T05:14:35.559 INFO:teuthology.orchestra.run.smithi017.stdout:2958 writesame 0x7c0b2b0 thru 0x7c18989 data_size 0x59(0xd6da bytes) 2024-09-18T05:14:35.559 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.571 INFO:teuthology.orchestra.run.smithi017.stdout:2962 trunc from 0x7c1898a to 0xeefa0c 2024-09-18T05:14:35.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:35.582+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:35.603 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16825 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1474560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.378937899999997, 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026210823000000001, 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16825 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219597+0000", 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219596+0000", 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219602+0000", 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999999e-06 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219620+0000", 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7920000000000001e-05 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219633+0000", 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3113e-05 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245513+0000", 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025879669000000001 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245662+0000", 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149009 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245807+0000", 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145589 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16826 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.378888543999999, 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026570620999999999, 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16826 2024-09-18T05:14:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219646+0000", 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219645+0000", 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219652+0000", 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4570000000000002e-06 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219670+0000", 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8295999999999999e-05 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.219704+0000", 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4536000000000003e-05 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.245864+0000", 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026159953 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246030+0000", 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016550899999999999 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.246217+0000", 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018675300000000001 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16885 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2752512~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.377139810999999, 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026057257, 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16885 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221395+0000", 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221394+0000", 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221400+0000", 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.533e-06 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221418+0000", 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8029999999999998e-05 2024-09-18T05:14:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221432+0000", 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3453e-05 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247088+0000", 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025655971999999999 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247255+0000", 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167066 2024-09-18T05:14:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247452+0000", 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019720600000000001 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16886 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.377091030999999, 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026360268999999999, 2024-09-18T05:14:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16886 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221443+0000", 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221442+0000", 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221455+0000", 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2116000000000001e-05 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221472+0000", 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.787e-05 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221486+0000", 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3573e-05 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247512+0000", 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026025942999999999 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247647+0000", 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000134859 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247804+0000", 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015688099999999999 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16887 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.377036271999998, 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026704731999999998, 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16887 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221498+0000", 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221497+0000", 2024-09-18T05:14:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221503+0000", 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2700000000000001e-06 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221522+0000", 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221535+0000", 2024-09-18T05:14:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3556e-05 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.247862+0000", 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026326385000000001 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248014+0000", 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152168 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248203+0000", 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000189276 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16888 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.376986244999998, 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027263773000000002, 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16888 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221548+0000", 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221547+0000", 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221554+0000", 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1430000000000001e-06 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221572+0000", 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7609999999999999e-05 2024-09-18T05:14:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221585+0000", 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2639999999999999e-05 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248308+0000", 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026723558000000001 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248546+0000", 2024-09-18T05:14:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000237741 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248812+0000", 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026612100000000002 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16889 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.376937935000001, 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027689516000000001, 2024-09-18T05:14:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16889 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221597+0000", 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221595+0000", 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221602+0000", 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0169999999999999e-06 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221621+0000", 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8386e-05 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221634+0000", 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.341e-05 2024-09-18T05:14:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.248882+0000", 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027247771 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249066+0000", 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018403000000000001 2024-09-18T05:14:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249286+0000", 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219986 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16890 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.376888889999996, 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028101418999999999, 2024-09-18T05:14:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16890 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221646+0000", 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221645+0000", 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221650+0000", 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7939999999999999e-06 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221667+0000", 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6616000000000002e-05 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.221680+0000", 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2663999999999999e-05 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249351+0000", 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027670808000000002 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249539+0000", 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000188505 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249747+0000", 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020795199999999999 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16947 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2654208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.375710198999997, 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027363044999999999, 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16947 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222824+0000", 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222822+0000", 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222856+0000", 2024-09-18T05:14:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316999999999997e-05 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222891+0000", 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4273000000000002e-05 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222914+0000", 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3119e-05 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249808+0000", 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026894668 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.249979+0000", 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017036699999999999 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250187+0000", 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020850400000000001 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16948 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.375600452999997, 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027712835000000002, 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16948 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222934+0000", 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222933+0000", 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222941+0000", 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2330000000000006e-06 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222961+0000", 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9933999999999999e-05 2024-09-18T05:14:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222976+0000", 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5486e-05 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250249+0000", 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027272951 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250424+0000", 2024-09-18T05:14:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017490999999999999 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250647+0000", 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000222761 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16949 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.375545219999999, 2024-09-18T05:14:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028222578000000002, 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16949 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222989+0000", 2024-09-18T05:14:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222988+0000", 2024-09-18T05:14:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.222995+0000", 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7059999999999998e-06 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223013+0000", 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8267e-05 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223027+0000", 2024-09-18T05:14:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3852999999999999e-05 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250733+0000", 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027705456 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.250935+0000", 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020255800000000001 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251212+0000", 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027678400000000003 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16950 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.375494879999998, 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028659265999999999, 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16950 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223040+0000", 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223039+0000", 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223045+0000", 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1500000000000004e-06 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223062+0000", 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223076+0000", 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3495999999999999e-05 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251277+0000", 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028201066 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251460+0000", 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018261199999999999 2024-09-18T05:14:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251699+0000", 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000239359 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16951 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.375446486999998, 2024-09-18T05:14:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029073671999999998, 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16951 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223088+0000", 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223087+0000", 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223093+0000", 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.003e-06 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223110+0000", 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7024000000000002e-05 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223124+0000", 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3682999999999999e-05 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251760+0000", 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028636582000000001 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.251957+0000", 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019702399999999999 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252162+0000", 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020431299999999999 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16952 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.375396803999998, 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029652123999999998, 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16952 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223138+0000", 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223136+0000", 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223143+0000", 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9600000000000003e-06 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223160+0000", 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.721e-05 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223173+0000", 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2486e-05 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252238+0000", 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029065160999999999 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252459+0000", 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022082100000000001 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252790+0000", 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033094299999999999 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16953 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.375350740999998, 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030055742999999999, 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16953 2024-09-18T05:14:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223184+0000", 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223183+0000", 2024-09-18T05:14:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223188+0000", 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223205+0000", 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6359999999999999e-05 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223217+0000", 2024-09-18T05:14:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2296000000000001e-05 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.252853+0000", 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.029636077 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253035+0000", 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018143900000000001 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253239+0000", 2024-09-18T05:14:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000204878 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:16954 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.375307565, 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030518435, 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 16954 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223227+0000", 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223226+0000", 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223231+0000", 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9529999999999998e-06 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223249+0000", 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7754e-05 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.223261+0000", 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.198e-05 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253312+0000", 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.030051123999999999 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253507+0000", 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019456700000000001 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.253745+0000", 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023878699999999999 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17135 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.368857478000002, 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026407401, 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17135 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229677+0000", 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229676+0000", 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229683+0000", 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0400000000000004e-06 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229701+0000", 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8182999999999999e-05 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229714+0000", 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3193000000000001e-05 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255689+0000", 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.025974962000000001 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.255873+0000", 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018339300000000001 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256084+0000", 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021176999999999999 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17136 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.368809182, 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026860747000000001, 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17136 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229725+0000", 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229724+0000", 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229730+0000", 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6629999999999998e-06 2024-09-18T05:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229746+0000", 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6293000000000001e-05 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229759+0000", 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2747e-05 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256148+0000", 2024-09-18T05:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026389072999999999 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256345+0000", 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019683799999999999 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256586+0000", 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024106999999999999 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17137 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.368764712999997, 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027322796999999999, 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17137 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229770+0000", 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229769+0000", 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229775+0000", 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6169999999999998e-06 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229791+0000", 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6126000000000001e-05 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229804+0000", 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2917e-05 2024-09-18T05:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256654+0000", 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026850816 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.256857+0000", 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020282399999999999 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257093+0000", 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023535 2024-09-18T05:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17138 3.17 3:ee931992:::rbd_data.118bd6f23a9d.0000000000000002:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.368718868999999, 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027760476999999999, 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17138 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229816+0000", 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229815+0000", 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229820+0000", 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7729999999999996e-06 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229838+0000", 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7113e-05 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229850+0000", 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2320000000000001e-05 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257154+0000", 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027304357000000001 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257348+0000", 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000193322 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.257576+0000", 2024-09-18T05:14:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000228569 2024-09-18T05:14:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:35.690 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:35.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:35.692 INFO:teuthology.orchestra.run.smithi017.stdout:2963 write 0x8ee6e35 thru 0x8eecfd8 (0x61a4 bytes) 2024-09-18T05:14:35.692 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:35.686+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:35.697 INFO:teuthology.orchestra.run.smithi017.stdout:2964 write 0xd5ccc1e thru 0xd5ce1d7 (0x15ba bytes) 2024-09-18T05:14:35.706 INFO:teuthology.orchestra.run.smithi017.stdout:2965 read 0xd16c31d thru 0xd16c6e9 (0x3cd bytes) 2024-09-18T05:14:35.706 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.706 INFO:teuthology.orchestra.run.smithi017.stdout:2967 write 0x75840f5 thru 0x75918fa (0xd806 bytes) 2024-09-18T05:14:35.712 INFO:teuthology.orchestra.run.smithi017.stdout:2969 writesame 0x540771c thru 0x5413140 data_size 0x1(0xba25 bytes) 2024-09-18T05:14:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:2971 punch from 0xd6c138 to 0xd74c52, (0x8b1a bytes) 2024-09-18T05:14:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:2972 read 0x22e1596 thru 0x22f1229 (0xfc94 bytes) 2024-09-18T05:14:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:2973 read 0x8e188a7 thru 0x8e210e7 (0x8841 bytes) 2024-09-18T05:14:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:2975 punch from 0x774b3e1 to 0x7757534, (0xc153 bytes) 2024-09-18T05:14:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:2977 read 0xae784f9 thru 0xae7ae3b (0x2943 bytes) 2024-09-18T05:14:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:2980 write 0x445f85e thru 0x4461130 (0x18d3 bytes) 2024-09-18T05:14:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:2981 write 0x58d8f51 thru 0x58e823a (0xf2ea bytes) 2024-09-18T05:14:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:2982 writesame 0x89c45cc thru 0x89cfc7a data_size 0x33(0xb6af bytes) 2024-09-18T05:14:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:2983 writesame 0xf13b7f thru 0xf17a79 data_size 0x1(0x3efb bytes) 2024-09-18T05:14:35.792 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:35.789+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:2984 trunc from 0xd5ce1d8 to 0x38dbab9 2024-09-18T05:14:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:35.833 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:35.833 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:2985 read 0x11afec6 thru 0x11b1b7f (0x1cba bytes) 2024-09-18T05:14:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:2989 writesame 0x1f606d7 thru 0x1f63fa4 data_size 0xb(0x38ce bytes) 2024-09-18T05:14:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:2990 punch from 0x18b3e69 to 0x18bbee3, (0x807a bytes) 2024-09-18T05:14:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:2993 trunc from 0x38dbab9 to 0x120f065 2024-09-18T05:14:35.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:35.860 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:2994 read 0x10f5e59 thru 0x10f858c (0x2734 bytes) 2024-09-18T05:14:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:2996 read 0x4e0dda thru 0x4e7d90 (0x6fb7 bytes) 2024-09-18T05:14:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:2997 read 0x11b7916 thru 0x11c6fad (0xf698 bytes) 2024-09-18T05:14:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:2999 read 0xb8197d thru 0xb90c62 (0xf2e6 bytes) 2024-09-18T05:14:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:3001 writesame 0x3ad19c1 thru 0x3ad5c26 data_size 0x3(0x4266 bytes) 2024-09-18T05:14:35.893 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:35.889+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:35.911 INFO:teuthology.orchestra.run.smithi017.stdout:3002 write 0xe3cee27 thru 0xe3d8ab3 (0x9c8d bytes) 2024-09-18T05:14:35.914 INFO:teuthology.orchestra.run.smithi017.stdout:3005 read 0xdf31cb7 thru 0xdf3bbfe (0x9f48 bytes) 2024-09-18T05:14:35.925 INFO:teuthology.orchestra.run.smithi017.stdout:3006 write 0xea4e57d thru 0xea57fa9 (0x9a2d bytes) 2024-09-18T05:14:35.930 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:35.931 INFO:teuthology.orchestra.run.smithi017.stdout:3008 write 0xcbf4f39 thru 0xcbf85a6 (0x366e bytes) 2024-09-18T05:14:35.936 INFO:teuthology.orchestra.run.smithi017.stdout:3009 read 0x271092d thru 0x2717d0f (0x73e3 bytes) 2024-09-18T05:14:35.936 INFO:teuthology.orchestra.run.smithi017.stdout:3010 write 0x27b3f1a thru 0x27ba839 (0x6920 bytes) 2024-09-18T05:14:35.941 INFO:teuthology.orchestra.run.smithi017.stdout:3011 read 0x32de5c8 thru 0x32e6d01 (0x873a bytes) 2024-09-18T05:14:35.942 INFO:teuthology.orchestra.run.smithi017.stdout:3012 read 0xc9c5c95 thru 0xc9d52c1 (0xf62d bytes) 2024-09-18T05:14:35.943 INFO:teuthology.orchestra.run.smithi017.stdout:3014 read 0x755c717 thru 0x755fcee (0x35d8 bytes) 2024-09-18T05:14:35.943 INFO:teuthology.orchestra.run.smithi017.stdout:3015 read 0xb421b40 thru 0xb430414 (0xe8d5 bytes) 2024-09-18T05:14:35.943 INFO:teuthology.orchestra.run.smithi017.stdout:3016 write 0x440a591 thru 0x4415b27 (0xb597 bytes) 2024-09-18T05:14:35.948 INFO:teuthology.orchestra.run.smithi017.stdout:3017 read 0x26f5d96 thru 0x26fb65d (0x58c8 bytes) 2024-09-18T05:14:35.973 INFO:teuthology.orchestra.run.smithi017.stdout:3019 trunc from 0xea57faa to 0x85d3fc 2024-09-18T05:14:35.993 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:35.986+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:36.011 INFO:teuthology.orchestra.run.smithi017.stdout:3021 write 0x2ad04fb thru 0x2ad4df9 (0x48ff bytes) 2024-09-18T05:14:36.021 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:36.030 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:36.030 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:36.030 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:36.030 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:36.030 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:36.036 INFO:teuthology.orchestra.run.smithi017.stdout:3022 write 0x7fc42c8 thru 0x7fd02e4 (0xc01d bytes) 2024-09-18T05:14:36.039 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:36.041 INFO:teuthology.orchestra.run.smithi017.stdout:3023 write 0x1d0d9ca thru 0x1d14e36 (0x746d bytes) 2024-09-18T05:14:36.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:36.047 INFO:teuthology.orchestra.run.smithi017.stdout:3024 read 0x4128765 thru 0x412c05f (0x38fb bytes) 2024-09-18T05:14:36.057 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:36.057 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:36.059 INFO:teuthology.orchestra.run.smithi017.stdout:3025 write 0x9adb48f thru 0x9ae4125 (0x8c97 bytes) 2024-09-18T05:14:36.064 INFO:teuthology.orchestra.run.smithi017.stdout:3026 writesame 0x579474a thru 0x579a729 data_size 0x68(0x5fe0 bytes) 2024-09-18T05:14:36.068 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:14:36.077 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:36.078 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:36.080 INFO:teuthology.orchestra.run.smithi017.stdout:3027 read 0x881dedf thru 0x882ba60 (0xdb82 bytes) 2024-09-18T05:14:36.080 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:36.080 INFO:teuthology.orchestra.run.smithi017.stdout:3029 punch from 0x8e6bf07 to 0x8e70083, (0x417c bytes) 2024-09-18T05:14:36.080 INFO:teuthology.orchestra.run.smithi017.stdout:3030 read 0x5f05b1f thru 0x5f13b1a (0xdffc bytes) 2024-09-18T05:14:36.081 INFO:teuthology.orchestra.run.smithi017.stdout:3031 writesame 0x853e00d thru 0x85492b5 data_size 0x1(0xb2a9 bytes) 2024-09-18T05:14:36.099 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:36.100 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:36.100 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:36.094+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:36.102 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:36.103 INFO:teuthology.orchestra.run.smithi017.stdout:3034 read 0x658e7ef thru 0x65954fb (0x6d0d bytes) 2024-09-18T05:14:36.103 INFO:teuthology.orchestra.run.smithi017.stdout:3035 punch from 0x8f33054 to 0x8f3dcc9, (0xac75 bytes) 2024-09-18T05:14:36.113 INFO:teuthology.orchestra.run.smithi017.stdout:3036 write 0xa93a8ae thru 0xa9403f1 (0x5b44 bytes) 2024-09-18T05:14:36.118 INFO:teuthology.orchestra.run.smithi017.stdout:3038 read 0x6563860 thru 0x6569ccf (0x6470 bytes) 2024-09-18T05:14:36.118 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:36.119 INFO:teuthology.orchestra.run.smithi017.stdout:3042 read 0x6cbc80d thru 0x6cbdbc0 (0x13b4 bytes) 2024-09-18T05:14:36.119 INFO:teuthology.orchestra.run.smithi017.stdout:3043 read 0xb67db2 thru 0xb72c76 (0xaec5 bytes) 2024-09-18T05:14:36.119 INFO:teuthology.orchestra.run.smithi017.stdout:3045 write 0x3d622d7 thru 0x3d6ae68 (0x8b92 bytes) 2024-09-18T05:14:36.123 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:36.123 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:36.123 INFO:teuthology.orchestra.run.smithi017.stdout:3046 writesame 0xb43423 thru 0xb4461c data_size 0x1(0x11fa bytes) 2024-09-18T05:14:36.125 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-18T05:14:36.128 INFO:teuthology.orchestra.run.smithi017.stdout:3048 trunc from 0xa9403f2 to 0x941b9a9 2024-09-18T05:14:36.145 INFO:teuthology.orchestra.run.smithi017.stdout:3051 write 0x7d10889 thru 0x7d1ab11 (0xa289 bytes) 2024-09-18T05:14:36.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:36.147 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:36.149 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:14:36.150 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:14:36.150 INFO:teuthology.orchestra.run.smithi017.stdout:3053 write 0x78dc274 thru 0x78ea72e (0xe4bb bytes) 2024-09-18T05:14:36.153 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:36.153 INFO:teuthology.orchestra.run.smithi017.stdout:3056 read 0x6a67ab2 thru 0x6a72e4a (0xb399 bytes) 2024-09-18T05:14:36.153 INFO:teuthology.orchestra.run.smithi017.stdout:3057 read 0x2b7a78f thru 0x2b83c6a (0x94dc bytes) 2024-09-18T05:14:36.153 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:36.154 INFO:teuthology.orchestra.run.smithi017.stdout:3059 trunc from 0x941b9a9 to 0x8924922 2024-09-18T05:14:36.185 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:36.185 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:36.187 INFO:teuthology.orchestra.run.smithi017.stdout:3060 write 0xb03afd0 thru 0xb049725 (0xe756 bytes) 2024-09-18T05:14:36.191 INFO:teuthology.orchestra.run.smithi017.stdout:3061 punch from 0x691e3c3 to 0x692acdf, (0xc91c bytes) 2024-09-18T05:14:36.191 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:36.191 INFO:teuthology.orchestra.run.smithi017.stdout:3063 read 0xa91d34 thru 0xa9558d (0x385a bytes) 2024-09-18T05:14:36.191 INFO:teuthology.orchestra.run.smithi017.stdout:3064 read 0x1a06be0 thru 0x1a0f060 (0x8481 bytes) 2024-09-18T05:14:36.193 INFO:teuthology.orchestra.run.smithi017.stdout:3065 read 0x733f95c thru 0x734ae53 (0xb4f8 bytes) 2024-09-18T05:14:36.193 INFO:teuthology.orchestra.run.smithi017.stdout:3066 read 0x70bf7ec thru 0x70cc781 (0xcf96 bytes) 2024-09-18T05:14:36.194 INFO:teuthology.orchestra.run.smithi017.stdout:3067 writesame 0x48c09a0 thru 0x48d03ba data_size 0x1(0xfa1b bytes) 2024-09-18T05:14:36.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:36.186+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:36.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:36.222 INFO:teuthology.orchestra.run.smithi017.stdout:3068 punch from 0x3d785cc to 0x3d82c8c, (0xa6c0 bytes) 2024-09-18T05:14:36.222 INFO:teuthology.orchestra.run.smithi017.stdout:3069 read 0x1cc1e0f thru 0x1cc3ed6 (0x20c8 bytes) 2024-09-18T05:14:36.222 INFO:teuthology.orchestra.run.smithi017.stdout:3070 read 0x5542672 thru 0x554d920 (0xb2af bytes) 2024-09-18T05:14:36.222 INFO:teuthology.orchestra.run.smithi017.stdout:3071 read 0x9e242fa thru 0x9e24f28 (0xc2f bytes) 2024-09-18T05:14:36.222 INFO:teuthology.orchestra.run.smithi017.stdout:3072 read 0x6e4bbac thru 0x6e555ca (0x9a1f bytes) 2024-09-18T05:14:36.222 INFO:teuthology.orchestra.run.smithi017.stdout:3073 write 0xa432c05 thru 0xa441c2d (0xf029 bytes) 2024-09-18T05:14:36.226 INFO:teuthology.orchestra.run.smithi017.stdout:3075 read 0x88dc55d thru 0x88ebdc4 (0xf868 bytes) 2024-09-18T05:14:36.226 INFO:teuthology.orchestra.run.smithi017.stdout:3076 punch from 0x7036eff to 0x703a996, (0x3a97 bytes) 2024-09-18T05:14:36.246 INFO:teuthology.orchestra.run.smithi017.stdout:3077 write 0xecd13e0 thru 0xecd48dd (0x34fe bytes) 2024-09-18T05:14:36.249 INFO:teuthology.orchestra.run.smithi017.stdout:3079 punch from 0x761d9bf to 0x7625168, (0x77a9 bytes) 2024-09-18T05:14:36.249 INFO:teuthology.orchestra.run.smithi017.stdout:3080 writesame 0x831807 thru 0x83d58b data_size 0x1d(0xbd85 bytes) 2024-09-18T05:14:36.273 INFO:teuthology.orchestra.run.smithi017.stdout:3081 trunc from 0xecd48de to 0x1acf005 2024-09-18T05:14:36.290 INFO:teuthology.orchestra.run.smithi017.stdout:3082 punch from 0x1237b12 to 0x123f512, (0x7a00 bytes) 2024-09-18T05:14:36.291 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:36.291 INFO:teuthology.orchestra.run.smithi017.stdout:3084 read 0x12af514 thru 0x12b146a (0x1f57 bytes) 2024-09-18T05:14:36.291 INFO:teuthology.orchestra.run.smithi017.stdout:3086 write 0x120bae1 thru 0x12102d1 (0x47f1 bytes) 2024-09-18T05:14:36.294 INFO:teuthology.orchestra.run.smithi017.stdout:3089 punch from 0x92685e to 0x92be66, (0x5608 bytes) 2024-09-18T05:14:36.295 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:36.290+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:36.305 INFO:teuthology.orchestra.run.smithi017.stdout:3090 write 0x2c76ad6 thru 0x2c7b792 (0x4cbd bytes) 2024-09-18T05:14:36.310 INFO:teuthology.orchestra.run.smithi017.stdout:3091 punch from 0x605d9d to 0x606db8, (0x101b bytes) 2024-09-18T05:14:36.310 INFO:teuthology.orchestra.run.smithi017.stdout:3092 punch from 0x19d4f3f to 0x19d5b4b, (0xc0c bytes) 2024-09-18T05:14:36.310 INFO:teuthology.orchestra.run.smithi017.stdout:3093 write 0x1f5f082 thru 0x1f62f67 (0x3ee6 bytes) 2024-09-18T05:14:36.313 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:36.313 INFO:teuthology.orchestra.run.smithi017.stdout:3096 read 0x1cc6fa3 thru 0x1ccc6f0 (0x574e bytes) 2024-09-18T05:14:36.316 INFO:teuthology.orchestra.run.smithi017.stdout:3097 trunc from 0x2c7b793 to 0x453dbc4 2024-09-18T05:14:36.326 INFO:teuthology.orchestra.run.smithi017.stdout:3098 read 0x1b8b60a thru 0x1b93ab2 (0x84a9 bytes) 2024-09-18T05:14:36.344 INFO:teuthology.orchestra.run.smithi017.stdout:3102 writesame 0x99132e3 thru 0x991feb9 data_size 0x1(0xcbd7 bytes) 2024-09-18T05:14:36.347 INFO:teuthology.orchestra.run.smithi017.stdout:3103 trunc from 0x991feba to 0x840375e 2024-09-18T05:14:36.350 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:36.350 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:36.367 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:36.380 INFO:teuthology.orchestra.run.smithi017.stdout:3104 write 0xd531bd2 thru 0xd534a8b (0x2eba bytes) 2024-09-18T05:14:36.385 INFO:teuthology.orchestra.run.smithi017.stdout:3106 write 0x2b909bf thru 0x2b9ad9f (0xa3e1 bytes) 2024-09-18T05:14:36.396 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:36.393+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:36.418 INFO:teuthology.orchestra.run.smithi017.stdout:3107 trunc from 0xd534a8c to 0xac6ba5 2024-09-18T05:14:36.438 INFO:teuthology.orchestra.run.smithi017.stdout:3108 read 0x6712b6 thru 0x672c53 (0x199e bytes) 2024-09-18T05:14:36.463 INFO:teuthology.orchestra.run.smithi017.stdout:3109 write 0x7a833b1 thru 0x7a84a94 (0x16e4 bytes) 2024-09-18T05:14:36.476 INFO:teuthology.orchestra.run.smithi017.stdout:3110 trunc from 0x7a84a95 to 0x49efbc0 2024-09-18T05:14:36.497 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:36.493+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:36.498 INFO:teuthology.orchestra.run.smithi017.stdout:3111 trunc from 0x49efbc0 to 0x585c8e2 2024-09-18T05:14:36.507 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:36.507 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:36.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:36.540 INFO:teuthology.orchestra.run.smithi017.stdout:3112 write 0xc8defca thru 0xc8e7666 (0x869d bytes) 2024-09-18T05:14:36.547 INFO:teuthology.orchestra.run.smithi017.stdout:3113 write 0x6fa7d3d thru 0x6fb7b9c (0xfe60 bytes) 2024-09-18T05:14:36.553 INFO:teuthology.orchestra.run.smithi017.stdout:3114 write 0x11a0447 thru 0x11afcd1 (0xf88b bytes) 2024-09-18T05:14:36.559 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:36.559 INFO:teuthology.orchestra.run.smithi017.stdout:3116 write 0x62c4236 thru 0x62c9108 (0x4ed3 bytes) 2024-09-18T05:14:36.571 INFO:teuthology.orchestra.run.smithi017.stdout:3117 trunc from 0xc8e7667 to 0x7ff2d65 2024-09-18T05:14:36.590 INFO:teuthology.orchestra.run.smithi017.stdout:3120 punch from 0x7660570 to 0x767054a, (0xffda bytes) 2024-09-18T05:14:36.590 INFO:teuthology.orchestra.run.smithi017.stdout:3121 punch from 0x42b5d48 to 0x42b6686, (0x93e bytes) 2024-09-18T05:14:36.590 INFO:teuthology.orchestra.run.smithi017.stdout:3122 punch from 0x7c42fd1 to 0x7c436a5, (0x6d4 bytes) 2024-09-18T05:14:36.591 INFO:teuthology.orchestra.run.smithi017.stdout:3124 read 0x1a1b7d4 thru 0x1a27e9b (0xc6c8 bytes) 2024-09-18T05:14:36.591 INFO:teuthology.orchestra.run.smithi017.stdout:3125 read 0x6660e6d thru 0x6666ab1 (0x5c45 bytes) 2024-09-18T05:14:36.591 INFO:teuthology.orchestra.run.smithi017.stdout:3127 punch from 0x574d879 to 0x575d632, (0xfdb9 bytes) 2024-09-18T05:14:36.598 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:36.590+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:36.606 INFO:teuthology.orchestra.run.smithi017.stdout:3128 writesame 0xa606111 thru 0xa613d5a data_size 0x75(0xdc4a bytes) 2024-09-18T05:14:36.606 INFO:teuthology.orchestra.run.smithi017.stdout:3129 writesame 0x1501ce8 thru 0x150e1cb data_size 0x2(0xc4e4 bytes) 2024-09-18T05:14:36.646 INFO:teuthology.orchestra.run.smithi017.stdout:3130 trunc from 0xa613d5b to 0xc8a3057 2024-09-18T05:14:36.659 INFO:teuthology.orchestra.run.smithi017.stdout:3131 write 0x2d1c76c thru 0x2d1e2c2 (0x1b57 bytes) 2024-09-18T05:14:36.666 INFO:teuthology.orchestra.run.smithi017.stdout:3132 punch from 0x75384b2 to 0x75441a0, (0xbcee bytes) 2024-09-18T05:14:36.666 INFO:teuthology.orchestra.run.smithi017.stdout:3135 read 0xaf8b6aa thru 0xaf9a09b (0xe9f2 bytes) 2024-09-18T05:14:36.666 INFO:teuthology.orchestra.run.smithi017.stdout:3136 writesame 0xb69f629 thru 0xb6aeb35 data_size 0xb(0xf50d bytes) 2024-09-18T05:14:36.672 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:36.673 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:36.676 INFO:teuthology.orchestra.run.smithi017.stdout:3137 punch from 0x81fe58b to 0x820c127, (0xdb9c bytes) 2024-09-18T05:14:36.677 INFO:teuthology.orchestra.run.smithi017.stdout:3139 trunc from 0xc8a3057 to 0xcdaef31 2024-09-18T05:14:36.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:36.690 INFO:teuthology.orchestra.run.smithi017.stdout:3140 read 0x54e05da thru 0x54e4851 (0x4278 bytes) 2024-09-18T05:14:36.690 INFO:teuthology.orchestra.run.smithi017.stdout:3143 clone 23 order 20 su 8192 sc 2 2024-09-18T05:14:36.731 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:36.726+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:36.800 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:36.797+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:36.859 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:36.859 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:36.873 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:36.900 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:36.897+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:36.998 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:36.998 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:37.001 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:36.994+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:37.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:37.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:37.094+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:37.189 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:37.189 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:37.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:37.198+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:37.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:flattening image image_client.0-clone22 2024-09-18T05:14:37.304 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:37.298+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:37.342 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:37.343 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:37.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:37.404 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:37.398+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:37.477 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:37.477 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:37.492 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:37.539 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:37.537+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:37.606 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:37.601+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:37.620 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:37.620 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:37.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:37.642 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-18T05:14:37.680 INFO:teuthology.orchestra.run.smithi017.stdout:3145 trunc from 0xcdaef31 to 0x193cbf1 2024-09-18T05:14:37.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:37.702+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:37.750 INFO:teuthology.orchestra.run.smithi017.stdout:3147 read 0xcdce5f thru 0xce3b12 (0x6cb4 bytes) 2024-09-18T05:14:37.781 INFO:teuthology.orchestra.run.smithi017.stdout:3148 writesame 0xa9d55e2 thru 0xa9db7f9 data_size 0x2b(0x6218 bytes) 2024-09-18T05:14:37.792 INFO:teuthology.orchestra.run.smithi017.stdout:3149 write 0xa9f3ed8 thru 0xa9f4475 (0x59e bytes) 2024-09-18T05:14:37.805 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:37.806 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:37.808 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:37.802+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:37.814 INFO:teuthology.orchestra.run.smithi017.stdout:3150 writesame 0xb627302 thru 0xb63562f data_size 0x36(0xe32e bytes) 2024-09-18T05:14:37.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:37.829 INFO:teuthology.orchestra.run.smithi017.stdout:3151 write 0xcf592eb thru 0xcf62738 (0x944e bytes) 2024-09-18T05:14:37.841 INFO:teuthology.orchestra.run.smithi017.stdout:3152 trunc from 0xcf62739 to 0xb761ab6 2024-09-18T05:14:37.862 INFO:teuthology.orchestra.run.smithi017.stdout:3154 read 0x8274574 thru 0x827dcaa (0x9737 bytes) 2024-09-18T05:14:37.863 INFO:teuthology.orchestra.run.smithi017.stdout:3156 write 0x6e4ace thru 0x6f3f7e (0xf4b1 bytes) 2024-09-18T05:14:37.909 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:37.905+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:37.928 INFO:teuthology.orchestra.run.smithi017.stdout:3157 read 0x1b2c97b thru 0x1b31ab2 (0x5138 bytes) 2024-09-18T05:14:37.928 INFO:teuthology.orchestra.run.smithi017.stdout:3158 read 0xa1e3b08 thru 0xa1f0332 (0xc82b bytes) 2024-09-18T05:14:37.928 INFO:teuthology.orchestra.run.smithi017.stdout:3159 read 0x3787d2a thru 0x3794af6 (0xcdcd bytes) 2024-09-18T05:14:37.928 INFO:teuthology.orchestra.run.smithi017.stdout:3160 write 0x65b2ab1 thru 0x65bfcbf (0xd20f bytes) 2024-09-18T05:14:37.935 INFO:teuthology.orchestra.run.smithi017.stdout:3162 read 0x7fc664d thru 0x7fd4716 (0xe0ca bytes) 2024-09-18T05:14:37.935 INFO:teuthology.orchestra.run.smithi017.stdout:3166 read 0x539efb1 thru 0x53a1422 (0x2472 bytes) 2024-09-18T05:14:37.935 INFO:teuthology.orchestra.run.smithi017.stdout:3168 read 0x55b587 thru 0x55c8e9 (0x1363 bytes) 2024-09-18T05:14:37.953 INFO:teuthology.orchestra.run.smithi017.stdout:3169 writesame 0xcc44469 thru 0xcc49dbd data_size 0x63(0x5955 bytes) 2024-09-18T05:14:37.953 INFO:teuthology.orchestra.run.smithi017.stdout:3170 write 0x5a43416 thru 0x5a445dd (0x11c8 bytes) 2024-09-18T05:14:37.955 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:37.955 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:37.960 INFO:teuthology.orchestra.run.smithi017.stdout:3171 write 0x613dad5 thru 0x6143c59 (0x6185 bytes) 2024-09-18T05:14:37.967 INFO:teuthology.orchestra.run.smithi017.stdout:3172 read 0x2903dbd thru 0x290d720 (0x9964 bytes) 2024-09-18T05:14:37.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:37.978 INFO:teuthology.orchestra.run.smithi017.stdout:3174 trunc from 0xcc49dbe to 0x8e6ef36 2024-09-18T05:14:37.997 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:37.997 INFO:teuthology.orchestra.run.smithi017.stdout:3178 write 0x3d520d6 thru 0x3d551f2 (0x311d bytes) 2024-09-18T05:14:38.002 INFO:teuthology.orchestra.run.smithi017.stdout:3179 read 0x402c07b thru 0x402c91f (0x8a5 bytes) 2024-09-18T05:14:38.002 INFO:teuthology.orchestra.run.smithi017.stdout:3180 punch from 0x288922a to 0x28942d4, (0xb0aa bytes) 2024-09-18T05:14:38.002 INFO:teuthology.orchestra.run.smithi017.stdout:3181 punch from 0x7239d89 to 0x723ceab, (0x3122 bytes) 2024-09-18T05:14:38.003 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.003 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.011 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:38.009+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:38.021 INFO:teuthology.orchestra.run.smithi017.stdout:3186 write 0xb920ba8 thru 0xb923ccc (0x3125 bytes) 2024-09-18T05:14:38.028 INFO:teuthology.orchestra.run.smithi017.stdout:3187 read 0x1555810 thru 0x155e1bb (0x89ac bytes) 2024-09-18T05:14:38.029 INFO:teuthology.orchestra.run.smithi017.stdout:3188 write 0x5df5db8 thru 0x5e031c8 (0xd411 bytes) 2024-09-18T05:14:38.039 INFO:teuthology.orchestra.run.smithi017.stdout:3189 read 0x4473167 thru 0x447af3d (0x7dd7 bytes) 2024-09-18T05:14:38.040 INFO:teuthology.orchestra.run.smithi017.stdout:3190 write 0x4e18909 thru 0x4e272d3 (0xe9cb bytes) 2024-09-18T05:14:38.046 INFO:teuthology.orchestra.run.smithi017.stdout:3191 write 0x62995c thru 0x630deb (0x7490 bytes) 2024-09-18T05:14:38.049 INFO:teuthology.orchestra.run.smithi017.stdout:3192 writesame 0x42b6ca9 thru 0x42b9584 data_size 0xa(0x28dc bytes) 2024-09-18T05:14:38.058 INFO:teuthology.orchestra.run.smithi017.stdout:3193 trunc from 0xb923ccd to 0xc10442f 2024-09-18T05:14:38.073 INFO:teuthology.orchestra.run.smithi017.stdout:3194 trunc from 0xc10442f to 0xaf1c8ab 2024-09-18T05:14:38.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:14:38.095 INFO:teuthology.orchestra.run.smithi017.stdout:3195 write 0x998c466 thru 0x998f43d (0x2fd8 bytes) 2024-09-18T05:14:38.115 INFO:teuthology.orchestra.run.smithi017.stdout:3196 trunc from 0xaf1c8ab to 0x653d764 2024-09-18T05:14:38.115 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:38.110+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:38.133 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:38.133 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:38.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:38.151 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:38.152 INFO:teuthology.orchestra.run.smithi017.stdout:3197 write 0x98af35c thru 0x98bdcd9 (0xe97e bytes) 2024-09-18T05:14:38.158 INFO:teuthology.orchestra.run.smithi017.stdout:3198 write 0x971654e thru 0x97228a7 (0xc35a bytes) 2024-09-18T05:14:38.164 INFO:teuthology.orchestra.run.smithi017.stdout:3199 read 0x73d4806 thru 0x73d4e49 (0x644 bytes) 2024-09-18T05:14:38.164 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.164 INFO:teuthology.orchestra.run.smithi017.stdout:3202 punch from 0x53d17d4 to 0x53db0fd, (0x9929 bytes) 2024-09-18T05:14:38.180 INFO:teuthology.orchestra.run.smithi017.stdout:3203 write 0xe119e53 thru 0xe120b5d (0x6d0b bytes) 2024-09-18T05:14:38.193 INFO:teuthology.orchestra.run.smithi017.stdout:3204 write 0xea72de1 thru 0xea75089 (0x22a9 bytes) 2024-09-18T05:14:38.198 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.198 INFO:teuthology.orchestra.run.smithi017.stdout:3206 read 0x8cc4830 thru 0x8cc915b (0x492c bytes) 2024-09-18T05:14:38.199 INFO:teuthology.orchestra.run.smithi017.stdout:3207 read 0x12347e thru 0x12876a (0x52ed bytes) 2024-09-18T05:14:38.199 INFO:teuthology.orchestra.run.smithi017.stdout:3209 write 0x475b8eb thru 0x475c685 (0xd9b bytes) 2024-09-18T05:14:38.205 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.212 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:38.209+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:38.216 INFO:teuthology.orchestra.run.smithi017.stdout:3213 trunc from 0xea7508a to 0x77fbeba 2024-09-18T05:14:38.230 INFO:teuthology.orchestra.run.smithi017.stdout:3214 read 0x5d78d4a thru 0x5d79d91 (0x1048 bytes) 2024-09-18T05:14:38.231 INFO:teuthology.orchestra.run.smithi017.stdout:3215 punch from 0x133c184 to 0x1340b9e, (0x4a1a bytes) 2024-09-18T05:14:38.231 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.238 INFO:teuthology.orchestra.run.smithi017.stdout:3217 trunc from 0x77fbeba to 0xd1d82f2 2024-09-18T05:14:38.245 INFO:teuthology.orchestra.run.smithi017.stdout:3218 read 0x9718f14 thru 0x9721dbb (0x8ea8 bytes) 2024-09-18T05:14:38.245 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.245 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.245 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.245 INFO:teuthology.orchestra.run.smithi017.stdout:3223 punch from 0x2036a3f to 0x2041be0, (0xb1a1 bytes) 2024-09-18T05:14:38.245 INFO:teuthology.orchestra.run.smithi017.stdout:3224 writesame 0x45a18f0 thru 0x45ae085 data_size 0x2(0xc796 bytes) 2024-09-18T05:14:38.255 INFO:teuthology.orchestra.run.smithi017.stdout:3225 writesame 0xab142cf thru 0xab198d9 data_size 0x1(0x560b bytes) 2024-09-18T05:14:38.265 INFO:teuthology.orchestra.run.smithi017.stdout:3226 write 0x43de5a thru 0x4498c4 (0xba6b bytes) 2024-09-18T05:14:38.277 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:38.277 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:38.297 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:38.305 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.305 INFO:teuthology.orchestra.run.smithi017.stdout:3228 read 0x1a788e9 thru 0x1a86753 (0xde6b bytes) 2024-09-18T05:14:38.305 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.305 INFO:teuthology.orchestra.run.smithi017.stdout:3230 writesame 0x721d9f5 thru 0x7223580 data_size 0x7c(0x5b8c bytes) 2024-09-18T05:14:38.316 INFO:teuthology.orchestra.run.smithi017.stdout:3231 write 0xd5b0fef thru 0xd5b7f39 (0x6f4b bytes) 2024-09-18T05:14:38.320 INFO:teuthology.orchestra.run.smithi017.stdout:3232 read 0xc222e0d thru 0xc227a7c (0x4c70 bytes) 2024-09-18T05:14:38.320 INFO:teuthology.orchestra.run.smithi017.stdout:3233 write 0x3729a86 thru 0x3738ef6 (0xf471 bytes) 2024-09-18T05:14:38.321 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:38.322 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:38.325 INFO:teuthology.orchestra.run.smithi017.stdout:3235 read 0x37a82f thru 0x389eef (0xf6c1 bytes) 2024-09-18T05:14:38.327 INFO:teuthology.orchestra.run.smithi017.stdout:3237 write 0x1ed46ea thru 0x1ee1a92 (0xd3a9 bytes) 2024-09-18T05:14:38.331 INFO:teuthology.orchestra.run.smithi017.stdout:3238 writesame 0x5e3d699 thru 0x5e40d0f data_size 0x1(0x3677 bytes) 2024-09-18T05:14:38.338 INFO:teuthology.orchestra.run.smithi017.stdout:3240 read 0xf46bf0 thru 0xf55ac8 (0xeed9 bytes) 2024-09-18T05:14:38.340 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:38.337+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:38.340 INFO:teuthology.orchestra.run.smithi017.stdout:3241 punch from 0x65e3a92 to 0x65ea637, (0x6ba5 bytes) 2024-09-18T05:14:38.340 INFO:teuthology.orchestra.run.smithi017.stdout:3242 writesame 0x1a245 thru 0x1cd79 data_size 0x3(0x2b35 bytes) 2024-09-18T05:14:38.342 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:38.365 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:38.366 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:38.373 INFO:teuthology.orchestra.run.smithi017.stdout:3243 read 0x1c5879c thru 0x1c5e44e (0x5cb3 bytes) 2024-09-18T05:14:38.373 INFO:teuthology.orchestra.run.smithi017.stdout:3244 read 0xcad3a93 thru 0xcad736e (0x38dc bytes) 2024-09-18T05:14:38.373 INFO:teuthology.orchestra.run.smithi017.stdout:3245 write 0xaf3cd3b thru 0xaf470bb (0xa381 bytes) 2024-09-18T05:14:38.377 INFO:teuthology.orchestra.run.smithi017.stdout:3247 write 0x3fc02a thru 0x406c8f (0xac66 bytes) 2024-09-18T05:14:38.388 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:38.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:38.406+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:38.414 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:38.415 INFO:teuthology.orchestra.run.smithi017.stdout:3249 writesame 0x272f819 thru 0x2730b24 data_size 0x17(0x130c bytes) 2024-09-18T05:14:38.419 INFO:teuthology.orchestra.run.smithi017.stdout:3250 read 0x4cb1d1d thru 0x4cc0f80 (0xf264 bytes) 2024-09-18T05:14:38.419 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.419 INFO:teuthology.orchestra.run.smithi017.stdout:3252 read 0xce8f14 thru 0xceb9b0 (0x2a9d bytes) 2024-09-18T05:14:38.420 INFO:teuthology.orchestra.run.smithi017.stdout:3254 trunc from 0xd5b7f3a to 0xcdba713 2024-09-18T05:14:38.432 INFO:teuthology.orchestra.run.smithi017.stdout:3255 read 0xacb75a9 thru 0xacc0c99 (0x96f1 bytes) 2024-09-18T05:14:38.432 INFO:teuthology.orchestra.run.smithi017.stdout:3256 read 0x9e091a8 thru 0x9e0e3a2 (0x51fb bytes) 2024-09-18T05:14:38.432 INFO:teuthology.orchestra.run.smithi017.stdout:3257 write 0x4a1322f thru 0x4a1a19e (0x6f70 bytes) 2024-09-18T05:14:38.434 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-18T05:14:38.436 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.438 INFO:teuthology.orchestra.run.smithi017.stdout:3259 trunc from 0xcdba713 to 0xe4af585 2024-09-18T05:14:38.444 INFO:teuthology.orchestra.run.smithi017.stdout:3260 writesame 0x37fc38f thru 0x37fcd58 data_size 0x7(0x9ca bytes) 2024-09-18T05:14:38.446 INFO:teuthology.orchestra.run.smithi017.stdout:3261 read 0xb31439 thru 0xb38027 (0x6bef bytes) 2024-09-18T05:14:38.447 INFO:teuthology.orchestra.run.smithi017.stdout:3262 read 0xaa77e5a thru 0xaa7e26a (0x6411 bytes) 2024-09-18T05:14:38.455 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:38.458 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:14:38.460 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:14:38.469 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:38.470 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:38.470 INFO:teuthology.orchestra.run.smithi017.stdout:3263 trunc from 0xe4af585 to 0x1071eec 2024-09-18T05:14:38.489 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:38.514 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:38.506+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:38.527 INFO:teuthology.orchestra.run.smithi017.stdout:3264 read 0x17b83f thru 0x186606 (0xadc8 bytes) 2024-09-18T05:14:38.543 INFO:teuthology.orchestra.run.smithi017.stdout:3268 writesame 0x68bf221 thru 0x68cbd3d data_size 0x1d(0xcb1d bytes) 2024-09-18T05:14:38.657 INFO:teuthology.orchestra.run.smithi017.stdout:3269 write 0x9eff78 thru 0x9f1083 (0x110c bytes) 2024-09-18T05:14:38.659 INFO:teuthology.orchestra.run.smithi017.stdout:3270 read 0x21bb426 thru 0x21c9de4 (0xe9bf bytes) 2024-09-18T05:14:38.659 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.659 INFO:teuthology.orchestra.run.smithi017.stdout:3272 write 0x2e85513 thru 0x2e8bcd8 (0x67c6 bytes) 2024-09-18T05:14:38.660 INFO:teuthology.orchestra.run.smithi017.stdout:3273 punch from 0x3554712 to 0x355798a, (0x3278 bytes) 2024-09-18T05:14:38.660 INFO:teuthology.orchestra.run.smithi017.stdout:3274 trunc from 0x68cbd3e to 0xa422640 2024-09-18T05:14:38.660 INFO:teuthology.orchestra.run.smithi017.stdout:3276 read 0x29f2b64 thru 0x29fd630 (0xaacd bytes) 2024-09-18T05:14:38.660 INFO:teuthology.orchestra.run.smithi017.stdout:3278 write 0x3df0510 thru 0x3df4477 (0x3f68 bytes) 2024-09-18T05:14:38.660 INFO:teuthology.orchestra.run.smithi017.stdout:3279 read 0x14b0475 thru 0x14b6980 (0x650c bytes) 2024-09-18T05:14:38.660 INFO:teuthology.orchestra.run.smithi017.stdout:3281 writesame 0x72eda79 thru 0x72f2297 data_size 0x1(0x481f bytes) 2024-09-18T05:14:38.660 INFO:teuthology.orchestra.run.smithi017.stdout:3282 trunc from 0xa422640 to 0x96e3b9d 2024-09-18T05:14:38.660 INFO:teuthology.orchestra.run.smithi017.stdout:3284 flatten 2024-09-18T05:14:38.661 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:27144 3.e 3:72e631ab:::rbd_data.118b9f2c0487.000000000000003c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T05:14:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:14:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.145105771000001, 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053442387000000001, 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 27144 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:14:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:14:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462530+0000", 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999957 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462560+0000", 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9933e-05 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462596+0000", 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5936000000000003e-05 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462621+0000", 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4644e-05 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462748+0000", 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126892 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.463025+0000", 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027756100000000001 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.471585+0000", 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085600780000000005 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515712+0000", 2024-09-18T05:14:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.044127 2024-09-18T05:14:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515824+0000", 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112002 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515915+0000", 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0105999999999994e-05 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515977+0000", 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2521999999999995e-05 2024-09-18T05:14:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36312 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.799080194999998, 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050924795000000002, 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36312 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808562+0000", 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.522e-06 2024-09-18T05:14:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808566+0000", 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0459999999999999e-06 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808569+0000", 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1580000000000001e-06 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859475+0000", 2024-09-18T05:14:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050906734000000002 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859485+0000", 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6029999999999994e-06 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36313 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.799069035999999, 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050958802999999997, 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36313 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808573+0000", 2024-09-18T05:14:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4720000000000001e-06 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808577+0000", 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9899999999999999e-06 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808581+0000", 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.301e-06 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859521+0000", 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939971000000001 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859530+0000", 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3309999999999993e-06 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36314 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.799056854, 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050974481000000002, 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36314 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808583+0000", 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808585+0000", 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839999999999999e-06 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808589+0000", 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0149999999999997e-06 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808592+0000", 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2100000000000002e-06 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859552+0000", 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050959971999999999 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859558+0000", 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0809999999999999e-06 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37032 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 366592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660540523000002, 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050948475, 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37032 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947099+0000", 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947102+0000", 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3140000000000002e-06 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947107+0000", 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947112+0000", 2024-09-18T05:14:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6500000000000004e-06 2024-09-18T05:14:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997959+0000", 2024-09-18T05:14:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050847106000000003 2024-09-18T05:14:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997999+0000", 2024-09-18T05:14:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0049000000000002e-05 2024-09-18T05:14:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998048+0000", 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9211e-05 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37033 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 376832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660513734999999, 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051119236999999998, 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37033 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947126+0000", 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947129+0000", 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5469999999999999e-06 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947135+0000", 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5069999999999997e-06 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947140+0000", 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7350000000000004e-06 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998080+0000", 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939401000000002 2024-09-18T05:14:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998158+0000", 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8753999999999998e-05 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998246+0000", 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7682999999999994e-05 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37034 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 387072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660496512999998, 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05121883, 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37034 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:14:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947146+0000", 2024-09-18T05:14:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.12e-06 2024-09-18T05:14:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947152+0000", 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8560000000000003e-06 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947156+0000", 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5970000000000002e-06 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998271+0000", 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051114764 2024-09-18T05:14:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998312+0000", 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1258999999999999e-05 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998363+0000", 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0581999999999998e-05 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37035 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660480143000001, 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051399043999999998, 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37035 2024-09-18T05:14:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947162+0000", 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1619999999999998e-06 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947168+0000", 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7640000000000002e-06 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947172+0000", 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4750000000000004e-06 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998394+0000", 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051222202000000001 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998472+0000", 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7228e-05 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998559+0000", 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7699000000000002e-05 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37036 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 407552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660464575999999, 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051565297000000003, 2024-09-18T05:14:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37036 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947178+0000", 2024-09-18T05:14:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0169999999999999e-06 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947183+0000", 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947188+0000", 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998583+0000", 2024-09-18T05:14:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051394678999999999 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998661+0000", 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8631e-05 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998741+0000", 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0054000000000003e-05 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37037 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 417792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660448379000002, 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051746031999999997, 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.709 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37037 2024-09-18T05:14:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:14:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947194+0000", 2024-09-18T05:14:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1100000000000001e-06 2024-09-18T05:14:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947200+0000", 2024-09-18T05:14:38.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2530000000000001e-06 2024-09-18T05:14:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947205+0000", 2024-09-18T05:14:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8319999999999996e-06 2024-09-18T05:14:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998775+0000", 2024-09-18T05:14:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051569934999999997 2024-09-18T05:14:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998850+0000", 2024-09-18T05:14:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4783999999999994e-05 2024-09-18T05:14:38.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998938+0000", 2024-09-18T05:14:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8442999999999993e-05 2024-09-18T05:14:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37038 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:14:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660430815000002, 2024-09-18T05:14:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851468999999997, 2024-09-18T05:14:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.717 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37038 2024-09-18T05:14:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:14:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:14:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947209+0000", 2024-09-18T05:14:38.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947212+0000", 2024-09-18T05:14:38.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:14:38.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947218+0000", 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2319999999999998e-06 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947223+0000", 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8590000000000004e-06 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998966+0000", 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051743193999999999 2024-09-18T05:14:38.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999009+0000", 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999997e-05 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999061+0000", 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2216999999999998e-05 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37039 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660413671000001, 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052037513000000001, 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37039 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947226+0000", 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947229+0000", 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.198e-06 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947235+0000", 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.319e-06 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947240+0000", 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7260000000000002e-06 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999092+0000", 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851928999999998 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999162+0000", 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0115000000000002e-05 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999264+0000", 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010256599999999999 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37040 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 448512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660394901, 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052135867000000002, 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.727 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37040 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:14:38.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947245+0000", 2024-09-18T05:14:38.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947248+0000", 2024-09-18T05:14:38.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4439999999999998e-06 2024-09-18T05:14:38.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947256+0000", 2024-09-18T05:14:38.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:38.658+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:38.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9410000000000007e-06 2024-09-18T05:14:38.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947260+0000", 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999286+0000", 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052025350999999997 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999330+0000", 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4226e-05 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999381+0000", 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1529000000000001e-05 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37041 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 458752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660375605999999, 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052321965999999998, 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.734 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37041 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947275+0000", 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0175e-05 2024-09-18T05:14:38.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947283+0000", 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8660000000000006e-06 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947287+0000", 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6369999999999998e-06 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999414+0000", 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052126541999999998 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999494+0000", 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999587+0000", 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2795999999999997e-05 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37042 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660348776999999, 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052411412999999997, 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37042 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947291+0000", 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947294+0000", 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4559999999999999e-06 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947300+0000", 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5189999999999998e-06 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947305+0000", 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9049999999999996e-06 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999614+0000", 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052308353000000002 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999653+0000", 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9879000000000002e-05 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999703+0000", 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9710999999999999e-05 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37043 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 479232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660326826999999, 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052588113999999998, 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37043 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947313+0000", 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947316+0000", 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4059999999999999e-06 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947322+0000", 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2999999999999998e-06 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947327+0000", 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7119999999999999e-06 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999735+0000", 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052408145000000003 2024-09-18T05:14:38.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999812+0000", 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7540999999999995e-05 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999902+0000", 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9413000000000006e-05 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37044 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 489472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660309639000001, 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052688817999999998, 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37044 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.749 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:38.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:38.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947333+0000", 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.396e-06 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947339+0000", 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947344+0000", 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9359999999999998e-06 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999929+0000", 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052584371999999997 2024-09-18T05:14:38.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999969+0000", 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0315000000000003e-05 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000020+0000", 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0807000000000003e-05 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.754 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37045 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 499712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.754 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:14:38.754 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660291829999998, 2024-09-18T05:14:38.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052875286000000001, 2024-09-18T05:14:38.754 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.754 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37045 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947348+0000", 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947351+0000", 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3130000000000001e-06 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947357+0000", 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2040000000000002e-06 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947362+0000", 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9269999999999996e-06 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000054+0000", 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052691799999999997 2024-09-18T05:14:38.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000133+0000", 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9134999999999994e-05 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000224+0000", 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1315000000000002e-05 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37046 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660274476000001, 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052973012999999999, 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37046 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947368+0000", 2024-09-18T05:14:38.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3190000000000002e-06 2024-09-18T05:14:38.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947374+0000", 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1569999999999997e-06 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947379+0000", 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6949999999999999e-06 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000250+0000", 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052870752999999999 2024-09-18T05:14:38.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000291+0000", 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0975e-05 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000339+0000", 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8511999999999999e-05 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37047 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.660257484999999, 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053159397999999997, 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:38.764 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37047 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947385+0000", 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3070000000000001e-06 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947391+0000", 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947396+0000", 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.921e-06 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000373+0000", 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052976957999999998 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000451+0000", 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8250000000000005e-05 2024-09-18T05:14:38.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000542+0000", 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1242999999999994e-05 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:38.768 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:38.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:3285 punch from 0x93503d to 0x93e4ae, (0x9471 bytes) 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:3286 write 0x4a336a thru 0x4a80e7 (0x4d7e bytes) 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:3287 read 0x44e6842 thru 0x44f2e30 (0xc5ef bytes) 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:3288 read 0xb80e77 thru 0xb83b99 (0x2d23 bytes) 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:3289 write 0x8f909c6 thru 0x8f97892 (0x6ecd bytes) 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:3291 read 0x709a595 thru 0x709e620 (0x408c bytes) 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:3292 trunc from 0x96e3b9d to 0x96ba85b 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:3293 read 0x3c24fbb thru 0x3c2bb57 (0x6b9d bytes) 2024-09-18T05:14:38.770 INFO:teuthology.orchestra.run.smithi017.stdout:3294 punch from 0x49324da to 0x494093d, (0xe463 bytes) 2024-09-18T05:14:38.771 INFO:teuthology.orchestra.run.smithi017.stdout:3296 write 0xb1926dc thru 0xb1a1f3f (0xf864 bytes) 2024-09-18T05:14:38.771 INFO:teuthology.orchestra.run.smithi017.stdout:3297 read 0x2c51718 thru 0x2c5ec77 (0xd560 bytes) 2024-09-18T05:14:38.772 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:38.766+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:38.781 INFO:teuthology.orchestra.run.smithi017.stdout:3300 write 0xe3508cc thru 0xe355d04 (0x5439 bytes) 2024-09-18T05:14:38.787 INFO:teuthology.orchestra.run.smithi017.stdout:3302 clone 24 order 24 su 65536 sc 7 2024-09-18T05:14:38.873 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:38.869+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:38.901 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:38.901 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:38.901 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:38.901 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:38.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:39.003 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:38.998+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:39.069 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:39.065+0000 7f0b256ca7c0 -1 osd.6 47 log_to_monitors true 2024-09-18T05:14:39.074 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:39.070+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:39.079 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:39.080 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:39.080 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:39.083 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:14:39.101 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:39.124 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:39.121+0000 7f0b194a2640 -1 osd.6 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:14:39.175 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:39.169+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:39.276 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:39.270+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:39.285 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55852 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64372622099999999, 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052798855999999998, 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55852 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636907+0000", 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636913+0000", 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9170000000000003e-06 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636927+0000", 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4080000000000001e-05 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636938+0000", 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0251000000000001e-05 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689571+0000", 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052632828999999999 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689634+0000", 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3139000000000007e-05 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689707+0000", 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3511999999999997e-05 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55853 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8142848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64368374299999997, 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052962084999999999, 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55853 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636950+0000", 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636957+0000", 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636994+0000", 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6879999999999999e-05 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637005+0000", 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1430000000000001e-05 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689750+0000", 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052744345999999998 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689837+0000", 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7581000000000001e-05 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689913+0000", 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5797999999999995e-05 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55854 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8159232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64361939800000001, 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053068918, 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55854 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637014+0000", 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637020+0000", 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5149999999999997e-06 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637034+0000", 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4696e-05 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637045+0000", 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0334e-05 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689962+0000", 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052916773 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690024+0000", 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2009999999999998e-05 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690084+0000", 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0485000000000001e-05 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55855 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64357883299999996, 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053239090000000003, 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55855 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637055+0000", 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637060+0000", 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9139999999999999e-06 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637080+0000", 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9873000000000001e-05 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637091+0000", 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0852999999999999e-05 2024-09-18T05:14:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690124+0000", 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053033736999999997 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690217+0000", 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2263999999999996e-05 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690295+0000", 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8193000000000002e-05 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55856 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64353366499999998, 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053363617000000002, 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55856 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637100+0000", 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637106+0000", 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637120+0000", 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4885999999999999e-05 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637131+0000", 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.064e-05 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690344+0000", 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053212832000000002 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690404+0000", 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0516999999999997e-05 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690465+0000", 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0132e-05 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55857 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64349389700000004, 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053529896, 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55857 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637140+0000", 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637145+0000", 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637158+0000", 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3465999999999999e-05 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637168+0000", 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4919999999999999e-06 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690506+0000", 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053337801999999997 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690595+0000", 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8925000000000007e-05 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690671+0000", 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5983999999999996e-05 2024-09-18T05:14:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55858 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8224768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.643456582, 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053665767000000003, 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55858 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637177+0000", 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637182+0000", 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.028e-06 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637197+0000", 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4341999999999999e-05 2024-09-18T05:14:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637207+0000", 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0345e-05 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690719+0000", 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053511982 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690783+0000", 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3683999999999995e-05 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690844+0000", 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1116000000000002e-05 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55859 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8241152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64341844100000001, 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053835149999999998, 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55859 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637215+0000", 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637221+0000", 2024-09-18T05:14:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4879999999999998e-06 2024-09-18T05:14:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637239+0000", 2024-09-18T05:14:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7665000000000001e-05 2024-09-18T05:14:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637252+0000", 2024-09-18T05:14:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3735e-05 2024-09-18T05:14:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690887+0000", 2024-09-18T05:14:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053635163 2024-09-18T05:14:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690977+0000", 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9452999999999999e-05 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691051+0000", 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4374000000000003e-05 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55860 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64334702600000004, 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053934739000000002, 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55860 2024-09-18T05:14:39.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637287+0000", 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637293+0000", 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637309+0000", 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6214000000000001e-05 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637322+0000", 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2413e-05 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691101+0000", 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053779456000000003 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691164+0000", 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2199000000000005e-05 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691222+0000", 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8758999999999998e-05 2024-09-18T05:14:39.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55861 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8273920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64330456800000002, 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054100101999999997, 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55861 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637329+0000", 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637333+0000", 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2619999999999999e-06 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637340+0000", 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5279999999999998e-06 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637347+0000", 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691264+0000", 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916886999999997 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691353+0000", 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9560000000000003e-05 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691430+0000", 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6715e-05 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55862 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8290304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:39.333 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64326962300000001, 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054235677000000003, 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55862 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637364+0000", 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637368+0000", 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637378+0000", 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0545e-05 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637384+0000", 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.592e-06 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691479+0000", 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054095022 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691540+0000", 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0958999999999997e-05 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691601+0000", 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0976e-05 2024-09-18T05:14:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.340 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.340 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55863 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8306688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64324567600000004, 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054421542000000003, 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55863 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637388+0000", 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637391+0000", 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637398+0000", 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8249999999999999e-06 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637403+0000", 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3879999999999999e-06 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691642+0000", 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054238572999999998 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691732+0000", 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0413000000000003e-05 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691810+0000", 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8079999999999998e-05 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.344 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55864 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64255947000000002, 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053905402999999998, 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55864 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:39.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637413+0000", 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9993382 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638082+0000", 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066932099999999996 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638103+0000", 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638115+0000", 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2935000000000001e-05 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691859+0000", 2024-09-18T05:14:39.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053743055999999997 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691920+0000", 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1087999999999995e-05 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691980+0000", 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0853999999999997e-05 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55865 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8339456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64250700199999999, 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054056874999999997, 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55865 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638127+0000", 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638133+0000", 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7869999999999998e-06 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638146+0000", 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3030000000000001e-05 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638156+0000", 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0523000000000001e-05 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692022+0000", 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053866149000000002 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692109+0000", 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6428000000000007e-05 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692184+0000", 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5760999999999995e-05 2024-09-18T05:14:39.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55935 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7397376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.63999817999999997, 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052706586, 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55935 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640635+0000", 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640640+0000", 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640649+0000", 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8130000000000007e-06 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640655+0000", 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1739999999999999e-06 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693173+0000", 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518675000000001 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693264+0000", 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0859999999999994e-05 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693343+0000", 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8870999999999998e-05 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55936 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7413760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.63997533399999995, 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052856933000000002, 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55936 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640661+0000", 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3479999999999998e-06 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640672+0000", 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0424999999999999e-05 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640677+0000", 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693392+0000", 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052714446999999998 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693456+0000", 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4426999999999998e-05 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693516+0000", 2024-09-18T05:14:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0154e-05 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55937 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7430144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.63995275399999996, 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053045085999999998, 2024-09-18T05:14:39.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55937 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640681+0000", 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640685+0000", 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0799999999999999e-06 2024-09-18T05:14:39.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640700+0000", 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4768e-05 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640707+0000", 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.81e-06 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693559+0000", 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052852022999999998 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693648+0000", 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8908999999999999e-05 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693727+0000", 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9123999999999997e-05 2024-09-18T05:14:39.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55938 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7446528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.63992269899999998, 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053184652999999998, 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55938 2024-09-18T05:14:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640711+0000", 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640714+0000", 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0070000000000002e-06 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640721+0000", 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640728+0000", 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6479999999999997e-06 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693775+0000", 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047086 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693836+0000", 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1513999999999994e-05 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693897+0000", 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0315000000000001e-05 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.372 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55939 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7462912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.63989900099999997, 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369857999999999, 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55939 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:39.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640735+0000", 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640739+0000", 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-06 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640750+0000", 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0668e-05 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640755+0000", 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4299999999999997e-06 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693938+0000", 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053182462 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694028+0000", 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0781999999999999e-05 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694105+0000", 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049e-05 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.376 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55940 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7479296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.63987475100000002, 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053517447000000003, 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55940 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640759+0000", 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640769+0000", 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4730000000000006e-06 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640779+0000", 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9899999999999992e-06 2024-09-18T05:14:39.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640784+0000", 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694154+0000", 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369648999999998 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694217+0000", 2024-09-18T05:14:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2540999999999996e-05 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694277+0000", 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0671999999999998e-05 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.381 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:39.383 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:39.383 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-18T05:14:39.383 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:39.377+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:39.484 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:39.478+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:39.553 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:39.553 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:39.553 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:39.553 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:39.570 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:39.610 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:39.606+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:39.686 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:39.685+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:39.707 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:39.707 INFO:teuthology.orchestra.run.smithi017.stdout:3304 write 0x1371d7d thru 0x1377176 (0x53fa bytes) 2024-09-18T05:14:39.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:39.737 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:39.737 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:39.737 INFO:teuthology.orchestra.run.smithi017.stdout:3306 writesame 0x208250a thru 0x208c9ca data_size 0x11(0xa4c1 bytes) 2024-09-18T05:14:39.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:39.759 INFO:teuthology.orchestra.run.smithi017.stdout:3307 punch from 0x209bdb7 to 0x20a5174, (0x93bd bytes) 2024-09-18T05:14:39.759 INFO:teuthology.orchestra.run.smithi017.stdout:3308 write 0x30e2d1a thru 0x30f042e (0xd715 bytes) 2024-09-18T05:14:39.781 INFO:teuthology.orchestra.run.smithi017.stdout:3309 punch from 0xa4c25a4 to 0xa4c9abf, (0x751b bytes) 2024-09-18T05:14:39.781 INFO:teuthology.orchestra.run.smithi017.stdout:3310 write 0xe339912 thru 0xe340bb4 (0x72a3 bytes) 2024-09-18T05:14:39.786 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:39.781+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:39.787 INFO:teuthology.orchestra.run.smithi017.stdout:3311 punch from 0x9b8bdbc to 0x9b953df, (0x9623 bytes) 2024-09-18T05:14:39.787 INFO:teuthology.orchestra.run.smithi017.stdout:3312 write 0xcf235f5 thru 0xcf2e286 (0xac92 bytes) 2024-09-18T05:14:39.793 INFO:teuthology.orchestra.run.smithi017.stdout:3314 punch from 0x69945d8 to 0x69a3e77, (0xf89f bytes) 2024-09-18T05:14:39.795 INFO:teuthology.orchestra.run.smithi017.stdout:3315 trunc from 0xe355d05 to 0xd20f42d 2024-09-18T05:14:39.826 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:39.826 INFO:teuthology.orchestra.run.smithi017.stdout:3318 read 0x9e23c28 thru 0x9e23d1a (0xf3 bytes) 2024-09-18T05:14:39.841 INFO:teuthology.orchestra.run.smithi017.stdout:3319 trunc from 0xd20f42d to 0x47f28a2 2024-09-18T05:14:39.863 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:39.863 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:39.863 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:14:39.863 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:39.883 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-18T05:14:39.896 INFO:teuthology.orchestra.run.smithi017.stdout:3320 trunc from 0x47f28a2 to 0x76692a1 2024-09-18T05:14:39.907 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:39.907 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.674393338999998, 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.908 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:39.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.913 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.674325729000003, 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:39.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.674278342999997, 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:39.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:39.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.674232936999999, 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:39.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.929 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.674187646999997, 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.930 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:39.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.672553096000001, 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:39.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:39.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.672500777000003, 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:39.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:39.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:39.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:39.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:39.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.672383134, 2024-09-18T05:14:39.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:39.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:39.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:39.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:39.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:39.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:39.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.672321214999997, 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:39.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.672262795000002, 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.672209168999998, 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.963 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:39.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.672162106000002, 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.672102027000001, 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:39.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:39.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.672041739999997, 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:39.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.671974423999998, 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:39.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:39.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.671925821000002, 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:39.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:39.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.671852201999997, 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:39.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:39.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:39.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.671778719000002, 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:39.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:40.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.671722129000003, 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:40.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:40.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:40.009 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.671675997000001, 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:40.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:40.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.014 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:40.015 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:39.925+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:40.016 INFO:teuthology.orchestra.run.smithi017.stdout:3321 writesame 0x96032cd thru 0x960733a data_size 0x3(0x406e bytes) 2024-09-18T05:14:40.016 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:40.016 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:40.016 INFO:teuthology.orchestra.run.smithi017.stdout:3324 write 0xb7a4f52 thru 0xb7a4ff9 (0xa8 bytes) 2024-09-18T05:14:40.017 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:40.019 INFO:teuthology.orchestra.run.smithi017.stdout:3326 read 0x79c2fe8 thru 0x79d2329 (0xf342 bytes) 2024-09-18T05:14:40.019 INFO:teuthology.orchestra.run.smithi017.stdout:3327 write 0x875107 thru 0x87ce13 (0x7d0d bytes) 2024-09-18T05:14:40.019 INFO:teuthology.orchestra.run.smithi017.stdout:3328 write 0x503295e thru 0x5041445 (0xeae8 bytes) 2024-09-18T05:14:40.019 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3331 writesame 0xedbc4e5 thru 0xedc43c1 data_size 0x1(0x7edd bytes) 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3332 read 0x10c26ba thru 0x10cdefd (0xb844 bytes) 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3333 write 0xb53fd3e thru 0xb54974e (0x9a11 bytes) 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3334 write 0x94f911f thru 0x9500ede (0x7dc0 bytes) 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3336 writesame 0xaa4450f thru 0xaa47768 data_size 0x5(0x325a bytes) 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3337 write 0x1dd632a thru 0x1de1f9e (0xbc75 bytes) 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3338 writesame 0x5192892 thru 0x519a040 data_size 0x7(0x77af bytes) 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3339 writesame 0xce07e58 thru 0xce09dd6 data_size 0x1(0x1f7f bytes) 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3342 write 0xcc4a194 thru 0xcc536d3 (0x9540 bytes) 2024-09-18T05:14:40.020 INFO:teuthology.orchestra.run.smithi017.stdout:3343 trunc from 0xedc43c2 to 0x20a3725 2024-09-18T05:14:40.021 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:40.010+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:40.040 INFO:teuthology.orchestra.run.smithi017.stdout:3344 read 0x12c79bf thru 0x12d396e (0xbfb0 bytes) 2024-09-18T05:14:40.060 INFO:teuthology.orchestra.run.smithi017.stdout:3345 writesame 0x639851d thru 0x6399d34 data_size 0xc(0x1818 bytes) 2024-09-18T05:14:40.062 INFO:teuthology.orchestra.run.smithi017.stdout:3346 write 0x3316a27 thru 0x331ef29 (0x8503 bytes) 2024-09-18T05:14:40.065 INFO:teuthology.orchestra.run.smithi017.stdout:3347 writesame 0x55ece54 thru 0x55f49f8 data_size 0x3(0x7ba5 bytes) 2024-09-18T05:14:40.072 INFO:teuthology.orchestra.run.smithi017.stdout:3350 punch from 0x1129525 to 0x112be0a, (0x28e5 bytes) 2024-09-18T05:14:40.072 INFO:teuthology.orchestra.run.smithi017.stdout:3351 punch from 0x3be68d3 to 0x3bf43c0, (0xdaed bytes) 2024-09-18T05:14:40.089 INFO:teuthology.orchestra.run.smithi017.stdout:3352 writesame 0x8eccb62 thru 0x8ed0df3 data_size 0x1(0x4292 bytes) 2024-09-18T05:14:40.089 INFO:teuthology.orchestra.run.smithi017.stdout:3353 read 0x13c4f2a thru 0x13c5b26 (0xbfd bytes) 2024-09-18T05:14:40.092 INFO:teuthology.orchestra.run.smithi017.stdout:3354 read 0x4b37001 thru 0x4b42152 (0xb152 bytes) 2024-09-18T05:14:40.116 INFO:teuthology.orchestra.run.smithi017.stdout:3355 writesame 0x9a3c6ce thru 0x9a471d4 data_size 0x1(0xab07 bytes) 2024-09-18T05:14:40.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:40.110+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:40.125 INFO:teuthology.orchestra.run.smithi017.stdout:3356 trunc from 0x9a471d5 to 0x407f8e5 2024-09-18T05:14:40.139 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:40.160 INFO:teuthology.orchestra.run.smithi017.stdout:3359 writesame 0xa3f1988 thru 0xa3fab70 data_size 0x1(0x91e9 bytes) 2024-09-18T05:14:40.160 INFO:teuthology.orchestra.run.smithi017.stdout:3360 punch from 0x252269f to 0x252a852, (0x81b3 bytes) 2024-09-18T05:14:40.161 INFO:teuthology.orchestra.run.smithi017.stdout:3361 writesame 0x22d33f0 thru 0x22e2112 data_size 0x1(0xed23 bytes) 2024-09-18T05:14:40.174 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:40.174 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:40.174 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:40.174 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:40.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:40.216 INFO:teuthology.orchestra.run.smithi017.stdout:3362 punch from 0x8006efe to 0x80133e6, (0xc4e8 bytes) 2024-09-18T05:14:40.216 INFO:teuthology.orchestra.run.smithi017.stdout:3363 write 0x845b7fc thru 0x8460f85 (0x578a bytes) 2024-09-18T05:14:40.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:40.214+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:40.319 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:40.313+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:40.341 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:40.341 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:40.341 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:40.341 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:40.341 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:40.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:40.419 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:40.414+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:40.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:40.484 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.657659526000003, 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:9001 3.4 e29/22 3:224b1375:::rbd_data.118beb25b049.0000000000000128:head v 29'42, mlcod=29'40)", 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.518135309999998, 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002309742, 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961959+0000", 2024-09-18T05:14:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962023+0000", 2024-09-18T05:14:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3678999999999998e-05 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962057+0000", 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4606e-05 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962078+0000", 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1109999999999999e-05 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962204+0000", 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125306 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962271+0000", 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7009999999999997e-05 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964181+0000", 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019100619999999999 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964271+0000", 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9819000000000002e-05 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.664021783000003, 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:14:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.661404986000001, 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:14:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:14:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:14:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:14:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16290 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'52, mlcod=32'49)", 2024-09-18T05:14:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.660314282000002, 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023378159999999999, 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819780+0000", 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819796+0000", 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325999999999999e-05 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819826+0000", 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9583000000000001e-05 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819845+0000", 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8597000000000002e-05 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819950+0000", 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105356 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820003+0000", 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3295999999999999e-05 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822018+0000", 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020151779999999998 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822120+0000", 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101316 2024-09-18T05:14:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.578869474000001, 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:14:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.204331781, 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:14:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:14:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17196 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'90, mlcod=32'86)", 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.196445199000003, 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023459290000000001, 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283650+0000", 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283663+0000", 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2697999999999999e-05 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283682+0000", 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9012999999999999e-05 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283691+0000", 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7720000000000006e-06 2024-09-18T05:14:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283777+0000", 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5923999999999999e-05 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283830+0000", 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2320000000000001e-05 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285942+0000", 2024-09-18T05:14:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002112039 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285997+0000", 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5322000000000003e-05 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21891 3.0 e36/22 3:04d4c8a4:::rbd_data.118ba5d0bdf6.0000000000000259:head v 36'100, mlcod=36'98)", 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.010323315999997, 2024-09-18T05:14:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022905260000000002, 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469771+0000", 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469789+0000", 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.821e-05 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469821+0000", 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1335999999999999e-05 2024-09-18T05:14:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469839+0000", 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-05 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469944+0000", 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104576 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469996+0000", 2024-09-18T05:14:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2102999999999999e-05 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471954+0000", 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019575980000000001 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472063+0000", 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010984600000000001 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21892 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'65, mlcod=36'62)", 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.009359289999999, 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023311389999999999, 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470735+0000", 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470750+0000", 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-18T05:14:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470788+0000", 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7252999999999997e-05 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470806+0000", 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8105999999999999e-05 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470949+0000", 2024-09-18T05:14:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014359600000000001 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471048+0000", 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8888999999999995e-05 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472956+0000", 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019074820000000001 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.473068+0000", 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011240599999999999 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.513402598999999, 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:14:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:45232 3.9 e50/22 3:9465da8c:::rbd_data.118bbcb4fc94.000000000000000d:head v 50'101, mlcod=49'99)", 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.080680187, 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364489, 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399415+0000", 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399425+0000", 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5429999999999999e-06 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399455+0000", 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9887e-05 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399472+0000", 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6821e-05 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399619+0000", 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146971 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399693+0000", 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4004999999999994e-05 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401682+0000", 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019894869999999999 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401781+0000", 2024-09-18T05:14:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8471e-05 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47581 3.4 e52/22 3:24a94b22:::rbd_data.118ba98b16f7.0000000000000011:head v 52'130, mlcod=52'128)", 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.815430040000001, 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033849169999999999, 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664664+0000", 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664684+0000", 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0044e-05 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664730+0000", 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6097000000000003e-05 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664751+0000", 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1024000000000001e-05 2024-09-18T05:14:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664942+0000", 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190538 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664998+0000", 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6786999999999997e-05 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.667951+0000", 2024-09-18T05:14:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029529040000000001 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668051+0000", 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9866999999999998e-05 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47585 3.4 e52/22 3:277480c1:::rbd_data.118ba98b16f7.0000000000000015:head v 52'131, mlcod=52'128)", 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.814684813, 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027129139999999999, 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665410+0000", 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665425+0000", 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.499e-05 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665451+0000", 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5936999999999999e-05 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665468+0000", 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7430000000000001e-05 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665537+0000", 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8703999999999998e-05 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665585+0000", 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8060999999999999e-05 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668061+0000", 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024756779999999998 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668124+0000", 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3676999999999994e-05 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47704 3.0 e52/22 3:04568dbb:::rbd_data.118ba98b16f7.000000000000005e:head v 52'153, mlcod=52'151)", 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.876932+0000", 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.603164371, 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002262773, 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876932+0000", 2024-09-18T05:14:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876932+0000", 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876930+0000", 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876987+0000", 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7064000000000001e-05 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877022+0000", 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5750000000000002e-05 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877038+0000", 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5509999999999999e-05 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877147+0000", 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108798 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877203+0000", 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6153999999999998e-05 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.879122+0000", 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00191877 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.879195+0000", 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3073999999999999e-05 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50861 3.9 e57/22 3:937da5aa:::rbd_data.118bea12bf49.0000000000000015:head v 57'133, mlcod=56'130)", 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.1823605600000002, 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033859879999999999, 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297735+0000", 2024-09-18T05:14:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297748+0000", 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3464e-05 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297799+0000", 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0232999999999998e-05 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297821+0000", 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2334e-05 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298165+0000", 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034369199999999999 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298223+0000", 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8457e-05 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301032+0000", 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028085050000000002 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301122+0000", 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0112999999999996e-05 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50880 3.0 e57/22 3:045763ee:::rbd_data.118bea12bf49.0000000000000073:head v 57'214, mlcod=57'211)", 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.1711671729999997, 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003490136, 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308926+0000", 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308950+0000", 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3453000000000001e-05 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309001+0000", 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0736999999999999e-05 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309022+0000", 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1437000000000002e-05 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309166+0000", 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014386100000000001 2024-09-18T05:14:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309242+0000", 2024-09-18T05:14:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6459999999999996e-05 2024-09-18T05:14:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312298+0000", 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030560700000000001 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312419+0000", 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120874 2024-09-18T05:14:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50883 3.4 e57/22 3:227c9179:::rbd_data.118bea12bf49.00000000000000cb:head v 57'152, mlcod=56'149)", 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.1678264309999999, 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026019060000000002, 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312268+0000", 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312286+0000", 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7756000000000001e-05 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312325+0000", 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9029999999999997e-05 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312361+0000", 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6303999999999997e-05 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312471+0000", 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010963099999999999 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312527+0000", 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6227000000000002e-05 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314758+0000", 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022307469999999999 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314872+0000", 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011420400000000001 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50934 3.4 e57/22 3:255d0e8e:::rbd_data.118bea12bf49.0000000000000001:head v 57'154, mlcod=56'150)", 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.1492788320000002, 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028140449999999998, 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330815+0000", 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330831+0000", 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5756e-05 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330862+0000", 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1180999999999998e-05 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330882+0000", 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0457000000000001e-05 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331013+0000", 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013070399999999999 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331082+0000", 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9369999999999995e-05 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333550+0000", 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024677420000000002 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333631+0000", 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1230999999999995e-05 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50936 3.9 e57/22 3:907835c8:::rbd_data.118bea12bf49.0000000000000003:head v 57'135, mlcod=56'131)", 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.1462697730000002, 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024933360000000001, 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333824+0000", 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333844+0000", 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9562999999999999e-05 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333873+0000", 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9487000000000001e-05 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333891+0000", 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7787000000000001e-05 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334003+0000", 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011215 2024-09-18T05:14:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334057+0000", 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3857999999999998e-05 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336229+0000", 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021715229999999999 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336320+0000", 2024-09-18T05:14:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1124000000000004e-05 2024-09-18T05:14:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:40.578 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:40.579 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:40.580 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:40.577+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:40.606 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:40.606 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:40.623 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:40.639 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:40.655 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:40.656 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:40.676 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:40.676 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:40.680 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:40.677+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:40.696 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:40.697 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:40.716 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:40.717 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-18T05:14:40.722 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:40.722 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:40.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:40.737 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:40.802 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:40.798+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:40.857 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:40.857 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:40.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:40.915 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:40.910+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:40.983 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:40.978+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:41.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:41.095 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2024-09-18T05:14:41.103 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:41.101+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:41.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:14:41.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-18T05:14:41.184 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:41.181+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:41.194 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:41.194 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:41.208 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:41.284 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:41.278+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:41.375 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:41.375 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:41.386 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:41.381+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:41.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:41.518 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:41.513+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:41.570 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:41.570 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:41.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:41.589 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:41.582+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:41.690 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:41.685+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:41.756 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:41.756 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:41.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:41.812 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:41.809+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:41.892 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:41.889+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:41.932 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:41.932 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:41.946 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:41.993 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:41.986+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:42.095 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:42.090+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:14:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2024-09-18T05:14:42.118 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:42.118 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:42.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-18T05:14:42.132 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:42.196 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:42.193+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:42.249 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:42.250 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:42.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:42.297 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:42.290+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:42.399 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:42.394+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:42.426 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:42.426 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:42.440 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:42.500 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:42.494+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:42.551 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:42.551 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:42.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:42.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:42.594+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:42.672 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:42.672 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:42.685 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:14:42.732 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:42.729+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:42.753 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:42.753 INFO:teuthology.orchestra.run.smithi017.stdout:3365 writesame 0x274aee2 thru 0x2759122 data_size 0x2b(0xe241 bytes) 2024-09-18T05:14:42.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:42.775 INFO:teuthology.orchestra.run.smithi017.stdout:3366 writesame 0xcd18b89 thru 0xcd24b58 data_size 0xba(0xbfd0 bytes) 2024-09-18T05:14:42.775 INFO:teuthology.orchestra.run.smithi017.stdout:3367 write 0x56dee thru 0x602bc (0x94cf bytes) 2024-09-18T05:14:42.778 INFO:teuthology.orchestra.run.smithi017.stdout:3368 write 0x36e6ca3 thru 0x36f087a (0x9bd8 bytes) 2024-09-18T05:14:42.781 INFO:teuthology.orchestra.run.smithi017.stdout:3369 read 0x6dd0b41 thru 0x6dd9fb8 (0x9478 bytes) 2024-09-18T05:14:42.793 INFO:teuthology.orchestra.run.smithi017.stdout:3370 trunc from 0xcd24b59 to 0x7346de8 2024-09-18T05:14:42.802 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:42.797+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:42.808 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:42.808 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:42.819 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:14:42.822 INFO:teuthology.orchestra.run.smithi017.stdout:3374 trunc from 0x7346de8 to 0xdd51d6a 2024-09-18T05:14:42.832 INFO:teuthology.orchestra.run.smithi017.stdout:3375 read 0x4a337f6 thru 0x4a3eb23 (0xb32e bytes) 2024-09-18T05:14:42.833 INFO:teuthology.orchestra.run.smithi017.stdout:3376 writesame 0xc7e570c thru 0xc7e7e5b data_size 0x25(0x2750 bytes) 2024-09-18T05:14:42.837 INFO:teuthology.orchestra.run.smithi017.stdout:3377 writesame 0xac138ed thru 0xac15c64 data_size 0x14(0x2378 bytes) 2024-09-18T05:14:42.842 INFO:teuthology.orchestra.run.smithi017.stdout:3378 writesame 0xd780944 thru 0xd7831a9 data_size 0x1(0x2866 bytes) 2024-09-18T05:14:42.855 INFO:teuthology.orchestra.run.smithi017.stdout:3379 punch from 0xb546d6f to 0xb552275, (0xb506 bytes) 2024-09-18T05:14:42.855 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:42.855 INFO:teuthology.orchestra.run.smithi017.stdout:3383 write 0xaa08b4a thru 0xaa173ae (0xe865 bytes) 2024-09-18T05:14:42.870 INFO:teuthology.orchestra.run.smithi017.stdout:3384 write 0xe156aea thru 0xe16643a (0xf951 bytes) 2024-09-18T05:14:42.878 INFO:teuthology.orchestra.run.smithi017.stdout:3385 writesame 0x13bee16 thru 0x13c84d6 data_size 0x1(0x96c1 bytes) 2024-09-18T05:14:42.903 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:42.898+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:42.905 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:42.905 INFO:teuthology.orchestra.run.smithi017.stdout:3387 punch from 0xa8e8aed to 0xa8ee3bc, (0x58cf bytes) 2024-09-18T05:14:42.905 INFO:teuthology.orchestra.run.smithi017.stdout:3388 write 0x74db77d thru 0x74e1787 (0x600b bytes) 2024-09-18T05:14:42.918 INFO:teuthology.orchestra.run.smithi017.stdout:3390 trunc from 0xe16643b to 0xa7cb554 2024-09-18T05:14:42.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:42.942 INFO:teuthology.orchestra.run.smithi017.stdout:3391 write 0xb87d89d thru 0xb88b078 (0xd7dc bytes) 2024-09-18T05:14:42.944 INFO:teuthology.orchestra.run.smithi017.stdout:3392 punch from 0xa6df860 to 0xa6e793a, (0x80da bytes) 2024-09-18T05:14:42.944 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:42.945 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:42.945 INFO:teuthology.orchestra.run.smithi017.stdout:3393 write 0xb42b1f1 thru 0xb43b10b (0xff1b bytes) 2024-09-18T05:14:42.946 INFO:teuthology.orchestra.run.smithi017.stdout:3394 clone 25 order 23 su 262144 sc 11 2024-09-18T05:14:42.961 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:42.977 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:42.978 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:42.988 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:42.988 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:42.997 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:42.997 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:43.001 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:43.003 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:42.998+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:43.017 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:43.017 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:43.037 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:43.037 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:43.055 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:43.104 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:43.101+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:43.115 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2024-09-18T05:14:43.130 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:43.130 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:43.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-18T05:14:43.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:43.239 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:43.234+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:43.305 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:43.298+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:43.310 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:43.311 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:43.311 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:43.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:43.411 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:43.406+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:43.490 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55852 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8491842389999995, 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052798855999999998, 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55852 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636907+0000", 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636913+0000", 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9170000000000003e-06 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636927+0000", 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4080000000000001e-05 2024-09-18T05:14:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636938+0000", 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0251000000000001e-05 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689571+0000", 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052632828999999999 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689634+0000", 2024-09-18T05:14:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3139000000000007e-05 2024-09-18T05:14:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689707+0000", 2024-09-18T05:14:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3511999999999997e-05 2024-09-18T05:14:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55853 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8142848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8491417610000003, 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052962084999999999, 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55853 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636950+0000", 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636957+0000", 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636994+0000", 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6879999999999999e-05 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637005+0000", 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1430000000000001e-05 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689750+0000", 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052744345999999998 2024-09-18T05:14:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689837+0000", 2024-09-18T05:14:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7581000000000001e-05 2024-09-18T05:14:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689913+0000", 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5797999999999995e-05 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55854 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8159232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8490774160000001, 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053068918, 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55854 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637014+0000", 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637020+0000", 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5149999999999997e-06 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637034+0000", 2024-09-18T05:14:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4696e-05 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637045+0000", 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0334e-05 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689962+0000", 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052916773 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690024+0000", 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2009999999999998e-05 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690084+0000", 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0485000000000001e-05 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55855 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8490368510000001, 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053239090000000003, 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55855 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637055+0000", 2024-09-18T05:14:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637060+0000", 2024-09-18T05:14:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9139999999999999e-06 2024-09-18T05:14:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637080+0000", 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9873000000000001e-05 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637091+0000", 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0852999999999999e-05 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690124+0000", 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053033736999999997 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690217+0000", 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2263999999999996e-05 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690295+0000", 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8193000000000002e-05 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55856 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8489916830000004, 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053363617000000002, 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55856 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637100+0000", 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637106+0000", 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637120+0000", 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4885999999999999e-05 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637131+0000", 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.064e-05 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690344+0000", 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053212832000000002 2024-09-18T05:14:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690404+0000", 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0516999999999997e-05 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690465+0000", 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0132e-05 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55857 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8489519149999998, 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053529896, 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55857 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637140+0000", 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637145+0000", 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637158+0000", 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3465999999999999e-05 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637168+0000", 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4919999999999999e-06 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690506+0000", 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053337801999999997 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690595+0000", 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8925000000000007e-05 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690671+0000", 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5983999999999996e-05 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55858 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8224768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8489145999999996, 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053665767000000003, 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55858 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637177+0000", 2024-09-18T05:14:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637182+0000", 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.028e-06 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637197+0000", 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4341999999999999e-05 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637207+0000", 2024-09-18T05:14:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0345e-05 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690719+0000", 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053511982 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690783+0000", 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3683999999999995e-05 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690844+0000", 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1116000000000002e-05 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55859 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8241152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8488764589999995, 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053835149999999998, 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55859 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637215+0000", 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637221+0000", 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4879999999999998e-06 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637239+0000", 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7665000000000001e-05 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637252+0000", 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3735e-05 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690887+0000", 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053635163 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690977+0000", 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9452999999999999e-05 2024-09-18T05:14:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691051+0000", 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4374000000000003e-05 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55860 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8488050439999997, 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053934739000000002, 2024-09-18T05:14:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55860 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637287+0000", 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637293+0000", 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637309+0000", 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6214000000000001e-05 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637322+0000", 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2413e-05 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691101+0000", 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053779456000000003 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691164+0000", 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2199000000000005e-05 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691222+0000", 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8758999999999998e-05 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55861 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8273920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8487625860000003, 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054100101999999997, 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55861 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637329+0000", 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637333+0000", 2024-09-18T05:14:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2619999999999999e-06 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637340+0000", 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5279999999999998e-06 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637347+0000", 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691264+0000", 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916886999999997 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691353+0000", 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9560000000000003e-05 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691430+0000", 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6715e-05 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55862 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8290304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.848727641, 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054235677000000003, 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55862 2024-09-18T05:14:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637364+0000", 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637368+0000", 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637378+0000", 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0545e-05 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637384+0000", 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.592e-06 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691479+0000", 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054095022 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691540+0000", 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0958999999999997e-05 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691601+0000", 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0976e-05 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55863 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8306688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8487036940000001, 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054421542000000003, 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55863 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637388+0000", 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637391+0000", 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637398+0000", 2024-09-18T05:14:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8249999999999999e-06 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637403+0000", 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3879999999999999e-06 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691642+0000", 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054238572999999998 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691732+0000", 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0413000000000003e-05 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691810+0000", 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8079999999999998e-05 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55864 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.848017488, 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053905402999999998, 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55864 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637413+0000", 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9993382 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638082+0000", 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066932099999999996 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638103+0000", 2024-09-18T05:14:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:14:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638115+0000", 2024-09-18T05:14:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2935000000000001e-05 2024-09-18T05:14:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691859+0000", 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053743055999999997 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691920+0000", 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1087999999999995e-05 2024-09-18T05:14:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691980+0000", 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0853999999999997e-05 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55865 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8339456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8479650200000002, 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054056874999999997, 2024-09-18T05:14:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55865 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638127+0000", 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638133+0000", 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7869999999999998e-06 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638146+0000", 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3030000000000001e-05 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638156+0000", 2024-09-18T05:14:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0523000000000001e-05 2024-09-18T05:14:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692022+0000", 2024-09-18T05:14:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053866149000000002 2024-09-18T05:14:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692109+0000", 2024-09-18T05:14:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6428000000000007e-05 2024-09-18T05:14:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692184+0000", 2024-09-18T05:14:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5760999999999995e-05 2024-09-18T05:14:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55935 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7397376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8454561979999999, 2024-09-18T05:14:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052706586, 2024-09-18T05:14:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55935 2024-09-18T05:14:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640635+0000", 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640640+0000", 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-18T05:14:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640649+0000", 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8130000000000007e-06 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640655+0000", 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1739999999999999e-06 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693173+0000", 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518675000000001 2024-09-18T05:14:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693264+0000", 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0859999999999994e-05 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693343+0000", 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8870999999999998e-05 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55936 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7413760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8454333519999997, 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052856933000000002, 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55936 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640661+0000", 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3479999999999998e-06 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640672+0000", 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0424999999999999e-05 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640677+0000", 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693392+0000", 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052714446999999998 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693456+0000", 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4426999999999998e-05 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693516+0000", 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0154e-05 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55937 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7430144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8454107720000001, 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053045085999999998, 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55937 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640681+0000", 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640685+0000", 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0799999999999999e-06 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640700+0000", 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4768e-05 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640707+0000", 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.81e-06 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693559+0000", 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052852022999999998 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693648+0000", 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8908999999999999e-05 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693727+0000", 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9123999999999997e-05 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55938 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7446528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8453807170000003, 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053184652999999998, 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55938 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640711+0000", 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640714+0000", 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0070000000000002e-06 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640721+0000", 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640728+0000", 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6479999999999997e-06 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693775+0000", 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047086 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693836+0000", 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1513999999999994e-05 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693897+0000", 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0315000000000001e-05 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55939 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7462912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8453570189999997, 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369857999999999, 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55939 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640735+0000", 2024-09-18T05:14:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640739+0000", 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-06 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640750+0000", 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0668e-05 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640755+0000", 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4299999999999997e-06 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693938+0000", 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053182462 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694028+0000", 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0781999999999999e-05 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694105+0000", 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049e-05 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55940 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7479296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.8453327689999997, 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053517447000000003, 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55940 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640759+0000", 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640769+0000", 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4730000000000006e-06 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640779+0000", 2024-09-18T05:14:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9899999999999992e-06 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640784+0000", 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694154+0000", 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369648999999998 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694217+0000", 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2540999999999996e-05 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694277+0000", 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0671999999999998e-05 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:43.585 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:43.587 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:43.587 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:43.585+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:43.688 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:43.685+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:43.760 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:43.760 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:43.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:43.789 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:43.785+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:43.891 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:43.889+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:43.901 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:43.901 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:43.901 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:43.901 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:43.901 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:43.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:43.991 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:43.986+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.803574933999997, 2024-09-18T05:14:44.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.042 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.803507324000002, 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:44.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.047 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.803459938000003, 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:44.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:44.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.803414531999998, 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:44.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.056 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.803369242000002, 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:44.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:44.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801734691, 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:44.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801682372000002, 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:44.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801564728999999, 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:44.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:44.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801502810000002, 2024-09-18T05:14:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:44.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:44.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:44.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:44.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.80144439, 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:44.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:44.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801390763999997, 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.090 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801343701, 2024-09-18T05:14:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:44.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:44.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801283622, 2024-09-18T05:14:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:44.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:44.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801223335000003, 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:44.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:44.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:44.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:44.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:44.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801156018999997, 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:44.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:44.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:44.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:44.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:44.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:44.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:44.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:44.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:44.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:44.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.119 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.119 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.119 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:44.119 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801107416000001, 2024-09-18T05:14:44.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:44.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:44.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:44.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.801033797000002, 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:44.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:44.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.129 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.129 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.129 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.800960314000001, 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:44.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:44.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:44.134 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.134 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.134 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.134 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.134 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:44.134 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.800903724000001, 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:44.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.800857592, 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:44.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.144 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.144 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.144 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:44.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:14:44.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:44.147 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.3 to 1 (10000) 2024-09-18T05:14:44.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-18T05:14:44.147 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:44.138+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:44.180 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone24 from 0xb88b079 (overlap 0x20a3725) to 0x3438b6 2024-09-18T05:14:44.246 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:44.241+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:44.299 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-18T05:14:44.322 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:44.322 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:44.322 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:44.322 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:44.347 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:44.342+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:44.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:44.448 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:44.445+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:44.538 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:44.538 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:44.538 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:44.539 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:44.539 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:44.549 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:44.545+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:44.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:44.650 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:44.645+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:44.682 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.854967555000002, 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:14:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:14:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:9001 3.4 e29/22 3:224b1375:::rbd_data.118beb25b049.0000000000000128:head v 29'42, mlcod=29'40)", 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.715443338999997, 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002309742, 2024-09-18T05:14:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961959+0000", 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962023+0000", 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3678999999999998e-05 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962057+0000", 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4606e-05 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962078+0000", 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1109999999999999e-05 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962204+0000", 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125306 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962271+0000", 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7009999999999997e-05 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964181+0000", 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019100619999999999 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964271+0000", 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9819000000000002e-05 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.861329812000001, 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:14:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:14:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.858713014999999, 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16290 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'52, mlcod=32'49)", 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.857622311, 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023378159999999999, 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819780+0000", 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819796+0000", 2024-09-18T05:14:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325999999999999e-05 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819826+0000", 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9583000000000001e-05 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819845+0000", 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8597000000000002e-05 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819950+0000", 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105356 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820003+0000", 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3295999999999999e-05 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822018+0000", 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020151779999999998 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822120+0000", 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101316 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.776177503, 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.401639809999999, 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17196 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'90, mlcod=32'86)", 2024-09-18T05:14:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.393753228000001, 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023459290000000001, 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283650+0000", 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283663+0000", 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2697999999999999e-05 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283682+0000", 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9012999999999999e-05 2024-09-18T05:14:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283691+0000", 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7720000000000006e-06 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283777+0000", 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5923999999999999e-05 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283830+0000", 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2320000000000001e-05 2024-09-18T05:14:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285942+0000", 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002112039 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285997+0000", 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5322000000000003e-05 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21891 3.0 e36/22 3:04d4c8a4:::rbd_data.118ba5d0bdf6.0000000000000259:head v 36'100, mlcod=36'98)", 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.207631345000003, 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022905260000000002, 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469771+0000", 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469789+0000", 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.821e-05 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469821+0000", 2024-09-18T05:14:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1335999999999999e-05 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469839+0000", 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-05 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469944+0000", 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104576 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469996+0000", 2024-09-18T05:14:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2102999999999999e-05 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471954+0000", 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019575980000000001 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472063+0000", 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010984600000000001 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21892 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'65, mlcod=36'62)", 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.206667318999997, 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023311389999999999, 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470735+0000", 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470750+0000", 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470788+0000", 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7252999999999997e-05 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470806+0000", 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8105999999999999e-05 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470949+0000", 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014359600000000001 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471048+0000", 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8888999999999995e-05 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472956+0000", 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019074820000000001 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.473068+0000", 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011240599999999999 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.710710628000001, 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:14:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:45232 3.9 e50/22 3:9465da8c:::rbd_data.118bbcb4fc94.000000000000000d:head v 50'101, mlcod=49'99)", 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.277988216000001, 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364489, 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399415+0000", 2024-09-18T05:14:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399425+0000", 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5429999999999999e-06 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399455+0000", 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9887e-05 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399472+0000", 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6821e-05 2024-09-18T05:14:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399619+0000", 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146971 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399693+0000", 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4004999999999994e-05 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401682+0000", 2024-09-18T05:14:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019894869999999999 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401781+0000", 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8471e-05 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47581 3.4 e52/22 3:24a94b22:::rbd_data.118ba98b16f7.0000000000000011:head v 52'130, mlcod=52'128)", 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.012738068999999, 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033849169999999999, 2024-09-18T05:14:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664664+0000", 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664684+0000", 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0044e-05 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664730+0000", 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6097000000000003e-05 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664751+0000", 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1024000000000001e-05 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664942+0000", 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190538 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664998+0000", 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6786999999999997e-05 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.667951+0000", 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029529040000000001 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668051+0000", 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9866999999999998e-05 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47585 3.4 e52/22 3:277480c1:::rbd_data.118ba98b16f7.0000000000000015:head v 52'131, mlcod=52'128)", 2024-09-18T05:14:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.011992842, 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027129139999999999, 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665410+0000", 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665425+0000", 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.499e-05 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665451+0000", 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5936999999999999e-05 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665468+0000", 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7430000000000001e-05 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665537+0000", 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8703999999999998e-05 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665585+0000", 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8060999999999999e-05 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668061+0000", 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024756779999999998 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668124+0000", 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3676999999999994e-05 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47704 3.0 e52/22 3:04568dbb:::rbd_data.118ba98b16f7.000000000000005e:head v 52'153, mlcod=52'151)", 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.876932+0000", 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.8004724, 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002262773, 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876932+0000", 2024-09-18T05:14:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876932+0000", 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876930+0000", 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876987+0000", 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7064000000000001e-05 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877022+0000", 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5750000000000002e-05 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877038+0000", 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5509999999999999e-05 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877147+0000", 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108798 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877203+0000", 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6153999999999998e-05 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.879122+0000", 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00191877 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.879195+0000", 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3073999999999999e-05 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50861 3.9 e57/22 3:937da5aa:::rbd_data.118bea12bf49.0000000000000015:head v 57'133, mlcod=56'130)", 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.379668589, 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033859879999999999, 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297735+0000", 2024-09-18T05:14:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297748+0000", 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3464e-05 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297799+0000", 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0232999999999998e-05 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297821+0000", 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2334e-05 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298165+0000", 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034369199999999999 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298223+0000", 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8457e-05 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301032+0000", 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028085050000000002 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301122+0000", 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0112999999999996e-05 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50880 3.0 e57/22 3:045763ee:::rbd_data.118bea12bf49.0000000000000073:head v 57'214, mlcod=57'211)", 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.368475202000001, 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003490136, 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308926+0000", 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308950+0000", 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3453000000000001e-05 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309001+0000", 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0736999999999999e-05 2024-09-18T05:14:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309022+0000", 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1437000000000002e-05 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309166+0000", 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014386100000000001 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309242+0000", 2024-09-18T05:14:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6459999999999996e-05 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312298+0000", 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030560700000000001 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312419+0000", 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120874 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50883 3.4 e57/22 3:227c9179:::rbd_data.118bea12bf49.00000000000000cb:head v 57'152, mlcod=56'149)", 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.36513446, 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026019060000000002, 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312268+0000", 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312286+0000", 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7756000000000001e-05 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312325+0000", 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9029999999999997e-05 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312361+0000", 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6303999999999997e-05 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312471+0000", 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010963099999999999 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312527+0000", 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6227000000000002e-05 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314758+0000", 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022307469999999999 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314872+0000", 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011420400000000001 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50934 3.4 e57/22 3:255d0e8e:::rbd_data.118bea12bf49.0000000000000001:head v 57'154, mlcod=56'150)", 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.346586861, 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028140449999999998, 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330815+0000", 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330831+0000", 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5756e-05 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330862+0000", 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1180999999999998e-05 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330882+0000", 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0457000000000001e-05 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331013+0000", 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013070399999999999 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331082+0000", 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9369999999999995e-05 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333550+0000", 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024677420000000002 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333631+0000", 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1230999999999995e-05 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50936 3.9 e57/22 3:907835c8:::rbd_data.118bea12bf49.0000000000000003:head v 57'135, mlcod=56'131)", 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.343577802, 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024933360000000001, 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333824+0000", 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333844+0000", 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9562999999999999e-05 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333873+0000", 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9487000000000001e-05 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333891+0000", 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7787000000000001e-05 2024-09-18T05:14:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334003+0000", 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011215 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334057+0000", 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3857999999999998e-05 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336229+0000", 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021715229999999999 2024-09-18T05:14:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336320+0000", 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1124000000000004e-05 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:44.767 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:44.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:44.769 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:44.769 INFO:teuthology.orchestra.run.smithi017.stdout:3400 write 0x6d4fd58 thru 0x6d59ce3 (0x9f8c bytes) 2024-09-18T05:14:44.770 INFO:teuthology.orchestra.run.smithi017.stdout:3402 read 0x8479b22 thru 0x847c6e5 (0x2bc4 bytes) 2024-09-18T05:14:44.770 INFO:teuthology.orchestra.run.smithi017.stdout:3405 writesame 0x991c6ec thru 0x992b7e0 data_size 0x49(0xf0f5 bytes) 2024-09-18T05:14:44.770 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:44.765+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:44.775 INFO:teuthology.orchestra.run.smithi017.stdout:3406 punch from 0xa5f1161 to 0xa5fd24d, (0xc0ec bytes) 2024-09-18T05:14:44.775 INFO:teuthology.orchestra.run.smithi017.stdout:3407 read 0x155add7 thru 0x155ceaa (0x20d4 bytes) 2024-09-18T05:14:44.776 INFO:teuthology.orchestra.run.smithi017.stdout:3408 writesame 0x6cfd4fa thru 0x6d010fb data_size 0x2(0x3c02 bytes) 2024-09-18T05:14:44.803 INFO:teuthology.orchestra.run.smithi017.stdout:3409 writesame 0x6cb1d8c thru 0x6cc06aa data_size 0x39(0xe91f bytes) 2024-09-18T05:14:44.835 INFO:teuthology.orchestra.run.smithi017.stdout:3413 writesame 0xcca2344 thru 0xccae201 data_size 0xa(0xbebe bytes) 2024-09-18T05:14:44.842 INFO:teuthology.orchestra.run.smithi017.stdout:3414 read 0x644fbb4 thru 0x6453571 (0x39be bytes) 2024-09-18T05:14:44.842 INFO:teuthology.orchestra.run.smithi017.stdout:3415 write 0xb5494e7 thru 0xb5532a1 (0x9dbb bytes) 2024-09-18T05:14:44.850 INFO:teuthology.orchestra.run.smithi017.stdout:3416 writesame 0xaee4c2c thru 0xaee4df2 data_size 0x7(0x1c7 bytes) 2024-09-18T05:14:44.852 INFO:teuthology.orchestra.run.smithi017.stdout:3419 read 0x158c2f6 thru 0x1594934 (0x863f bytes) 2024-09-18T05:14:44.856 INFO:teuthology.orchestra.run.smithi017.stdout:3420 writesame 0x398edfa thru 0x3997c89 data_size 0x8(0x8e90 bytes) 2024-09-18T05:14:44.869 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:44.862+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:44.899 INFO:teuthology.orchestra.run.smithi017.stdout:3421 writesame 0xb8f6bc1 thru 0xb8fcd8c data_size 0x2(0x61cc bytes) 2024-09-18T05:14:44.902 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:44.902 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:44.902 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:44.902 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:44.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:44.918 INFO:teuthology.orchestra.run.smithi017.stdout:3422 trunc from 0xccae202 to 0x9552051 2024-09-18T05:14:44.969 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:44.965+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:44.989 INFO:teuthology.orchestra.run.smithi017.stdout:3424 read 0x529be4e thru 0x52a9095 (0xd248 bytes) 2024-09-18T05:14:44.990 INFO:teuthology.orchestra.run.smithi017.stdout:3425 write 0x75a0cee thru 0x75a1c2c (0xf3f bytes) 2024-09-18T05:14:44.992 INFO:teuthology.orchestra.run.smithi017.stdout:3426 read 0x350df8e thru 0x3512d94 (0x4e07 bytes) 2024-09-18T05:14:44.992 INFO:teuthology.orchestra.run.smithi017.stdout:3427 writesame 0x3577652 thru 0x35781b7 data_size 0x1(0xb66 bytes) 2024-09-18T05:14:45.019 INFO:teuthology.orchestra.run.smithi017.stdout:3432 read 0x12ef669 thru 0x12f23e1 (0x2d79 bytes) 2024-09-18T05:14:45.028 INFO:teuthology.orchestra.run.smithi017.stdout:3433 writesame 0x999972b thru 0x99a23c5 data_size 0x5(0x8c9b bytes) 2024-09-18T05:14:45.030 INFO:teuthology.orchestra.run.smithi017.stdout:3435 write 0x3a5f8cd thru 0x3a68deb (0x951f bytes) 2024-09-18T05:14:45.068 INFO:teuthology.orchestra.run.smithi017.stdout:3436 trunc from 0x99a23c6 to 0x2a621a 2024-09-18T05:14:45.070 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:45.065+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:45.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:45.079 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:45.080 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:45.080 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:45.080 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:45.080 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:45.103 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:45.129 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:14:45.130 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.4 to 1 (10000) 2024-09-18T05:14:45.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-18T05:14:45.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:45.206+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:45.214 INFO:teuthology.orchestra.run.smithi017.stdout:3438 read 0x1ccf29 thru 0x1d3c01 (0x6cd9 bytes) 2024-09-18T05:14:45.238 INFO:teuthology.orchestra.run.smithi017.stdout:3439 write 0xbc5b1dd thru 0xbc69259 (0xe07d bytes) 2024-09-18T05:14:45.240 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:45.249 INFO:teuthology.orchestra.run.smithi017.stdout:3441 trunc from 0xbc6925a to 0x637e8b9 2024-09-18T05:14:45.258 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:45.263 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:45.263 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:45.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:45.263 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:45.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.263 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.263 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:45.263 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.348544554, 2024-09-18T05:14:45.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:14:45.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:14:45.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:14:45.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:14:45.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.268 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.348513611000001, 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:45.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:45.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:14:45.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.348488047000004, 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:45.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:14:45.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.348463330999998, 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.283 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.284 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.284 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:45.284 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.348437097000001, 2024-09-18T05:14:45.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:14:45.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:14:45.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:14:45.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:14:45.288 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.348408188000001, 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.289 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:45.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.348384357999997, 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:14:45.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:14:45.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:14:45.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:14:45.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.348359881999997, 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.299 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:14:45.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:14:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.348242083000002, 2024-09-18T05:14:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:45.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:45.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:14:45.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.345250128000004, 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.308 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.345172066000003, 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:14:45.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.345140778999998, 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:14:45.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:45.321 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.345114766000002, 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.345086993000002, 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:14:45.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:14:45.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.34506193, 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.331 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:14:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.335 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.345036899999997, 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:14:45.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.340912572000001, 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:14:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:45.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:45.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:45.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:14:45.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:14:45.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:14:45.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.346 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.346 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.346 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:45.346 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.340892027000002, 2024-09-18T05:14:45.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:14:45.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:14:45.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:14:45.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:14:45.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.340872345000001, 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.352 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:14:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:45.356 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.0728008980000001, 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:14:45.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:45.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:14:45.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:14:45.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:45.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:45.363 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:45.364 INFO:teuthology.orchestra.run.smithi017.stdout:3442 read 0x820e01 thru 0x824273 (0x3473 bytes) 2024-09-18T05:14:45.364 INFO:teuthology.orchestra.run.smithi017.stdout:3444 read 0x2f5bf9b thru 0x2f5c406 (0x46c bytes) 2024-09-18T05:14:45.364 INFO:teuthology.orchestra.run.smithi017.stdout:3445 trunc from 0x637e8b9 to 0xe3578c4 2024-09-18T05:14:45.364 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.364 INFO:teuthology.orchestra.run.smithi017.stdout:3447 punch from 0x72dcf7f to 0x72e4a46, (0x7ac7 bytes) 2024-09-18T05:14:45.365 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:45.365 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:45.366 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:45.366 INFO:teuthology.orchestra.run.smithi017.stdout:3448 trunc from 0xe3578c4 to 0x45a9a7e 2024-09-18T05:14:45.366 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:45.366 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:45.367 INFO:teuthology.orchestra.run.smithi017.stdout:3449 read 0x1b8dbe1 thru 0x1b8e750 (0xb70 bytes) 2024-09-18T05:14:45.367 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.367 INFO:teuthology.orchestra.run.smithi017.stdout:3451 writesame 0x72d32ce thru 0x72d53f9 data_size 0x16(0x212c bytes) 2024-09-18T05:14:45.367 INFO:teuthology.orchestra.run.smithi017.stdout:3452 writesame 0x2a4d919 thru 0x2a53b78 data_size 0x10(0x6260 bytes) 2024-09-18T05:14:45.368 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:45.368 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:45.369 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:45.369 INFO:teuthology.orchestra.run.smithi017.stdout:3455 writesame 0xee2fc1c thru 0xee3ef39 data_size 0x7b(0xf31e bytes) 2024-09-18T05:14:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:45.370 INFO:teuthology.orchestra.run.smithi017.stdout:3456 punch from 0x7e35c98 to 0x7e35ef5, (0x25d bytes) 2024-09-18T05:14:45.370 INFO:teuthology.orchestra.run.smithi017.stdout:3457 write 0x14236ec thru 0x142ece4 (0xb5f9 bytes) 2024-09-18T05:14:45.370 INFO:teuthology.orchestra.run.smithi017.stdout:3458 trunc from 0xee3ef3a to 0x7831997 2024-09-18T05:14:45.370 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:45.371 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:45.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:45.362+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:45.372 INFO:teuthology.orchestra.run.smithi017.stdout:3459 trunc from 0x7831997 to 0x6b0b893 2024-09-18T05:14:45.383 INFO:teuthology.orchestra.run.smithi017.stdout:3462 write 0x678ac02 thru 0x679aa92 (0xfe91 bytes) 2024-09-18T05:14:45.388 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.388 INFO:teuthology.orchestra.run.smithi017.stdout:3466 punch from 0x5ecf04b to 0x5ed2b72, (0x3b27 bytes) 2024-09-18T05:14:45.388 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.389 INFO:teuthology.orchestra.run.smithi017.stdout:3469 trunc from 0x6b0b893 to 0x664e481 2024-09-18T05:14:45.389 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:45.390 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:45.402 INFO:teuthology.orchestra.run.smithi017.stdout:3471 trunc from 0x664e481 to 0x3a057ff 2024-09-18T05:14:45.437 INFO:teuthology.orchestra.run.smithi017.stdout:3473 writesame 0x6b9b2ee thru 0x6ba2cc0 data_size 0x1(0x79d3 bytes) 2024-09-18T05:14:45.453 INFO:teuthology.orchestra.run.smithi017.stdout:3474 write 0xd0c7936 thru 0xd0d6c2d (0xf2f8 bytes) 2024-09-18T05:14:45.457 INFO:teuthology.orchestra.run.smithi017.stdout:3475 punch from 0x1bba74e to 0x1bbe073, (0x3925 bytes) 2024-09-18T05:14:45.458 INFO:teuthology.orchestra.run.smithi017.stdout:3476 punch from 0x5ed8ef9 to 0x5ee1f8a, (0x9091 bytes) 2024-09-18T05:14:45.458 INFO:teuthology.orchestra.run.smithi017.stdout:3477 write 0x5fe1eae thru 0x5fefc43 (0xdd96 bytes) 2024-09-18T05:14:45.463 INFO:teuthology.orchestra.run.smithi017.stdout:3478 write 0xb50b9c5 thru 0xb5183d8 (0xca14 bytes) 2024-09-18T05:14:45.469 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:45.462+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:45.478 INFO:teuthology.orchestra.run.smithi017.stdout:3479 write 0xe5bbae4 thru 0xe5bc80d (0xd2a bytes) 2024-09-18T05:14:45.484 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.485 INFO:teuthology.orchestra.run.smithi017.stdout:3482 write 0x305a4a8 thru 0x3067f4a (0xdaa3 bytes) 2024-09-18T05:14:45.487 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.487 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.488 INFO:teuthology.orchestra.run.smithi017.stdout:3487 trunc from 0xe5bc80e to 0xd40a954 2024-09-18T05:14:45.499 INFO:teuthology.orchestra.run.smithi017.stdout:3488 writesame 0x572a6ac thru 0x572ef22 data_size 0x1(0x4877 bytes) 2024-09-18T05:14:45.508 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:45.508 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:45.516 INFO:teuthology.orchestra.run.smithi017.stdout:3489 write 0xaf8a95a thru 0xaf9a60a (0xfcb1 bytes) 2024-09-18T05:14:45.522 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:45.543 INFO:teuthology.orchestra.run.smithi017.stdout:3490 trunc from 0xd40a954 to 0x1f04ebe 2024-09-18T05:14:45.562 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.570 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:45.565+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:45.575 INFO:teuthology.orchestra.run.smithi017.stdout:3493 trunc from 0x1f04ebe to 0x8938ed7 2024-09-18T05:14:45.601 INFO:teuthology.orchestra.run.smithi017.stdout:3494 write 0xd5fcc81 thru 0xd60a5d9 (0xd959 bytes) 2024-09-18T05:14:45.610 INFO:teuthology.orchestra.run.smithi017.stdout:3496 punch from 0x7195c59 to 0x71a1b3d, (0xbee4 bytes) 2024-09-18T05:14:45.610 INFO:teuthology.orchestra.run.smithi017.stdout:3497 read 0x8c50147 thru 0x8c536a0 (0x355a bytes) 2024-09-18T05:14:45.612 INFO:teuthology.orchestra.run.smithi017.stdout:3498 trunc from 0xd60a5da to 0xc6ed7d8 2024-09-18T05:14:45.640 INFO:teuthology.orchestra.run.smithi017.stdout:3499 writesame 0xdedec2e thru 0xdee0578 data_size 0x7(0x194b bytes) 2024-09-18T05:14:45.640 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.640 INFO:teuthology.orchestra.run.smithi017.stdout:3501 read 0x84acb89 thru 0x84bb7b6 (0xec2e bytes) 2024-09-18T05:14:45.649 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:45.649 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:45.653 INFO:teuthology.orchestra.run.smithi017.stdout:3504 write 0xecccf74 thru 0xecd3081 (0x610e bytes) 2024-09-18T05:14:45.660 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.660 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.661 INFO:teuthology.orchestra.run.smithi017.stdout:3510 write 0x81bfed2 thru 0x81cd737 (0xd866 bytes) 2024-09-18T05:14:45.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:45.671 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:45.666+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:45.690 INFO:teuthology.orchestra.run.smithi017.stdout:3511 trunc from 0xecd3082 to 0x516d883 2024-09-18T05:14:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:3512 writesame 0xe5a82a1 thru 0xe5b479f data_size 0x25(0xc4ff bytes) 2024-09-18T05:14:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:3513 write 0xb56d8a7 thru 0xb573f3a (0x6694 bytes) 2024-09-18T05:14:45.758 INFO:teuthology.orchestra.run.smithi017.stdout:3514 read 0x20a58e3 thru 0x20b4fee (0xf70c bytes) 2024-09-18T05:14:45.759 INFO:teuthology.orchestra.run.smithi017.stdout:3515 write 0x445346c thru 0x4462c3e (0xf7d3 bytes) 2024-09-18T05:14:45.763 INFO:teuthology.orchestra.run.smithi017.stdout:3517 writesame 0xa984a97 thru 0xa993e78 data_size 0x3e(0xf3e2 bytes) 2024-09-18T05:14:45.769 INFO:teuthology.orchestra.run.smithi017.stdout:3519 writesame 0x49124ba thru 0x4914329 data_size 0x8(0x1e70 bytes) 2024-09-18T05:14:45.771 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:45.765+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:45.773 INFO:teuthology.orchestra.run.smithi017.stdout:3520 write 0x34a736b thru 0x34b2836 (0xb4cc bytes) 2024-09-18T05:14:45.808 INFO:teuthology.orchestra.run.smithi017.stdout:3523 trunc from 0xe5b47a0 to 0x386b6 2024-09-18T05:14:45.833 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:45.834 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:45.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:45.872 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:45.866+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:45.911 INFO:teuthology.orchestra.run.smithi017.stdout:3524 write 0x726b6ad thru 0x726d48d (0x1de1 bytes) 2024-09-18T05:14:45.918 INFO:teuthology.orchestra.run.smithi017.stdout:3525 write 0x3249846 thru 0x32554f8 (0xbcb3 bytes) 2024-09-18T05:14:45.925 INFO:teuthology.orchestra.run.smithi017.stdout:3526 read 0xb90f04 thru 0xb9f9eb (0xeae8 bytes) 2024-09-18T05:14:45.925 INFO:teuthology.orchestra.run.smithi017.stdout:3527 punch from 0x55c6e4a to 0x55cc01d, (0x51d3 bytes) 2024-09-18T05:14:45.925 INFO:teuthology.orchestra.run.smithi017.stdout:3529 read 0xebf488 thru 0xeccbe6 (0xd75f bytes) 2024-09-18T05:14:45.925 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.926 INFO:teuthology.orchestra.run.smithi017.stdout:3531 read 0x110dc2e thru 0x110ec0c (0xfdf bytes) 2024-09-18T05:14:45.943 INFO:teuthology.orchestra.run.smithi017.stdout:3533 write 0xa2e678c thru 0xa2ef7ea (0x905f bytes) 2024-09-18T05:14:45.950 INFO:teuthology.orchestra.run.smithi017.stdout:3534 punch from 0x1505d05 to 0x150e1b8, (0x84b3 bytes) 2024-09-18T05:14:45.950 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.950 INFO:teuthology.orchestra.run.smithi017.stdout:3539 write 0x2e84476 thru 0x2e8ba71 (0x75fc bytes) 2024-09-18T05:14:45.957 INFO:teuthology.orchestra.run.smithi017.stdout:3543 read 0xa21a420 thru 0xa22374a (0x932b bytes) 2024-09-18T05:14:45.957 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.957 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.957 INFO:teuthology.orchestra.run.smithi017.stdout:3548 punch from 0x56e335c to 0x56f197f, (0xe623 bytes) 2024-09-18T05:14:45.957 INFO:teuthology.orchestra.run.smithi017.stdout:3549 read 0x40dbdc2 thru 0x40e0b3d (0x4d7c bytes) 2024-09-18T05:14:45.957 INFO:teuthology.orchestra.run.smithi017.stdout:3550 punch from 0x57b5789 to 0x57bf9fd, (0xa274 bytes) 2024-09-18T05:14:45.972 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:45.969+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:45.979 INFO:teuthology.orchestra.run.smithi017.stdout:3551 write 0xddfe67a thru 0xde0ae09 (0xc790 bytes) 2024-09-18T05:14:45.990 INFO:teuthology.orchestra.run.smithi017.stdout:3552 punch from 0x1e2b100 to 0x1e32f0e, (0x7e0e bytes) 2024-09-18T05:14:45.990 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:45.990 INFO:teuthology.orchestra.run.smithi017.stdout:3554 write 0x8332662 thru 0x8336c55 (0x45f4 bytes) 2024-09-18T05:14:46.004 INFO:teuthology.orchestra.run.smithi017.stdout:3555 trunc from 0xde0ae0a to 0xbbdba78 2024-09-18T05:14:46.021 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:46.021 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:46.021 INFO:teuthology.orchestra.run.smithi017.stdout:3560 punch from 0x7a8c615 to 0x7a8fdb8, (0x37a3 bytes) 2024-09-18T05:14:46.022 INFO:teuthology.orchestra.run.smithi017.stdout:3561 read 0x593f61a thru 0x5941f64 (0x294b bytes) 2024-09-18T05:14:46.022 INFO:teuthology.orchestra.run.smithi017.stdout:3564 punch from 0x4c33bb5 to 0x4c368d1, (0x2d1c bytes) 2024-09-18T05:14:46.022 INFO:teuthology.orchestra.run.smithi017.stdout:3565 read 0x35a49ab thru 0x35a68a7 (0x1efd bytes) 2024-09-18T05:14:46.022 INFO:teuthology.orchestra.run.smithi017.stdout:3566 read 0x2254038 thru 0x225f4fb (0xb4c4 bytes) 2024-09-18T05:14:46.022 INFO:teuthology.orchestra.run.smithi017.stdout:3567 trunc from 0xbbdba78 to 0xb9adfe0 2024-09-18T05:14:46.025 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:46.025 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:46.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:46.049 INFO:teuthology.orchestra.run.smithi017.stdout:3568 write 0xbff0b50 thru 0xc0003ca (0xf87b bytes) 2024-09-18T05:14:46.057 INFO:teuthology.orchestra.run.smithi017.stdout:3569 read 0x24b90cd thru 0x24c8038 (0xef6c bytes) 2024-09-18T05:14:46.058 INFO:teuthology.orchestra.run.smithi017.stdout:3571 read 0x6016129 thru 0x6020b89 (0xaa61 bytes) 2024-09-18T05:14:46.059 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:46.059 INFO:teuthology.orchestra.run.smithi017.stdout:3574 write 0x1927725 thru 0x1928e20 (0x16fc bytes) 2024-09-18T05:14:46.066 INFO:teuthology.orchestra.run.smithi017.stdout:3575 write 0x948cc4b thru 0x94900ee (0x34a4 bytes) 2024-09-18T05:14:46.072 INFO:teuthology.orchestra.run.smithi017.stdout:3576 writesame 0x4f3ce9 thru 0x50188d data_size 0x1(0xdba5 bytes) 2024-09-18T05:14:46.088 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:46.085+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:46.122 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:46.122 INFO:teuthology.orchestra.run.smithi017.stdout:3578 writesame 0x587acb6 thru 0x5880dae data_size 0x19(0x60f9 bytes) 2024-09-18T05:14:46.131 INFO:teuthology.orchestra.run.smithi017.stdout:3579 punch from 0x69cd8a8 to 0x69d1391, (0x3ae9 bytes) 2024-09-18T05:14:46.131 INFO:teuthology.orchestra.run.smithi017.stdout:3580 write 0xe08cc5 thru 0xe1432e (0xb66a bytes) 2024-09-18T05:14:46.135 INFO:teuthology.orchestra.run.smithi017.stdout:3581 punch from 0x9da1725 to 0x9db1546, (0xfe21 bytes) 2024-09-18T05:14:46.145 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.5 to 1 (10000) 2024-09-18T05:14:46.159 INFO:teuthology.orchestra.run.smithi017.stdout:3582 writesame 0xddd5daa thru 0xdddce6c data_size 0x1(0x70c3 bytes) 2024-09-18T05:14:46.162 INFO:teuthology.orchestra.run.smithi017.stdout:3583 write 0x2d40b76 thru 0x2d4fc4f (0xf0da bytes) 2024-09-18T05:14:46.167 INFO:teuthology.orchestra.run.smithi017.stdout:3586 read 0x5804b15 thru 0x5808a0f (0x3efb bytes) 2024-09-18T05:14:46.174 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-18T05:14:46.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:46.166+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:46.179 INFO:teuthology.orchestra.run.smithi017.stdout:3587 writesame 0xed89fc1 thru 0xed98463 data_size 0x11(0xe4a3 bytes) 2024-09-18T05:14:46.179 INFO:teuthology.orchestra.run.smithi017.stdout:3588 punch from 0x2b497b3 to 0x2b49d84, (0x5d1 bytes) 2024-09-18T05:14:46.180 INFO:teuthology.orchestra.run.smithi017.stdout:3589 read 0x757bfd0 thru 0x758b857 (0xf888 bytes) 2024-09-18T05:14:46.183 INFO:teuthology.orchestra.run.smithi017.stdout:3590 punch from 0x538b63 to 0x54254e, (0x99eb bytes) 2024-09-18T05:14:46.208 INFO:teuthology.orchestra.run.smithi017.stdout:3591 trunc from 0xed98464 to 0x15e95ca 2024-09-18T05:14:46.225 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:46.225 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:46.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:46.254 INFO:teuthology.orchestra.run.smithi017.stdout:3593 write 0xa0f7d30 thru 0xa101554 (0x9825 bytes) 2024-09-18T05:14:46.261 INFO:teuthology.orchestra.run.smithi017.stdout:3594 read 0x114172e thru 0x114c210 (0xaae3 bytes) 2024-09-18T05:14:46.261 INFO:teuthology.orchestra.run.smithi017.stdout:3596 read 0x403d17b thru 0x40441eb (0x7071 bytes) 2024-09-18T05:14:46.266 INFO:teuthology.orchestra.run.smithi017.stdout:3597 trunc from 0xa101555 to 0xc4cec8b 2024-09-18T05:14:46.274 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:46.270+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:46.277 INFO:teuthology.orchestra.run.smithi017.stdout:3598 trunc from 0xc4cec8b to 0xbbe5529 2024-09-18T05:14:46.287 INFO:teuthology.orchestra.run.smithi017.stdout:3599 read 0x9361c9f thru 0x9364bcb (0x2f2d bytes) 2024-09-18T05:14:46.302 INFO:teuthology.orchestra.run.smithi017.stdout:3600 trunc from 0xbbe5529 to 0x4fd2b80 2024-09-18T05:14:46.333 INFO:teuthology.orchestra.run.smithi017.stdout:3603 trunc from 0x4fd2b80 to 0xe002dc0 2024-09-18T05:14:46.340 INFO:teuthology.orchestra.run.smithi017.stdout:3604 writesame 0x1fddbfb thru 0x1fde2fb data_size 0x1(0x701 bytes) 2024-09-18T05:14:46.344 INFO:teuthology.orchestra.run.smithi017.stdout:3605 write 0x469a24e thru 0x469cc9e (0x2a51 bytes) 2024-09-18T05:14:46.350 INFO:teuthology.orchestra.run.smithi017.stdout:3607 trunc from 0xe002dc0 to 0xd0dff1f 2024-09-18T05:14:46.359 INFO:teuthology.orchestra.run.smithi017.stdout:3608 write 0x9d1a19c thru 0x9d1c6bd (0x2522 bytes) 2024-09-18T05:14:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:46.365 INFO:teuthology.orchestra.run.smithi017.stdout:3609 write 0x8f6591c thru 0x8f6cac7 (0x71ac bytes) 2024-09-18T05:14:46.375 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:46.370+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:46.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:46.379 INFO:teuthology.orchestra.run.smithi017.stdout:3610 trunc from 0xd0dff1f to 0x3ff9e83 2024-09-18T05:14:46.394 INFO:teuthology.orchestra.run.smithi017.stdout:3611 punch from 0x6cef2e to 0x6d77b8, (0x888a bytes) 2024-09-18T05:14:46.394 INFO:teuthology.orchestra.run.smithi017.stdout:3612 read 0x2870797 thru 0x28750aa (0x4914 bytes) 2024-09-18T05:14:46.394 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:46.394 INFO:teuthology.orchestra.run.smithi017.stdout:3614 read 0x5fa0c1 thru 0x5ff509 (0x5449 bytes) 2024-09-18T05:14:46.394 INFO:teuthology.orchestra.run.smithi017.stdout:3615 punch from 0xb0b52f to 0xb0e570, (0x3041 bytes) 2024-09-18T05:14:46.407 INFO:teuthology.orchestra.run.smithi017.stdout:3616 write 0x9144028 thru 0x9144aea (0xac3 bytes) 2024-09-18T05:14:46.411 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:46.411 INFO:teuthology.orchestra.run.smithi017.stdout:3619 read 0x92f3d2 thru 0x936ef1 (0x7b20 bytes) 2024-09-18T05:14:46.412 INFO:teuthology.orchestra.run.smithi017.stdout:3620 punch from 0x8e7f9c1 to 0x8e83311, (0x3950 bytes) 2024-09-18T05:14:46.412 INFO:teuthology.orchestra.run.smithi017.stdout:3621 punch from 0x285726a to 0x285b67a, (0x4410 bytes) 2024-09-18T05:14:46.412 INFO:teuthology.orchestra.run.smithi017.stdout:3622 punch from 0x227447b to 0x227d46c, (0x8ff1 bytes) 2024-09-18T05:14:46.412 INFO:teuthology.orchestra.run.smithi017.stdout:3623 read 0x43f3a71 thru 0x4401f51 (0xe4e1 bytes) 2024-09-18T05:14:46.412 INFO:teuthology.orchestra.run.smithi017.stdout:3624 write 0x2692e3e thru 0x269703a (0x41fd bytes) 2024-09-18T05:14:46.414 INFO:teuthology.orchestra.run.smithi017.stdout:3625 punch from 0x1046ab6 to 0x104ab2e, (0x4078 bytes) 2024-09-18T05:14:46.425 INFO:teuthology.orchestra.run.smithi017.stdout:3627 write 0xbda4975 thru 0xbdacc52 (0x82de bytes) 2024-09-18T05:14:46.430 INFO:teuthology.orchestra.run.smithi017.stdout:3630 punch from 0x778c659 to 0x778da64, (0x140b bytes) 2024-09-18T05:14:46.430 INFO:teuthology.orchestra.run.smithi017.stdout:3631 read 0xbcf46bb thru 0xbcf6b9d (0x24e3 bytes) 2024-09-18T05:14:46.430 INFO:teuthology.orchestra.run.smithi017.stdout:3632 write 0x9d28a6d thru 0x9d3232c (0x98c0 bytes) 2024-09-18T05:14:46.448 INFO:teuthology.orchestra.run.smithi017.stdout:3633 trunc from 0xbdacc53 to 0x2b00f44 2024-09-18T05:14:46.469 INFO:teuthology.orchestra.run.smithi017.stdout:3634 clone 26 order 24 su 65536 sc 5 2024-09-18T05:14:46.476 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:46.473+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:46.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:46.578 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:46.570+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:46.679 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:46.673+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:46.679 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:46.679 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:46.693 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:46.780 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:46.777+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:46.859 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:46.860 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:46.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:46.916 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:46.913+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:46.982 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:46.974+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:47.038 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:47.038 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:47.054 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:14:47.083 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:47.078+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:47.152 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.6 to 1 (10000) 2024-09-18T05:14:47.164 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:14:47.179 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-18T05:14:47.180 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:47.180 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:47.197 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:14:47.227 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:47.222+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:47.250 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone25 from 0x2b00f44 (overlap 0x386b6) to 0x16915 2024-09-18T05:14:47.284 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:47.281+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:47.327 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:47.327 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:47.342 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:47.355 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-18T05:14:47.364 INFO:teuthology.orchestra.run.smithi017.stdout:3637 read 0x1cbfab1 thru 0x1cca2a8 (0xa7f8 bytes) 2024-09-18T05:14:47.365 INFO:teuthology.orchestra.run.smithi017.stdout:3639 punch from 0x256b590 to 0x2576c60, (0xb6d0 bytes) 2024-09-18T05:14:47.385 INFO:teuthology.orchestra.run.smithi017.stdout:3640 write 0x7ccea0f thru 0x7cdcfbd (0xe5af bytes) 2024-09-18T05:14:47.385 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:47.378+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:47.390 INFO:teuthology.orchestra.run.smithi017.stdout:3641 read 0xbb23ae thru 0xbbf266 (0xceb9 bytes) 2024-09-18T05:14:47.390 INFO:teuthology.orchestra.run.smithi017.stdout:3642 write 0x368c023 thru 0x368d9eb (0x19c9 bytes) 2024-09-18T05:14:47.401 INFO:teuthology.orchestra.run.smithi017.stdout:3645 clone 27 order 21 su 262144 sc 7 2024-09-18T05:14:47.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:47.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:47.482+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:47.525 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:47.525 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:47.542 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:47.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:47.546 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:47.563 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:47.564 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:47.581 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:47.588 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:47.585+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:47.599 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:47.620 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:47.620 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:47.640 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:47.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:47.683 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:47.702 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:47.698+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:47.789 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:47.785+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:47.804 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55852 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1620623569999999, 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052798855999999998, 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55852 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636907+0000", 2024-09-18T05:14:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636913+0000", 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9170000000000003e-06 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636927+0000", 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4080000000000001e-05 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636938+0000", 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0251000000000001e-05 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689571+0000", 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052632828999999999 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689634+0000", 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3139000000000007e-05 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689707+0000", 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3511999999999997e-05 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55853 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8142848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1620198790000007, 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052962084999999999, 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55853 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636950+0000", 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636957+0000", 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636994+0000", 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6879999999999999e-05 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637005+0000", 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1430000000000001e-05 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689750+0000", 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052744345999999998 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689837+0000", 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7581000000000001e-05 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689913+0000", 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5797999999999995e-05 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55854 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8159232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1619555340000005, 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053068918, 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55854 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637014+0000", 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637020+0000", 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5149999999999997e-06 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637034+0000", 2024-09-18T05:14:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4696e-05 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637045+0000", 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0334e-05 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689962+0000", 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052916773 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690024+0000", 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2009999999999998e-05 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690084+0000", 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0485000000000001e-05 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55855 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1619149689999997, 2024-09-18T05:14:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053239090000000003, 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55855 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637055+0000", 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637060+0000", 2024-09-18T05:14:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9139999999999999e-06 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637080+0000", 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9873000000000001e-05 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637091+0000", 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0852999999999999e-05 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690124+0000", 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053033736999999997 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690217+0000", 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2263999999999996e-05 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690295+0000", 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8193000000000002e-05 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55856 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1618698009999999, 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053363617000000002, 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55856 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637100+0000", 2024-09-18T05:14:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637106+0000", 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637120+0000", 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4885999999999999e-05 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637131+0000", 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.064e-05 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690344+0000", 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053212832000000002 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690404+0000", 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0516999999999997e-05 2024-09-18T05:14:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690465+0000", 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0132e-05 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55857 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1618300329999993, 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053529896, 2024-09-18T05:14:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55857 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637140+0000", 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637145+0000", 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637158+0000", 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3465999999999999e-05 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637168+0000", 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4919999999999999e-06 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690506+0000", 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053337801999999997 2024-09-18T05:14:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690595+0000", 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8925000000000007e-05 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690671+0000", 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5983999999999996e-05 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55858 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8224768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1617927179999992, 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053665767000000003, 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55858 2024-09-18T05:14:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637177+0000", 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637182+0000", 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.028e-06 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637197+0000", 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4341999999999999e-05 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637207+0000", 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0345e-05 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690719+0000", 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053511982 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690783+0000", 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3683999999999995e-05 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690844+0000", 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1116000000000002e-05 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55859 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8241152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.161754577, 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053835149999999998, 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55859 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637215+0000", 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637221+0000", 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4879999999999998e-06 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637239+0000", 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7665000000000001e-05 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637252+0000", 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3735e-05 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690887+0000", 2024-09-18T05:14:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053635163 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690977+0000", 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9452999999999999e-05 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691051+0000", 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4374000000000003e-05 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55860 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1616831619999992, 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053934739000000002, 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55860 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637287+0000", 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637293+0000", 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637309+0000", 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6214000000000001e-05 2024-09-18T05:14:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637322+0000", 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2413e-05 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691101+0000", 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053779456000000003 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691164+0000", 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2199000000000005e-05 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691222+0000", 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8758999999999998e-05 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55861 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8273920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1616407039999999, 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054100101999999997, 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55861 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637329+0000", 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637333+0000", 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2619999999999999e-06 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637340+0000", 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5279999999999998e-06 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637347+0000", 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691264+0000", 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916886999999997 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691353+0000", 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9560000000000003e-05 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691430+0000", 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6715e-05 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55862 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8290304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1616057590000004, 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054235677000000003, 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55862 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637364+0000", 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637368+0000", 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637378+0000", 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0545e-05 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637384+0000", 2024-09-18T05:14:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.592e-06 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691479+0000", 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054095022 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691540+0000", 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0958999999999997e-05 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691601+0000", 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0976e-05 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55863 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8306688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1615818119999997, 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054421542000000003, 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55863 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637388+0000", 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637391+0000", 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637398+0000", 2024-09-18T05:14:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8249999999999999e-06 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637403+0000", 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3879999999999999e-06 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691642+0000", 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054238572999999998 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691732+0000", 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0413000000000003e-05 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691810+0000", 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8079999999999998e-05 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55864 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1608956060000004, 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053905402999999998, 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55864 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637413+0000", 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9993382 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638082+0000", 2024-09-18T05:14:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066932099999999996 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638103+0000", 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638115+0000", 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2935000000000001e-05 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691859+0000", 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053743055999999997 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691920+0000", 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1087999999999995e-05 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691980+0000", 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0853999999999997e-05 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55865 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8339456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1608431380000006, 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054056874999999997, 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55865 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638127+0000", 2024-09-18T05:14:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638133+0000", 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7869999999999998e-06 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638146+0000", 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3030000000000001e-05 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638156+0000", 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0523000000000001e-05 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692022+0000", 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053866149000000002 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692109+0000", 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6428000000000007e-05 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692184+0000", 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5760999999999995e-05 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55935 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7397376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1583343159999995, 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052706586, 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55935 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640635+0000", 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640640+0000", 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640649+0000", 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8130000000000007e-06 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640655+0000", 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1739999999999999e-06 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693173+0000", 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518675000000001 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693264+0000", 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0859999999999994e-05 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693343+0000", 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8870999999999998e-05 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55936 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7413760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1583114699999992, 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052856933000000002, 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55936 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640661+0000", 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3479999999999998e-06 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640672+0000", 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0424999999999999e-05 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640677+0000", 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693392+0000", 2024-09-18T05:14:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052714446999999998 2024-09-18T05:14:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693456+0000", 2024-09-18T05:14:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4426999999999998e-05 2024-09-18T05:14:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693516+0000", 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0154e-05 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55937 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7430144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1582888899999997, 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053045085999999998, 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55937 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640681+0000", 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640685+0000", 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0799999999999999e-06 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640700+0000", 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4768e-05 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640707+0000", 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.81e-06 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693559+0000", 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052852022999999998 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693648+0000", 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8908999999999999e-05 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693727+0000", 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9123999999999997e-05 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55938 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7446528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1582588349999998, 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053184652999999998, 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55938 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640711+0000", 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640714+0000", 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0070000000000002e-06 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640721+0000", 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640728+0000", 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6479999999999997e-06 2024-09-18T05:14:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693775+0000", 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047086 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693836+0000", 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1513999999999994e-05 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693897+0000", 2024-09-18T05:14:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0315000000000001e-05 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55939 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7462912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1582351370000001, 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369857999999999, 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55939 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640735+0000", 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640739+0000", 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-06 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640750+0000", 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0668e-05 2024-09-18T05:14:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640755+0000", 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4299999999999997e-06 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693938+0000", 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053182462 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694028+0000", 2024-09-18T05:14:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0781999999999999e-05 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694105+0000", 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049e-05 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55940 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7479296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1582108869999992, 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053517447000000003, 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55940 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640759+0000", 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640769+0000", 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4730000000000006e-06 2024-09-18T05:14:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640779+0000", 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9899999999999992e-06 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640784+0000", 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694154+0000", 2024-09-18T05:14:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369648999999998 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694217+0000", 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2540999999999996e-05 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694277+0000", 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0671999999999998e-05 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:47.895 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:47.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:47.896 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:47.890+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:47.996 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:47.990+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:48.068 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:48.069 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:48.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:48.127 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:48.122+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:48.151 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:14:48.151 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.7 to 1 (10000) 2024-09-18T05:14:48.181 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-18T05:14:48.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:14:48.227 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:48.222+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:48.261 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:48.261 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:48.261 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:48.262 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:48.262 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:48.278 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:48.299 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:48.293+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:48.300 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone26 from 0x7cdcfbe (overlap 0x2b00f44) to 0x899ca7 2024-09-18T05:14:48.401 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:48.397+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:48.444 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:48.445 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:48.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:48.445 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:48.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.208948468999999, 2024-09-18T05:14:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:48.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:48.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:48.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:48.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:48.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:48.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:48.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:48.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.459 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.459 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:48.459 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.208880858999997, 2024-09-18T05:14:48.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:48.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.460 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:48.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.462 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:48.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:48.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:48.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:48.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:48.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.467 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.467 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.467 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:48.467 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.208833472999999, 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.473 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.473 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:48.473 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.208788067, 2024-09-18T05:14:48.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:48.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.473 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.473 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:48.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:48.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:48.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:48.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.479 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.479 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:48.479 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.208742776999998, 2024-09-18T05:14:48.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:48.479 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.479 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:48.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:48.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:48.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:48.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:48.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:48.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:48.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:48.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:48.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.207108226000003, 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.487 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:48.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:48.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:48.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:48.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:48.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.493 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.493 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:48.493 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.207055906999997, 2024-09-18T05:14:48.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:48.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.495 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.496 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:48.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:48.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:48.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:48.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:48.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:48.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:48.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:48.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:48.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:48.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:48.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:48.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206938264000001, 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.503 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.503 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:48.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.503 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:48.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206876344999998, 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:48.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:48.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:48.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:48.512 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206817925000003, 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:48.516 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206764299, 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:48.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:48.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:48.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:48.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.523 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.523 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:48.523 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206717236000003, 2024-09-18T05:14:48.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:48.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.523 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.524 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.524 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.524 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:48.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.524 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:48.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:48.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:48.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:48.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:48.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:48.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:48.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:48.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:48.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:48.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:48.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:48.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.529 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.530 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.530 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:48.530 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206657157000002, 2024-09-18T05:14:48.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:48.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.531 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.531 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:48.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.532 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:48.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:48.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:48.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:48.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:48.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.536 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.537 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.537 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:48.537 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206596869999998, 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:48.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206529553999999, 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.543 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:48.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.547 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206480951000003, 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:48.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:48.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:48.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:48.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:48.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.552 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.553 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.553 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:48.553 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206407331999998, 2024-09-18T05:14:48.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:48.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:48.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.554 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:48.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:48.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:48.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:48.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:48.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:48.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:48.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:48.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:48.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:48.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:48.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.562 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.563 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.563 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:48.563 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206333849000004, 2024-09-18T05:14:48.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:48.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:48.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.564 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:48.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:48.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:48.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:48.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:48.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:48.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206277258999997, 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:48.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:48.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:48.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:48.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:48.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:48.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:48.576 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.206231127000002, 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:48.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:48.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:48.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:48.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:48.582 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:48.582 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:48.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:48.585 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-18T05:14:48.585 INFO:teuthology.orchestra.run.smithi017.stdout:3646 writesame 0x9cd95ee thru 0x9ce893b data_size 0x15(0xf34e bytes) 2024-09-18T05:14:48.586 INFO:teuthology.orchestra.run.smithi017.stdout:3647 read 0x93be44b thru 0x93c2ccc (0x4882 bytes) 2024-09-18T05:14:48.586 INFO:teuthology.orchestra.run.smithi017.stdout:3648 clone 28 order 23 su 32768 sc 15 2024-09-18T05:14:48.587 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:14:48.589 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:14:48.590 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-18T05:14:48.150652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":955859554,"num_objects":1196,"num_object_clones":340,"num_object_copies":2392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":501,"num_read":87440,"num_read_kb":499722,"num_write":12760,"num_write_kb":210927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":2595236,"num_keys_recovered":53,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10144,"ondisk_log_size":10144,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309820,"kb_used_data":38700,"kb_used_omap":18,"kb_used_meta":270509,"kb_avail":754664900,"statfs":{"total":773094113280,"available":772776857600,"internally_reserved":0,"allocated":39628800,"data_stored":337430182,"data_compressed":20720335,"data_compressed_allocated":21893120,"data_compressed_original":324738902,"omap_allocated":19416,"internal_metadata":277001256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":129482994,"num_objects":48,"num_object_clones":22,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-69,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":5936,"num_read_kb":22955,"num_write":716,"num_write_kb":5574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":135962,"num_keys_recovered":41,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035066"},"pg_stats":[{"pgid":"3.1f","version":"65'461","reported_seq":1862,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141490+0000","last_change":"2024-09-18T05:13:47.874353+0000","last_active":"2024-09-18T05:14:46.141490+0000","last_peered":"2024-09-18T05:14:46.141490+0000","last_clean":"2024-09-18T05:14:46.141490+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:14:46.141490+0000","last_undegraded":"2024-09-18T05:14:46.141490+0000","last_fullsized":"2024-09-18T05:14:46.141490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002377985,"stat_sum":{"num_bytes":34012366,"num_objects":43,"num_object_clones":13,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":17,"num_read":2813,"num_read_kb":15510,"num_write":665,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"68'1097","reported_seq":3371,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.332284+0000","last_change":"2024-09-18T05:14:44.123599+0000","last_active":"2024-09-18T05:14:47.332284+0000","last_peered":"2024-09-18T05:14:47.332284+0000","last_clean":"2024-09-18T05:14:47.332284+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:14:47.332284+0000","last_undegraded":"2024-09-18T05:14:47.332284+0000","last_fullsized":"2024-09-18T05:14:47.332284+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001660138,"stat_sum":{"num_bytes":27749495,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":7490,"num_read_kb":17862,"num_write":1801,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"66'236","reported_seq":984,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.182492+0000","last_change":"2024-09-18T05:13:47.889261+0000","last_active":"2024-09-18T05:14:46.182492+0000","last_peered":"2024-09-18T05:14:46.182492+0000","last_clean":"2024-09-18T05:14:46.182492+0000","last_became_active":"2024-09-18T05:13:45.883512+0000","last_became_peered":"2024-09-18T05:13:45.883512+0000","last_unstale":"2024-09-18T05:14:46.182492+0000","last_undegraded":"2024-09-18T05:14:46.182492+0000","last_fullsized":"2024-09-18T05:14:46.182492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:13.538982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080162099999999997,"stat_sum":{"num_bytes":10858625,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":20,"num_read":960,"num_read_kb":7332,"num_write":256,"num_write_kb":7800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"68'494","reported_seq":2025,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.354655+0000","last_change":"2024-09-18T05:13:47.889511+0000","last_active":"2024-09-18T05:14:47.354655+0000","last_peered":"2024-09-18T05:14:47.354655+0000","last_clean":"2024-09-18T05:14:47.354655+0000","last_became_active":"2024-09-18T05:13:45.890406+0000","last_became_peered":"2024-09-18T05:13:45.890406+0000","last_unstale":"2024-09-18T05:14:47.354655+0000","last_undegraded":"2024-09-18T05:14:47.354655+0000","last_fullsized":"2024-09-18T05:14:47.354655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:49:08.888102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001443443,"stat_sum":{"num_bytes":39971790,"num_objects":47,"num_object_clones":11,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":19,"num_read":3823,"num_read_kb":20970,"num_write":663,"num_write_kb":7445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"68'181","reported_seq":793,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.391533+0000","last_change":"2024-09-18T05:13:47.872985+0000","last_active":"2024-09-18T05:14:47.391533+0000","last_peered":"2024-09-18T05:14:47.391533+0000","last_clean":"2024-09-18T05:14:47.391533+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:14:47.391533+0000","last_undegraded":"2024-09-18T05:14:47.391533+0000","last_fullsized":"2024-09-18T05:14:47.391533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016154539999999999,"stat_sum":{"num_bytes":52862645,"num_objects":42,"num_object_clones":15,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":18,"num_read":633,"num_read_kb":14289,"num_write":190,"num_write_kb":10366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"68'206","reported_seq":1963,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.395896+0000","last_change":"2024-09-18T05:13:47.881254+0000","last_active":"2024-09-18T05:14:47.395896+0000","last_peered":"2024-09-18T05:14:47.395896+0000","last_clean":"2024-09-18T05:14:47.395896+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:14:47.395896+0000","last_undegraded":"2024-09-18T05:14:47.395896+0000","last_fullsized":"2024-09-18T05:14:47.395896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091901600000000004,"stat_sum":{"num_bytes":27280737,"num_objects":37,"num_object_clones":12,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":1777,"num_read_kb":13080,"num_write":203,"num_write_kb":6031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"67'268","reported_seq":2644,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.349076+0000","last_change":"2024-09-18T05:13:47.880516+0000","last_active":"2024-09-18T05:14:47.349076+0000","last_peered":"2024-09-18T05:14:47.349076+0000","last_clean":"2024-09-18T05:14:47.349076+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:14:47.349076+0000","last_undegraded":"2024-09-18T05:14:47.349076+0000","last_fullsized":"2024-09-18T05:14:47.349076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042422500000000003,"stat_sum":{"num_bytes":41252232,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":13,"num_read":4196,"num_read_kb":14550,"num_write":264,"num_write_kb":6129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"68'425","reported_seq":1572,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.393758+0000","last_change":"2024-09-18T05:13:47.895130+0000","last_active":"2024-09-18T05:14:47.393758+0000","last_peered":"2024-09-18T05:14:47.393758+0000","last_clean":"2024-09-18T05:14:47.393758+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:14:47.393758+0000","last_undegraded":"2024-09-18T05:14:47.393758+0000","last_fullsized":"2024-09-18T05:14:47.393758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000585963,"stat_sum":{"num_bytes":38573558,"num_objects":43,"num_object_clones":14,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":19,"num_read":2164,"num_read_kb":16850,"num_write":546,"num_write_kb":4810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"68'259","reported_seq":1537,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.391562+0000","last_change":"2024-09-18T05:13:47.874514+0000","last_active":"2024-09-18T05:14:47.391562+0000","last_peered":"2024-09-18T05:14:47.391562+0000","last_clean":"2024-09-18T05:14:47.391562+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:14:47.391562+0000","last_undegraded":"2024-09-18T05:14:47.391562+0000","last_fullsized":"2024-09-18T05:14:47.391562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021885429999999998,"stat_sum":{"num_bytes":37856356,"num_objects":42,"num_object_clones":16,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":21,"num_read":1790,"num_read_kb":9024,"num_write":239,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"65'349","reported_seq":3496,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.179109+0000","last_change":"2024-09-18T05:13:47.888939+0000","last_active":"2024-09-18T05:14:47.179109+0000","last_peered":"2024-09-18T05:14:47.179109+0000","last_clean":"2024-09-18T05:14:47.179109+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:14:47.179109+0000","last_undegraded":"2024-09-18T05:14:47.179109+0000","last_fullsized":"2024-09-18T05:14:47.179109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081828800000000002,"stat_sum":{"num_bytes":45285929,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":4372,"num_read_kb":23190,"num_write":429,"num_write_kb":6918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"65'308","reported_seq":4423,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.154907+0000","last_change":"2024-09-18T05:13:47.875490+0000","last_active":"2024-09-18T05:14:47.154907+0000","last_peered":"2024-09-18T05:14:47.154907+0000","last_clean":"2024-09-18T05:14:47.154907+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:14:47.154907+0000","last_undegraded":"2024-09-18T05:14:47.154907+0000","last_fullsized":"2024-09-18T05:14:47.154907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068601800000000004,"stat_sum":{"num_bytes":59879077,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":4558,"num_read_kb":37370,"num_write":398,"num_write_kb":12677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"67'293","reported_seq":1219,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.453310+0000","last_change":"2024-09-18T05:13:47.881467+0000","last_active":"2024-09-18T05:14:46.453310+0000","last_peered":"2024-09-18T05:14:46.453310+0000","last_clean":"2024-09-18T05:14:46.453310+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:14:46.453310+0000","last_undegraded":"2024-09-18T05:14:46.453310+0000","last_fullsized":"2024-09-18T05:14:46.453310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147750000000001,"stat_sum":{"num_bytes":39093950,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":19,"num_read":1323,"num_read_kb":11797,"num_write":330,"num_write_kb":4926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T05:14:43.119884+0000","last_change":"2024-09-18T05:14:41.375842+0000","last_active":"2024-09-18T05:14:43.119884+0000","last_peered":"2024-09-18T05:14:43.119884+0000","last_clean":"2024-09-18T05:14:43.119884+0000","last_became_active":"2024-09-18T05:14:41.375168+0000","last_became_peered":"2024-09-18T05:14:41.375168+0000","last_unstale":"2024-09-18T05:14:43.119884+0000","last_undegraded":"2024-09-18T05:14:43.119884+0000","last_fullsized":"2024-09-18T05:14:43.119884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:10:30.973479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"68'262","reported_seq":2028,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.214090+0000","last_change":"2024-09-18T05:13:47.873517+0000","last_active":"2024-09-18T05:14:47.214090+0000","last_peered":"2024-09-18T05:14:47.214090+0000","last_clean":"2024-09-18T05:14:47.214090+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:14:47.214090+0000","last_undegraded":"2024-09-18T05:14:47.214090+0000","last_fullsized":"2024-09-18T05:14:47.214090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019230849999999999,"stat_sum":{"num_bytes":25928883,"num_objects":31,"num_object_clones":7,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":15,"num_read":2398,"num_read_kb":21811,"num_write":359,"num_write_kb":10012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.140438+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:14:46.140438+0000","last_peered":"2024-09-18T05:14:46.140438+0000","last_clean":"2024-09-18T05:14:46.140438+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:14:46.140438+0000","last_undegraded":"2024-09-18T05:14:46.140438+0000","last_fullsized":"2024-09-18T05:14:46.140438+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"68'277","reported_seq":1864,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.393932+0000","last_change":"2024-09-18T05:13:47.897304+0000","last_active":"2024-09-18T05:14:47.393932+0000","last_peered":"2024-09-18T05:14:47.393932+0000","last_clean":"2024-09-18T05:14:47.393932+0000","last_became_active":"2024-09-18T05:13:45.882587+0000","last_became_peered":"2024-09-18T05:13:45.882587+0000","last_unstale":"2024-09-18T05:14:47.393932+0000","last_undegraded":"2024-09-18T05:14:47.393932+0000","last_fullsized":"2024-09-18T05:14:47.393932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:27:19.084581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021450010000000001,"stat_sum":{"num_bytes":34383241,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":13,"num_read":2457,"num_read_kb":21096,"num_write":321,"num_write_kb":7211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141292+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:14:46.141292+0000","last_peered":"2024-09-18T05:14:46.141292+0000","last_clean":"2024-09-18T05:14:46.141292+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:14:46.141292+0000","last_undegraded":"2024-09-18T05:14:46.141292+0000","last_fullsized":"2024-09-18T05:14:46.141292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"68'161","reported_seq":849,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.147279+0000","last_change":"2024-09-18T05:13:47.880769+0000","last_active":"2024-09-18T05:14:47.147279+0000","last_peered":"2024-09-18T05:14:47.147279+0000","last_clean":"2024-09-18T05:14:47.147279+0000","last_became_active":"2024-09-18T05:13:46.174136+0000","last_became_peered":"2024-09-18T05:13:46.174136+0000","last_unstale":"2024-09-18T05:14:47.147279+0000","last_undegraded":"2024-09-18T05:14:47.147279+0000","last_fullsized":"2024-09-18T05:14:47.147279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:52.243601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058757199999999996,"stat_sum":{"num_bytes":41927633,"num_objects":35,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":839,"num_read_kb":11921,"num_write":234,"num_write_kb":6731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.140503+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:14:46.140503+0000","last_peered":"2024-09-18T05:14:46.140503+0000","last_clean":"2024-09-18T05:14:46.140503+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:14:46.140503+0000","last_undegraded":"2024-09-18T05:14:46.140503+0000","last_fullsized":"2024-09-18T05:14:46.140503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"65'216","reported_seq":1873,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.356500+0000","last_change":"2024-09-18T05:13:47.889820+0000","last_active":"2024-09-18T05:14:47.356500+0000","last_peered":"2024-09-18T05:14:47.356500+0000","last_clean":"2024-09-18T05:14:47.356500+0000","last_became_active":"2024-09-18T05:13:45.881482+0000","last_became_peered":"2024-09-18T05:13:45.881482+0000","last_unstale":"2024-09-18T05:14:47.356500+0000","last_undegraded":"2024-09-18T05:14:47.356500+0000","last_fullsized":"2024-09-18T05:14:47.356500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:50:34.961113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013457199999999999,"stat_sum":{"num_bytes":42129549,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":13,"num_read":1689,"num_read_kb":16021,"num_write":217,"num_write_kb":11169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"68'417","reported_seq":2517,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.393301+0000","last_change":"2024-09-18T05:13:47.881241+0000","last_active":"2024-09-18T05:14:47.393301+0000","last_peered":"2024-09-18T05:14:47.393301+0000","last_clean":"2024-09-18T05:14:47.393301+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:14:47.393301+0000","last_undegraded":"2024-09-18T05:14:47.393301+0000","last_fullsized":"2024-09-18T05:14:47.393301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087944100000000001,"stat_sum":{"num_bytes":38018355,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":15,"num_read":3330,"num_read_kb":20787,"num_write":608,"num_write_kb":12377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.181951+0000","last_change":"2024-09-18T05:13:37.897308+0000","last_active":"2024-09-18T05:14:46.181951+0000","last_peered":"2024-09-18T05:14:46.181951+0000","last_clean":"2024-09-18T05:14:46.181951+0000","last_became_active":"2024-09-18T05:13:35.880281+0000","last_became_peered":"2024-09-18T05:13:35.880281+0000","last_unstale":"2024-09-18T05:14:46.181951+0000","last_undegraded":"2024-09-18T05:14:46.181951+0000","last_fullsized":"2024-09-18T05:14:46.181951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"68'263","reported_seq":1864,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.391068+0000","last_change":"2024-09-18T05:13:47.880771+0000","last_active":"2024-09-18T05:14:47.391068+0000","last_peered":"2024-09-18T05:14:47.391068+0000","last_clean":"2024-09-18T05:14:47.391068+0000","last_became_active":"2024-09-18T05:13:46.174696+0000","last_became_peered":"2024-09-18T05:13:46.174696+0000","last_unstale":"2024-09-18T05:14:47.391068+0000","last_undegraded":"2024-09-18T05:14:47.391068+0000","last_fullsized":"2024-09-18T05:14:47.391068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:04:21.805854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058553999999999995,"stat_sum":{"num_bytes":30089752,"num_objects":40,"num_object_clones":14,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":15,"num_read":2307,"num_read_kb":12272,"num_write":257,"num_write_kb":4579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.212559+0000","last_change":"2024-09-18T05:13:37.887642+0000","last_active":"2024-09-18T05:14:46.212559+0000","last_peered":"2024-09-18T05:14:46.212559+0000","last_clean":"2024-09-18T05:14:46.212559+0000","last_became_active":"2024-09-18T05:13:36.135298+0000","last_became_peered":"2024-09-18T05:13:36.135298+0000","last_unstale":"2024-09-18T05:14:46.212559+0000","last_undegraded":"2024-09-18T05:14:46.212559+0000","last_fullsized":"2024-09-18T05:14:46.212559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.310834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088184600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'172","reported_seq":1370,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141304+0000","last_change":"2024-09-18T05:13:47.872235+0000","last_active":"2024-09-18T05:14:46.141304+0000","last_peered":"2024-09-18T05:14:46.141304+0000","last_clean":"2024-09-18T05:14:46.141304+0000","last_became_active":"2024-09-18T05:13:45.870133+0000","last_became_peered":"2024-09-18T05:13:45.870133+0000","last_unstale":"2024-09-18T05:14:46.141304+0000","last_undegraded":"2024-09-18T05:14:46.141304+0000","last_fullsized":"2024-09-18T05:14:46.141304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:02:08.230414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014534350000000001,"stat_sum":{"num_bytes":6263892,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":17,"num_read":1320,"num_read_kb":3794,"num_write":189,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.140851+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:14:46.140851+0000","last_peered":"2024-09-18T05:14:46.140851+0000","last_clean":"2024-09-18T05:14:46.140851+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:14:46.140851+0000","last_undegraded":"2024-09-18T05:14:46.140851+0000","last_fullsized":"2024-09-18T05:14:46.140851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"59'303","reported_seq":2976,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.145949+0000","last_change":"2024-09-18T05:13:47.897422+0000","last_active":"2024-09-18T05:14:46.145949+0000","last_peered":"2024-09-18T05:14:46.145949+0000","last_clean":"2024-09-18T05:14:46.145949+0000","last_became_active":"2024-09-18T05:13:45.878063+0000","last_became_peered":"2024-09-18T05:13:45.878063+0000","last_unstale":"2024-09-18T05:14:46.145949+0000","last_undegraded":"2024-09-18T05:14:46.145949+0000","last_fullsized":"2024-09-18T05:14:46.145949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:53.493537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023719930000000002,"stat_sum":{"num_bytes":32478072,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":4710,"num_read_kb":21118,"num_write":321,"num_write_kb":7633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.182004+0000","last_change":"2024-09-18T05:13:37.896005+0000","last_active":"2024-09-18T05:14:46.182004+0000","last_peered":"2024-09-18T05:14:46.182004+0000","last_clean":"2024-09-18T05:14:46.182004+0000","last_became_active":"2024-09-18T05:13:35.878921+0000","last_became_peered":"2024-09-18T05:13:35.878921+0000","last_unstale":"2024-09-18T05:14:46.182004+0000","last_undegraded":"2024-09-18T05:14:46.182004+0000","last_fullsized":"2024-09-18T05:14:46.182004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:03.020943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.140744+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:14:46.140744+0000","last_peered":"2024-09-18T05:14:46.140744+0000","last_clean":"2024-09-18T05:14:46.140744+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:14:46.140744+0000","last_undegraded":"2024-09-18T05:14:46.140744+0000","last_fullsized":"2024-09-18T05:14:46.140744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"68'161","reported_seq":1805,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.385605+0000","last_change":"2024-09-18T05:13:47.896354+0000","last_active":"2024-09-18T05:14:47.385605+0000","last_peered":"2024-09-18T05:14:47.385605+0000","last_clean":"2024-09-18T05:14:47.385605+0000","last_became_active":"2024-09-18T05:13:45.873640+0000","last_became_peered":"2024-09-18T05:13:45.873640+0000","last_unstale":"2024-09-18T05:14:47.385605+0000","last_undegraded":"2024-09-18T05:14:47.385605+0000","last_fullsized":"2024-09-18T05:14:47.385605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:45.276749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001525368,"stat_sum":{"num_bytes":13628034,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":9,"num_read":2986,"num_read_kb":21497,"num_write":159,"num_write_kb":8078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"59'139","reported_seq":1519,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.154033+0000","last_change":"2024-09-18T05:13:47.880748+0000","last_active":"2024-09-18T05:14:46.154033+0000","last_peered":"2024-09-18T05:14:46.154033+0000","last_clean":"2024-09-18T05:14:46.154033+0000","last_became_active":"2024-09-18T05:13:46.177331+0000","last_became_peered":"2024-09-18T05:13:46.177331+0000","last_unstale":"2024-09-18T05:14:46.154033+0000","last_undegraded":"2024-09-18T05:14:46.154033+0000","last_fullsized":"2024-09-18T05:14:46.154033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:38:10.519505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044114000000000002,"stat_sum":{"num_bytes":30422856,"num_objects":36,"num_object_clones":14,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":16,"num_read":1384,"num_read_kb":9977,"num_write":123,"num_write_kb":2163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"63'229","reported_seq":1557,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-18T05:14:44.125964+0000","last_change":"2024-09-18T05:14:44.126112+0000","last_active":"2024-09-18T05:14:44.125964+0000","last_peered":"2024-09-18T05:14:44.125964+0000","last_clean":"2024-09-18T05:14:21.001832+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:14:44.125964+0000","last_undegraded":"2024-09-18T05:14:44.125964+0000","last_fullsized":"2024-09-18T05:14:44.125964+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070131499999999999,"stat_sum":{"num_bytes":18835299,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":10,"num_read":1928,"num_read_kb":11783,"num_write":233,"num_write_kb":3856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"67'176","reported_seq":1527,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.212094+0000","last_change":"2024-09-18T05:13:47.896719+0000","last_active":"2024-09-18T05:14:46.212094+0000","last_peered":"2024-09-18T05:14:46.212094+0000","last_clean":"2024-09-18T05:14:46.212094+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:14:46.212094+0000","last_undegraded":"2024-09-18T05:14:46.212094+0000","last_fullsized":"2024-09-18T05:14:46.212094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001766786,"stat_sum":{"num_bytes":11169947,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":1355,"num_read_kb":5834,"num_write":158,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"67'303","reported_seq":1042,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.307302+0000","last_change":"2024-09-18T05:13:47.889554+0000","last_active":"2024-09-18T05:14:46.307302+0000","last_peered":"2024-09-18T05:14:46.307302+0000","last_clean":"2024-09-18T05:14:46.307302+0000","last_became_active":"2024-09-18T05:13:45.883970+0000","last_became_peered":"2024-09-18T05:13:45.883970+0000","last_unstale":"2024-09-18T05:14:46.307302+0000","last_undegraded":"2024-09-18T05:14:46.307302+0000","last_fullsized":"2024-09-18T05:14:46.307302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:50.318030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011236919999999999,"stat_sum":{"num_bytes":22766534,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":17,"num_read":1400,"num_read_kb":14428,"num_write":396,"num_write_kb":6301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"66'194","reported_seq":845,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141194+0000","last_change":"2024-09-18T05:13:47.875657+0000","last_active":"2024-09-18T05:14:46.141194+0000","last_peered":"2024-09-18T05:14:46.141194+0000","last_clean":"2024-09-18T05:14:46.141194+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:14:46.141194+0000","last_undegraded":"2024-09-18T05:14:46.141194+0000","last_fullsized":"2024-09-18T05:14:46.141194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070575100000000001,"stat_sum":{"num_bytes":18636439,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":10,"num_read":1366,"num_read_kb":8444,"num_write":194,"num_write_kb":7702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"64'387","reported_seq":3254,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.215314+0000","last_change":"2024-09-18T05:13:47.875757+0000","last_active":"2024-09-18T05:14:47.215314+0000","last_peered":"2024-09-18T05:14:47.215314+0000","last_clean":"2024-09-18T05:14:47.215314+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:14:47.215314+0000","last_undegraded":"2024-09-18T05:14:47.215314+0000","last_fullsized":"2024-09-18T05:14:47.215314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066626200000000004,"stat_sum":{"num_bytes":37641816,"num_objects":55,"num_object_clones":14,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":30,"num_read":4411,"num_read_kb":21647,"num_write":424,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"68'268","reported_seq":3825,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.294835+0000","last_change":"2024-09-18T05:14:15.877993+0000","last_active":"2024-09-18T05:14:47.294835+0000","last_peered":"2024-09-18T05:14:47.294835+0000","last_clean":"2024-09-18T05:14:47.294835+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:14:47.294835+0000","last_undegraded":"2024-09-18T05:14:47.294835+0000","last_fullsized":"2024-09-18T05:14:47.294835+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072282800000000001,"stat_sum":{"num_bytes":24963007,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":18,"num_read":4464,"num_read_kb":22953,"num_write":268,"num_write_kb":8859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"59'247","reported_seq":1099,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T05:14:43.120075+0000","last_change":"2024-09-18T05:14:41.123716+0000","last_active":"2024-09-18T05:14:43.120075+0000","last_peered":"2024-09-18T05:14:43.120075+0000","last_clean":"2024-09-18T05:14:43.120075+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:14:43.120075+0000","last_undegraded":"2024-09-18T05:14:43.120075+0000","last_fullsized":"2024-09-18T05:14:43.120075+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060322900000000005,"stat_sum":{"num_bytes":30521600,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":16,"num_read":2613,"num_read_kb":24722,"num_write":336,"num_write_kb":6800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"68'218","reported_seq":1967,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.400936+0000","last_change":"2024-09-18T05:13:47.875315+0000","last_active":"2024-09-18T05:14:47.400936+0000","last_peered":"2024-09-18T05:14:47.400936+0000","last_clean":"2024-09-18T05:14:47.400936+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:14:47.400936+0000","last_undegraded":"2024-09-18T05:14:47.400936+0000","last_fullsized":"2024-09-18T05:14:47.400936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000619883,"stat_sum":{"num_bytes":27333006,"num_objects":25,"num_object_clones":6,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":9,"num_read":2437,"num_read_kb":11768,"num_write":236,"num_write_kb":5540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"59'425","reported_seq":1606,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141331+0000","last_change":"2024-09-18T05:13:47.873548+0000","last_active":"2024-09-18T05:14:46.141331+0000","last_peered":"2024-09-18T05:14:46.141331+0000","last_clean":"2024-09-18T05:14:46.141331+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:14:46.141331+0000","last_undegraded":"2024-09-18T05:14:46.141331+0000","last_fullsized":"2024-09-18T05:14:46.141331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025716760000000002,"stat_sum":{"num_bytes":4780609,"num_objects":28,"num_object_clones":7,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":15,"num_read":3654,"num_read_kb":6245,"num_write":558,"num_write_kb":2604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"65'629","reported_seq":1940,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.328348+0000","last_change":"2024-09-18T05:13:47.875357+0000","last_active":"2024-09-18T05:14:47.328348+0000","last_peered":"2024-09-18T05:14:47.328348+0000","last_clean":"2024-09-18T05:14:47.328348+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:14:47.328348+0000","last_undegraded":"2024-09-18T05:14:47.328348+0000","last_fullsized":"2024-09-18T05:14:47.328348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063229599999999996,"stat_sum":{"num_bytes":8673883,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":18,"num_read":4377,"num_read_kb":9680,"num_write":1024,"num_write_kb":6032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":955269167,"num_objects":1192,"num_object_clones":340,"num_object_copies":2384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":501,"num_read":87324,"num_read_kb":499622,"num_write":12599,"num_write_kb":208509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":2595236,"num_keys_recovered":53,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33366016,"data_stored":333739242,"data_compressed":20666676,"data_compressed_allocated":21807104,"data_compressed_original":323826048,"omap_allocated":2648,"internal_metadata":0},"log_size":10024,"ondisk_log_size":10024,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45196,"kb_used_data":5656,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94326644,"statfs":{"total":96636764160,"available":96590483456,"internally_reserved":0,"allocated":5791744,"data_stored":44503941,"data_compressed":2906806,"data_compressed_allocated":3239936,"data_compressed_original":42613189,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.9980000000000002,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.86499999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":0.624},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":0.94499999999999995}]},{"osd":5,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":6,"up_from":61,"seq":261993005058,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30084,"kb_used_data":1844,"kb_used_omap":8,"kb_used_meta":28215,"kb_avail":94341756,"statfs":{"total":96636764160,"available":96605958144,"internally_reserved":0,"allocated":1888256,"data_stored":11119694,"data_compressed":623692,"data_compressed_allocated":712704,"data_compressed_original":10450901,"omap_allocated":8265,"internal_metadata":28893111},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45236,"kb_used_data":5924,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94326604,"statfs":{"total":96636764160,"available":96590442496,"internally_reserved":0,"allocated":6066176,"data_stored":52780459,"data_compressed":3421766,"data_compressed_allocated":3604480,"data_compressed_original":51069729,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.91500000000000004}]},{"osd":1,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":1.0149999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.113},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.98699999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.04},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.2430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50428,"kb_used_data":6788,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94321412,"statfs":{"total":96636764160,"available":96585125888,"internally_reserved":0,"allocated":6950912,"data_stored":62437416,"data_compressed":3935268,"data_compressed_allocated":4124672,"data_compressed_original":60418795,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.505}]},{"osd":2,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.98599999999999999}]},{"osd":5,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.042}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34460,"kb_used_data":7444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337380,"statfs":{"total":96636764160,"available":96601477120,"internally_reserved":0,"allocated":7622656,"data_stored":72076067,"data_compressed":4386323,"data_compressed_allocated":4575232,"data_compressed_original":69656869,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.752},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":0.68899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1708032,"data_stored":10757378,"data_compressed":615635,"data_compressed_allocated":462848,"data_compressed_original":9981952,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.623},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.3979999999999997,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":1.0629999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.03}]},{"osd":3,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.99399999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.67600000000000005}]},{"osd":5,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":7,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.1160000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38820,"kb_used_data":3600,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94333020,"statfs":{"total":96636764160,"available":96597012480,"internally_reserved":0,"allocated":3686400,"data_stored":34942758,"data_compressed":2034887,"data_compressed_allocated":1966080,"data_compressed_original":33675503,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.56200000000000006}]},{"osd":2,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.32200000000000001}]},{"osd":3,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.41299999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":7,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.625},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":5776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":5914624,"data_stored":48812469,"data_compressed":2795958,"data_compressed_allocated":3207168,"data_compressed_original":46871964,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.95299999999999996}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.286},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.087}]},{"osd":3,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.623},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.381}]},{"osd":4,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.73399999999999999}]},{"osd":5,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.343},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":1.044}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5111808,"data_stored":47946575,"data_compressed":2764873,"data_compressed_allocated":3166208,"data_compressed_original":46347676,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2916352,"data_stored":34688628,"data_compressed":2040303,"data_compressed_allocated":1966080,"data_compressed_original":33767940,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":933888,"data_stored":10410756,"data_compressed":615635,"data_compressed_allocated":462848,"data_compressed_original":9981952,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6828032,"data_stored":71717680,"data_compressed":4386323,"data_compressed_allocated":4575232,"data_compressed_original":69656869,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6205440,"data_stored":62201124,"data_compressed":3940684,"data_compressed_allocated":4124672,"data_compressed_original":60511232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5279744,"data_stored":52428201,"data_compressed":3421766,"data_compressed_allocated":3604480,"data_compressed_original":51069729,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1146880,"data_stored":10784944,"data_compressed":623692,"data_compressed_allocated":712704,"data_compressed_original":10450901,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4943872,"data_stored":43561334,"data_compressed":2873400,"data_compressed_allocated":3194880,"data_compressed_original":42039749,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:14:48.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:14:48.594 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:48.578+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:48.685 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:48.678+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:48.747 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:48.747 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:48.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:48.806 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:48.802+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:48.886 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:48.881+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:48.932 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:48.932 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:14:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:14:48.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:48.965 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-09-18T05:14:48.572169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":955859554,"num_objects":1196,"num_object_clones":340,"num_object_copies":2392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":501,"num_read":87440,"num_read_kb":499722,"num_write":12760,"num_write_kb":210927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":2595236,"num_keys_recovered":53,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10144,"ondisk_log_size":10144,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309820,"kb_used_data":38700,"kb_used_omap":18,"kb_used_meta":270509,"kb_avail":754664900,"statfs":{"total":773094113280,"available":772776857600,"internally_reserved":0,"allocated":39628800,"data_stored":337430182,"data_compressed":20720335,"data_compressed_allocated":21893120,"data_compressed_original":324738902,"omap_allocated":19416,"internal_metadata":277001256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":121113502,"num_objects":47,"num_object_clones":22,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-18,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":14,"num_read":5933,"num_read_kb":22954,"num_write":711,"num_write_kb":5539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001045"},"pg_stats":[{"pgid":"3.1f","version":"65'461","reported_seq":1862,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141490+0000","last_change":"2024-09-18T05:13:47.874353+0000","last_active":"2024-09-18T05:14:46.141490+0000","last_peered":"2024-09-18T05:14:46.141490+0000","last_clean":"2024-09-18T05:14:46.141490+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:14:46.141490+0000","last_undegraded":"2024-09-18T05:14:46.141490+0000","last_fullsized":"2024-09-18T05:14:46.141490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002377985,"stat_sum":{"num_bytes":34012366,"num_objects":43,"num_object_clones":13,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":17,"num_read":2813,"num_read_kb":15510,"num_write":665,"num_write_kb":7710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"68'1097","reported_seq":3371,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.332284+0000","last_change":"2024-09-18T05:14:44.123599+0000","last_active":"2024-09-18T05:14:47.332284+0000","last_peered":"2024-09-18T05:14:47.332284+0000","last_clean":"2024-09-18T05:14:47.332284+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:14:47.332284+0000","last_undegraded":"2024-09-18T05:14:47.332284+0000","last_fullsized":"2024-09-18T05:14:47.332284+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001660138,"stat_sum":{"num_bytes":27749495,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":7490,"num_read_kb":17862,"num_write":1801,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"66'236","reported_seq":984,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.182492+0000","last_change":"2024-09-18T05:13:47.889261+0000","last_active":"2024-09-18T05:14:46.182492+0000","last_peered":"2024-09-18T05:14:46.182492+0000","last_clean":"2024-09-18T05:14:46.182492+0000","last_became_active":"2024-09-18T05:13:45.883512+0000","last_became_peered":"2024-09-18T05:13:45.883512+0000","last_unstale":"2024-09-18T05:14:46.182492+0000","last_undegraded":"2024-09-18T05:14:46.182492+0000","last_fullsized":"2024-09-18T05:14:46.182492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:13.538982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080162099999999997,"stat_sum":{"num_bytes":10858625,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":20,"num_read":960,"num_read_kb":7332,"num_write":256,"num_write_kb":7800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"68'494","reported_seq":2025,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.354655+0000","last_change":"2024-09-18T05:13:47.889511+0000","last_active":"2024-09-18T05:14:47.354655+0000","last_peered":"2024-09-18T05:14:47.354655+0000","last_clean":"2024-09-18T05:14:47.354655+0000","last_became_active":"2024-09-18T05:13:45.890406+0000","last_became_peered":"2024-09-18T05:13:45.890406+0000","last_unstale":"2024-09-18T05:14:47.354655+0000","last_undegraded":"2024-09-18T05:14:47.354655+0000","last_fullsized":"2024-09-18T05:14:47.354655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:49:08.888102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001443443,"stat_sum":{"num_bytes":39971790,"num_objects":47,"num_object_clones":11,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":19,"num_read":3823,"num_read_kb":20970,"num_write":663,"num_write_kb":7445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"68'181","reported_seq":793,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.391533+0000","last_change":"2024-09-18T05:13:47.872985+0000","last_active":"2024-09-18T05:14:47.391533+0000","last_peered":"2024-09-18T05:14:47.391533+0000","last_clean":"2024-09-18T05:14:47.391533+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:14:47.391533+0000","last_undegraded":"2024-09-18T05:14:47.391533+0000","last_fullsized":"2024-09-18T05:14:47.391533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016154539999999999,"stat_sum":{"num_bytes":52862645,"num_objects":42,"num_object_clones":15,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":18,"num_read":633,"num_read_kb":14289,"num_write":190,"num_write_kb":10366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"68'206","reported_seq":1963,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.395896+0000","last_change":"2024-09-18T05:13:47.881254+0000","last_active":"2024-09-18T05:14:47.395896+0000","last_peered":"2024-09-18T05:14:47.395896+0000","last_clean":"2024-09-18T05:14:47.395896+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:14:47.395896+0000","last_undegraded":"2024-09-18T05:14:47.395896+0000","last_fullsized":"2024-09-18T05:14:47.395896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091901600000000004,"stat_sum":{"num_bytes":27280737,"num_objects":37,"num_object_clones":12,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":1777,"num_read_kb":13080,"num_write":203,"num_write_kb":6031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"67'268","reported_seq":2644,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.349076+0000","last_change":"2024-09-18T05:13:47.880516+0000","last_active":"2024-09-18T05:14:47.349076+0000","last_peered":"2024-09-18T05:14:47.349076+0000","last_clean":"2024-09-18T05:14:47.349076+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:14:47.349076+0000","last_undegraded":"2024-09-18T05:14:47.349076+0000","last_fullsized":"2024-09-18T05:14:47.349076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042422500000000003,"stat_sum":{"num_bytes":41252232,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":13,"num_read":4196,"num_read_kb":14550,"num_write":264,"num_write_kb":6129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"68'425","reported_seq":1572,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.393758+0000","last_change":"2024-09-18T05:13:47.895130+0000","last_active":"2024-09-18T05:14:47.393758+0000","last_peered":"2024-09-18T05:14:47.393758+0000","last_clean":"2024-09-18T05:14:47.393758+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:14:47.393758+0000","last_undegraded":"2024-09-18T05:14:47.393758+0000","last_fullsized":"2024-09-18T05:14:47.393758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000585963,"stat_sum":{"num_bytes":38573558,"num_objects":43,"num_object_clones":14,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":19,"num_read":2164,"num_read_kb":16850,"num_write":546,"num_write_kb":4810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"68'259","reported_seq":1537,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.391562+0000","last_change":"2024-09-18T05:13:47.874514+0000","last_active":"2024-09-18T05:14:47.391562+0000","last_peered":"2024-09-18T05:14:47.391562+0000","last_clean":"2024-09-18T05:14:47.391562+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:14:47.391562+0000","last_undegraded":"2024-09-18T05:14:47.391562+0000","last_fullsized":"2024-09-18T05:14:47.391562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021885429999999998,"stat_sum":{"num_bytes":37856356,"num_objects":42,"num_object_clones":16,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":21,"num_read":1790,"num_read_kb":9024,"num_write":239,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"65'349","reported_seq":3496,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.179109+0000","last_change":"2024-09-18T05:13:47.888939+0000","last_active":"2024-09-18T05:14:47.179109+0000","last_peered":"2024-09-18T05:14:47.179109+0000","last_clean":"2024-09-18T05:14:47.179109+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:14:47.179109+0000","last_undegraded":"2024-09-18T05:14:47.179109+0000","last_fullsized":"2024-09-18T05:14:47.179109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081828800000000002,"stat_sum":{"num_bytes":45285929,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":4372,"num_read_kb":23190,"num_write":429,"num_write_kb":6918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"65'308","reported_seq":4423,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.154907+0000","last_change":"2024-09-18T05:13:47.875490+0000","last_active":"2024-09-18T05:14:47.154907+0000","last_peered":"2024-09-18T05:14:47.154907+0000","last_clean":"2024-09-18T05:14:47.154907+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:14:47.154907+0000","last_undegraded":"2024-09-18T05:14:47.154907+0000","last_fullsized":"2024-09-18T05:14:47.154907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068601800000000004,"stat_sum":{"num_bytes":59879077,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":4558,"num_read_kb":37370,"num_write":398,"num_write_kb":12677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"67'293","reported_seq":1219,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.453310+0000","last_change":"2024-09-18T05:13:47.881467+0000","last_active":"2024-09-18T05:14:46.453310+0000","last_peered":"2024-09-18T05:14:46.453310+0000","last_clean":"2024-09-18T05:14:46.453310+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:14:46.453310+0000","last_undegraded":"2024-09-18T05:14:46.453310+0000","last_fullsized":"2024-09-18T05:14:46.453310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147750000000001,"stat_sum":{"num_bytes":39093950,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":19,"num_read":1323,"num_read_kb":11797,"num_write":330,"num_write_kb":4926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T05:14:43.119884+0000","last_change":"2024-09-18T05:14:41.375842+0000","last_active":"2024-09-18T05:14:43.119884+0000","last_peered":"2024-09-18T05:14:43.119884+0000","last_clean":"2024-09-18T05:14:43.119884+0000","last_became_active":"2024-09-18T05:14:41.375168+0000","last_became_peered":"2024-09-18T05:14:41.375168+0000","last_unstale":"2024-09-18T05:14:43.119884+0000","last_undegraded":"2024-09-18T05:14:43.119884+0000","last_fullsized":"2024-09-18T05:14:43.119884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:10:30.973479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"68'262","reported_seq":2028,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.214090+0000","last_change":"2024-09-18T05:13:47.873517+0000","last_active":"2024-09-18T05:14:47.214090+0000","last_peered":"2024-09-18T05:14:47.214090+0000","last_clean":"2024-09-18T05:14:47.214090+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:14:47.214090+0000","last_undegraded":"2024-09-18T05:14:47.214090+0000","last_fullsized":"2024-09-18T05:14:47.214090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019230849999999999,"stat_sum":{"num_bytes":25928883,"num_objects":31,"num_object_clones":7,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":15,"num_read":2398,"num_read_kb":21811,"num_write":359,"num_write_kb":10012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.140438+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:14:46.140438+0000","last_peered":"2024-09-18T05:14:46.140438+0000","last_clean":"2024-09-18T05:14:46.140438+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:14:46.140438+0000","last_undegraded":"2024-09-18T05:14:46.140438+0000","last_fullsized":"2024-09-18T05:14:46.140438+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"68'277","reported_seq":1864,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.393932+0000","last_change":"2024-09-18T05:13:47.897304+0000","last_active":"2024-09-18T05:14:47.393932+0000","last_peered":"2024-09-18T05:14:47.393932+0000","last_clean":"2024-09-18T05:14:47.393932+0000","last_became_active":"2024-09-18T05:13:45.882587+0000","last_became_peered":"2024-09-18T05:13:45.882587+0000","last_unstale":"2024-09-18T05:14:47.393932+0000","last_undegraded":"2024-09-18T05:14:47.393932+0000","last_fullsized":"2024-09-18T05:14:47.393932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:27:19.084581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021450010000000001,"stat_sum":{"num_bytes":34383241,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":13,"num_read":2457,"num_read_kb":21096,"num_write":321,"num_write_kb":7211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141292+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:14:46.141292+0000","last_peered":"2024-09-18T05:14:46.141292+0000","last_clean":"2024-09-18T05:14:46.141292+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:14:46.141292+0000","last_undegraded":"2024-09-18T05:14:46.141292+0000","last_fullsized":"2024-09-18T05:14:46.141292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"68'161","reported_seq":849,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.147279+0000","last_change":"2024-09-18T05:13:47.880769+0000","last_active":"2024-09-18T05:14:47.147279+0000","last_peered":"2024-09-18T05:14:47.147279+0000","last_clean":"2024-09-18T05:14:47.147279+0000","last_became_active":"2024-09-18T05:13:46.174136+0000","last_became_peered":"2024-09-18T05:13:46.174136+0000","last_unstale":"2024-09-18T05:14:47.147279+0000","last_undegraded":"2024-09-18T05:14:47.147279+0000","last_fullsized":"2024-09-18T05:14:47.147279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:52.243601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058757199999999996,"stat_sum":{"num_bytes":41927633,"num_objects":35,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":839,"num_read_kb":11921,"num_write":234,"num_write_kb":6731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.140503+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:14:46.140503+0000","last_peered":"2024-09-18T05:14:46.140503+0000","last_clean":"2024-09-18T05:14:46.140503+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:14:46.140503+0000","last_undegraded":"2024-09-18T05:14:46.140503+0000","last_fullsized":"2024-09-18T05:14:46.140503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"65'216","reported_seq":1873,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.356500+0000","last_change":"2024-09-18T05:13:47.889820+0000","last_active":"2024-09-18T05:14:47.356500+0000","last_peered":"2024-09-18T05:14:47.356500+0000","last_clean":"2024-09-18T05:14:47.356500+0000","last_became_active":"2024-09-18T05:13:45.881482+0000","last_became_peered":"2024-09-18T05:13:45.881482+0000","last_unstale":"2024-09-18T05:14:47.356500+0000","last_undegraded":"2024-09-18T05:14:47.356500+0000","last_fullsized":"2024-09-18T05:14:47.356500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:50:34.961113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013457199999999999,"stat_sum":{"num_bytes":42129549,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":13,"num_read":1689,"num_read_kb":16021,"num_write":217,"num_write_kb":11169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"68'417","reported_seq":2517,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.393301+0000","last_change":"2024-09-18T05:13:47.881241+0000","last_active":"2024-09-18T05:14:47.393301+0000","last_peered":"2024-09-18T05:14:47.393301+0000","last_clean":"2024-09-18T05:14:47.393301+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:14:47.393301+0000","last_undegraded":"2024-09-18T05:14:47.393301+0000","last_fullsized":"2024-09-18T05:14:47.393301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087944100000000001,"stat_sum":{"num_bytes":38018355,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":15,"num_read":3330,"num_read_kb":20787,"num_write":608,"num_write_kb":12377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.181951+0000","last_change":"2024-09-18T05:13:37.897308+0000","last_active":"2024-09-18T05:14:46.181951+0000","last_peered":"2024-09-18T05:14:46.181951+0000","last_clean":"2024-09-18T05:14:46.181951+0000","last_became_active":"2024-09-18T05:13:35.880281+0000","last_became_peered":"2024-09-18T05:13:35.880281+0000","last_unstale":"2024-09-18T05:14:46.181951+0000","last_undegraded":"2024-09-18T05:14:46.181951+0000","last_fullsized":"2024-09-18T05:14:46.181951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"68'263","reported_seq":1864,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.391068+0000","last_change":"2024-09-18T05:13:47.880771+0000","last_active":"2024-09-18T05:14:47.391068+0000","last_peered":"2024-09-18T05:14:47.391068+0000","last_clean":"2024-09-18T05:14:47.391068+0000","last_became_active":"2024-09-18T05:13:46.174696+0000","last_became_peered":"2024-09-18T05:13:46.174696+0000","last_unstale":"2024-09-18T05:14:47.391068+0000","last_undegraded":"2024-09-18T05:14:47.391068+0000","last_fullsized":"2024-09-18T05:14:47.391068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:04:21.805854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058553999999999995,"stat_sum":{"num_bytes":30089752,"num_objects":40,"num_object_clones":14,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":15,"num_read":2307,"num_read_kb":12272,"num_write":257,"num_write_kb":4579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.212559+0000","last_change":"2024-09-18T05:13:37.887642+0000","last_active":"2024-09-18T05:14:46.212559+0000","last_peered":"2024-09-18T05:14:46.212559+0000","last_clean":"2024-09-18T05:14:46.212559+0000","last_became_active":"2024-09-18T05:13:36.135298+0000","last_became_peered":"2024-09-18T05:13:36.135298+0000","last_unstale":"2024-09-18T05:14:46.212559+0000","last_undegraded":"2024-09-18T05:14:46.212559+0000","last_fullsized":"2024-09-18T05:14:46.212559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.310834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088184600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'172","reported_seq":1370,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141304+0000","last_change":"2024-09-18T05:13:47.872235+0000","last_active":"2024-09-18T05:14:46.141304+0000","last_peered":"2024-09-18T05:14:46.141304+0000","last_clean":"2024-09-18T05:14:46.141304+0000","last_became_active":"2024-09-18T05:13:45.870133+0000","last_became_peered":"2024-09-18T05:13:45.870133+0000","last_unstale":"2024-09-18T05:14:46.141304+0000","last_undegraded":"2024-09-18T05:14:46.141304+0000","last_fullsized":"2024-09-18T05:14:46.141304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:02:08.230414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014534350000000001,"stat_sum":{"num_bytes":6263892,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":17,"num_read":1320,"num_read_kb":3794,"num_write":189,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.140851+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:14:46.140851+0000","last_peered":"2024-09-18T05:14:46.140851+0000","last_clean":"2024-09-18T05:14:46.140851+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:14:46.140851+0000","last_undegraded":"2024-09-18T05:14:46.140851+0000","last_fullsized":"2024-09-18T05:14:46.140851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"59'303","reported_seq":2976,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.145949+0000","last_change":"2024-09-18T05:13:47.897422+0000","last_active":"2024-09-18T05:14:46.145949+0000","last_peered":"2024-09-18T05:14:46.145949+0000","last_clean":"2024-09-18T05:14:46.145949+0000","last_became_active":"2024-09-18T05:13:45.878063+0000","last_became_peered":"2024-09-18T05:13:45.878063+0000","last_unstale":"2024-09-18T05:14:46.145949+0000","last_undegraded":"2024-09-18T05:14:46.145949+0000","last_fullsized":"2024-09-18T05:14:46.145949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:53.493537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023719930000000002,"stat_sum":{"num_bytes":32478072,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":4710,"num_read_kb":21118,"num_write":321,"num_write_kb":7633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.182004+0000","last_change":"2024-09-18T05:13:37.896005+0000","last_active":"2024-09-18T05:14:46.182004+0000","last_peered":"2024-09-18T05:14:46.182004+0000","last_clean":"2024-09-18T05:14:46.182004+0000","last_became_active":"2024-09-18T05:13:35.878921+0000","last_became_peered":"2024-09-18T05:13:35.878921+0000","last_unstale":"2024-09-18T05:14:46.182004+0000","last_undegraded":"2024-09-18T05:14:46.182004+0000","last_fullsized":"2024-09-18T05:14:46.182004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:03.020943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.140744+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:14:46.140744+0000","last_peered":"2024-09-18T05:14:46.140744+0000","last_clean":"2024-09-18T05:14:46.140744+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:14:46.140744+0000","last_undegraded":"2024-09-18T05:14:46.140744+0000","last_fullsized":"2024-09-18T05:14:46.140744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"68'161","reported_seq":1805,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.385605+0000","last_change":"2024-09-18T05:13:47.896354+0000","last_active":"2024-09-18T05:14:47.385605+0000","last_peered":"2024-09-18T05:14:47.385605+0000","last_clean":"2024-09-18T05:14:47.385605+0000","last_became_active":"2024-09-18T05:13:45.873640+0000","last_became_peered":"2024-09-18T05:13:45.873640+0000","last_unstale":"2024-09-18T05:14:47.385605+0000","last_undegraded":"2024-09-18T05:14:47.385605+0000","last_fullsized":"2024-09-18T05:14:47.385605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:45.276749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001525368,"stat_sum":{"num_bytes":13628034,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":9,"num_read":2986,"num_read_kb":21497,"num_write":159,"num_write_kb":8078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"59'139","reported_seq":1519,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.154033+0000","last_change":"2024-09-18T05:13:47.880748+0000","last_active":"2024-09-18T05:14:46.154033+0000","last_peered":"2024-09-18T05:14:46.154033+0000","last_clean":"2024-09-18T05:14:46.154033+0000","last_became_active":"2024-09-18T05:13:46.177331+0000","last_became_peered":"2024-09-18T05:13:46.177331+0000","last_unstale":"2024-09-18T05:14:46.154033+0000","last_undegraded":"2024-09-18T05:14:46.154033+0000","last_fullsized":"2024-09-18T05:14:46.154033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:38:10.519505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044114000000000002,"stat_sum":{"num_bytes":30422856,"num_objects":36,"num_object_clones":14,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":16,"num_read":1384,"num_read_kb":9977,"num_write":123,"num_write_kb":2163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"63'229","reported_seq":1557,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-18T05:14:44.125964+0000","last_change":"2024-09-18T05:14:44.126112+0000","last_active":"2024-09-18T05:14:44.125964+0000","last_peered":"2024-09-18T05:14:44.125964+0000","last_clean":"2024-09-18T05:14:21.001832+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:14:44.125964+0000","last_undegraded":"2024-09-18T05:14:44.125964+0000","last_fullsized":"2024-09-18T05:14:44.125964+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070131499999999999,"stat_sum":{"num_bytes":18835299,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":10,"num_read":1928,"num_read_kb":11783,"num_write":233,"num_write_kb":3856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"67'176","reported_seq":1527,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.212094+0000","last_change":"2024-09-18T05:13:47.896719+0000","last_active":"2024-09-18T05:14:46.212094+0000","last_peered":"2024-09-18T05:14:46.212094+0000","last_clean":"2024-09-18T05:14:46.212094+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:14:46.212094+0000","last_undegraded":"2024-09-18T05:14:46.212094+0000","last_fullsized":"2024-09-18T05:14:46.212094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001766786,"stat_sum":{"num_bytes":11169947,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":1355,"num_read_kb":5834,"num_write":158,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"67'303","reported_seq":1042,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.307302+0000","last_change":"2024-09-18T05:13:47.889554+0000","last_active":"2024-09-18T05:14:46.307302+0000","last_peered":"2024-09-18T05:14:46.307302+0000","last_clean":"2024-09-18T05:14:46.307302+0000","last_became_active":"2024-09-18T05:13:45.883970+0000","last_became_peered":"2024-09-18T05:13:45.883970+0000","last_unstale":"2024-09-18T05:14:46.307302+0000","last_undegraded":"2024-09-18T05:14:46.307302+0000","last_fullsized":"2024-09-18T05:14:46.307302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:50.318030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011236919999999999,"stat_sum":{"num_bytes":22766534,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":17,"num_read":1400,"num_read_kb":14428,"num_write":396,"num_write_kb":6301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"66'194","reported_seq":845,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141194+0000","last_change":"2024-09-18T05:13:47.875657+0000","last_active":"2024-09-18T05:14:46.141194+0000","last_peered":"2024-09-18T05:14:46.141194+0000","last_clean":"2024-09-18T05:14:46.141194+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:14:46.141194+0000","last_undegraded":"2024-09-18T05:14:46.141194+0000","last_fullsized":"2024-09-18T05:14:46.141194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070575100000000001,"stat_sum":{"num_bytes":18636439,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":10,"num_read":1366,"num_read_kb":8444,"num_write":194,"num_write_kb":7702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"64'387","reported_seq":3254,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.215314+0000","last_change":"2024-09-18T05:13:47.875757+0000","last_active":"2024-09-18T05:14:47.215314+0000","last_peered":"2024-09-18T05:14:47.215314+0000","last_clean":"2024-09-18T05:14:47.215314+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:14:47.215314+0000","last_undegraded":"2024-09-18T05:14:47.215314+0000","last_fullsized":"2024-09-18T05:14:47.215314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066626200000000004,"stat_sum":{"num_bytes":37641816,"num_objects":55,"num_object_clones":14,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":30,"num_read":4411,"num_read_kb":21647,"num_write":424,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"68'268","reported_seq":3825,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.294835+0000","last_change":"2024-09-18T05:14:15.877993+0000","last_active":"2024-09-18T05:14:47.294835+0000","last_peered":"2024-09-18T05:14:47.294835+0000","last_clean":"2024-09-18T05:14:47.294835+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:14:47.294835+0000","last_undegraded":"2024-09-18T05:14:47.294835+0000","last_fullsized":"2024-09-18T05:14:47.294835+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072282800000000001,"stat_sum":{"num_bytes":24963007,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":18,"num_read":4464,"num_read_kb":22953,"num_write":268,"num_write_kb":8859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"59'247","reported_seq":1099,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T05:14:43.120075+0000","last_change":"2024-09-18T05:14:41.123716+0000","last_active":"2024-09-18T05:14:43.120075+0000","last_peered":"2024-09-18T05:14:43.120075+0000","last_clean":"2024-09-18T05:14:43.120075+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:14:43.120075+0000","last_undegraded":"2024-09-18T05:14:43.120075+0000","last_fullsized":"2024-09-18T05:14:43.120075+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060322900000000005,"stat_sum":{"num_bytes":30521600,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":16,"num_read":2613,"num_read_kb":24722,"num_write":336,"num_write_kb":6800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"68'218","reported_seq":1967,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.400936+0000","last_change":"2024-09-18T05:13:47.875315+0000","last_active":"2024-09-18T05:14:47.400936+0000","last_peered":"2024-09-18T05:14:47.400936+0000","last_clean":"2024-09-18T05:14:47.400936+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:14:47.400936+0000","last_undegraded":"2024-09-18T05:14:47.400936+0000","last_fullsized":"2024-09-18T05:14:47.400936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000619883,"stat_sum":{"num_bytes":27333006,"num_objects":25,"num_object_clones":6,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":9,"num_read":2437,"num_read_kb":11768,"num_write":236,"num_write_kb":5540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"59'425","reported_seq":1606,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-18T05:14:46.141331+0000","last_change":"2024-09-18T05:13:47.873548+0000","last_active":"2024-09-18T05:14:46.141331+0000","last_peered":"2024-09-18T05:14:46.141331+0000","last_clean":"2024-09-18T05:14:46.141331+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:14:46.141331+0000","last_undegraded":"2024-09-18T05:14:46.141331+0000","last_fullsized":"2024-09-18T05:14:46.141331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025716760000000002,"stat_sum":{"num_bytes":4780609,"num_objects":28,"num_object_clones":7,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":15,"num_read":3654,"num_read_kb":6245,"num_write":558,"num_write_kb":2604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"65'629","reported_seq":1940,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-18T05:14:47.328348+0000","last_change":"2024-09-18T05:13:47.875357+0000","last_active":"2024-09-18T05:14:47.328348+0000","last_peered":"2024-09-18T05:14:47.328348+0000","last_clean":"2024-09-18T05:14:47.328348+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:14:47.328348+0000","last_undegraded":"2024-09-18T05:14:47.328348+0000","last_fullsized":"2024-09-18T05:14:47.328348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063229599999999996,"stat_sum":{"num_bytes":8673883,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":18,"num_read":4377,"num_read_kb":9680,"num_write":1024,"num_write_kb":6032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":955269167,"num_objects":1192,"num_object_clones":340,"num_object_copies":2384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":501,"num_read":87324,"num_read_kb":499622,"num_write":12599,"num_write_kb":208509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":2595236,"num_keys_recovered":53,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33366016,"data_stored":333739242,"data_compressed":20666676,"data_compressed_allocated":21807104,"data_compressed_original":323826048,"omap_allocated":2648,"internal_metadata":0},"log_size":10024,"ondisk_log_size":10024,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45196,"kb_used_data":5656,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94326644,"statfs":{"total":96636764160,"available":96590483456,"internally_reserved":0,"allocated":5791744,"data_stored":44503941,"data_compressed":2906806,"data_compressed_allocated":3239936,"data_compressed_original":42613189,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.9980000000000002,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.86499999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":0.624},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":0.94499999999999995}]},{"osd":5,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":6,"up_from":61,"seq":261993005058,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30084,"kb_used_data":1844,"kb_used_omap":8,"kb_used_meta":28215,"kb_avail":94341756,"statfs":{"total":96636764160,"available":96605958144,"internally_reserved":0,"allocated":1888256,"data_stored":11119694,"data_compressed":623692,"data_compressed_allocated":712704,"data_compressed_original":10450901,"omap_allocated":8265,"internal_metadata":28893111},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45236,"kb_used_data":5924,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94326604,"statfs":{"total":96636764160,"available":96590442496,"internally_reserved":0,"allocated":6066176,"data_stored":52780459,"data_compressed":3421766,"data_compressed_allocated":3604480,"data_compressed_original":51069729,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.91500000000000004}]},{"osd":1,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":1.0149999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.113},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.98699999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.04},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.2430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50428,"kb_used_data":6788,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94321412,"statfs":{"total":96636764160,"available":96585125888,"internally_reserved":0,"allocated":6950912,"data_stored":62437416,"data_compressed":3935268,"data_compressed_allocated":4124672,"data_compressed_original":60418795,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.505}]},{"osd":2,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.98599999999999999}]},{"osd":5,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.042}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34460,"kb_used_data":7444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337380,"statfs":{"total":96636764160,"available":96601477120,"internally_reserved":0,"allocated":7622656,"data_stored":72076067,"data_compressed":4386323,"data_compressed_allocated":4575232,"data_compressed_original":69656869,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.752},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":0.68899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1708032,"data_stored":10757378,"data_compressed":615635,"data_compressed_allocated":462848,"data_compressed_original":9981952,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.623},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.3979999999999997,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":1.0629999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.03}]},{"osd":3,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.99399999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.67600000000000005}]},{"osd":5,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":7,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.1160000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38820,"kb_used_data":3600,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94333020,"statfs":{"total":96636764160,"available":96597012480,"internally_reserved":0,"allocated":3686400,"data_stored":34942758,"data_compressed":2034887,"data_compressed_allocated":1966080,"data_compressed_original":33675503,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.56200000000000006}]},{"osd":2,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.32200000000000001}]},{"osd":3,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.41299999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":7,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.625},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":5776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":5914624,"data_stored":48812469,"data_compressed":2795958,"data_compressed_allocated":3207168,"data_compressed_original":46871964,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.95299999999999996}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.286},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.087}]},{"osd":3,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.623},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.381}]},{"osd":4,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.73399999999999999}]},{"osd":5,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.343},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":1.044}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5111808,"data_stored":47946575,"data_compressed":2764873,"data_compressed_allocated":3166208,"data_compressed_original":46347676,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2916352,"data_stored":34688628,"data_compressed":2040303,"data_compressed_allocated":1966080,"data_compressed_original":33767940,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":933888,"data_stored":10410756,"data_compressed":615635,"data_compressed_allocated":462848,"data_compressed_original":9981952,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6828032,"data_stored":71717680,"data_compressed":4386323,"data_compressed_allocated":4575232,"data_compressed_original":69656869,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6205440,"data_stored":62201124,"data_compressed":3940684,"data_compressed_allocated":4124672,"data_compressed_original":60511232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5279744,"data_stored":52428201,"data_compressed":3421766,"data_compressed_allocated":3604480,"data_compressed_original":51069729,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1146880,"data_stored":10784944,"data_compressed":623692,"data_compressed_allocated":712704,"data_compressed_original":10450901,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4943872,"data_stored":43561334,"data_compressed":2873400,"data_compressed_allocated":3194880,"data_compressed_original":42039749,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:14:48.968 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-18T05:14:48.968 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:14:48.969 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-18T05:14:48.969 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T05:14:48.969 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T05:14:48.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-18T05:14:48.987 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:48.981+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:49.083 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.257008536000001, 2024-09-18T05:14:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:14:49.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:14:49.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.087 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:9001 3.4 e29/22 3:224b1375:::rbd_data.118beb25b049.0000000000000128:head v 29'42, mlcod=29'40)", 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.117484320000003, 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002309742, 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961961+0000", 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.961959+0000", 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962023+0000", 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3678999999999998e-05 2024-09-18T05:14:49.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962057+0000", 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4606e-05 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962078+0000", 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1109999999999999e-05 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962204+0000", 2024-09-18T05:14:49.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125306 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.962271+0000", 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7009999999999997e-05 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964181+0000", 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019100619999999999 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:56.964271+0000", 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9819000000000002e-05 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.263370793, 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:14:49.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:14:49.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.260753995999998, 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16290 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'52, mlcod=32'49)", 2024-09-18T05:14:49.100 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.259663291999999, 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023378159999999999, 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:49.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819780+0000", 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819796+0000", 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325999999999999e-05 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819826+0000", 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9583000000000001e-05 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819845+0000", 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8597000000000002e-05 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819950+0000", 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105356 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820003+0000", 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3295999999999999e-05 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822018+0000", 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020151779999999998 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822120+0000", 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101316 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.178218483999999, 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:49.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:14:49.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.803680790999998, 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.109 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:14:49.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:14:49.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17196 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'90, mlcod=32'86)", 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:49.113 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.795794209, 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023459290000000001, 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283650+0000", 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283663+0000", 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2697999999999999e-05 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283682+0000", 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9012999999999999e-05 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283691+0000", 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7720000000000006e-06 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283777+0000", 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5923999999999999e-05 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283830+0000", 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2320000000000001e-05 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285942+0000", 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002112039 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285997+0000", 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5322000000000003e-05 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21891 3.0 e36/22 3:04d4c8a4:::rbd_data.118ba5d0bdf6.0000000000000259:head v 36'100, mlcod=36'98)", 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.609672326000002, 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022905260000000002, 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469773+0000", 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469771+0000", 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469789+0000", 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.821e-05 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469821+0000", 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1335999999999999e-05 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469839+0000", 2024-09-18T05:14:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-05 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469944+0000", 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104576 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.469996+0000", 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2102999999999999e-05 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471954+0000", 2024-09-18T05:14:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019575980000000001 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472063+0000", 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010984600000000001 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:21892 3.9 e36/22 3:924cec9d:::rbd_data.118ba5d0bdf6.00000000000002ed:head v 36'65, mlcod=36'62)", 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.608708300000004, 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023311389999999999, 2024-09-18T05:14:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470737+0000", 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470735+0000", 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470750+0000", 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470788+0000", 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7252999999999997e-05 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470806+0000", 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8105999999999999e-05 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.470949+0000", 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014359600000000001 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.471048+0000", 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8888999999999995e-05 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.472956+0000", 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019074820000000001 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:07.473068+0000", 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011240599999999999 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.112751609, 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:14:49.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:14:49.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:14:49.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:45232 3.9 e50/22 3:9465da8c:::rbd_data.118bbcb4fc94.000000000000000d:head v 50'101, mlcod=49'99)", 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.680029197, 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364489, 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399415+0000", 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399425+0000", 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5429999999999999e-06 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399455+0000", 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9887e-05 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399472+0000", 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6821e-05 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399619+0000", 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146971 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399693+0000", 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4004999999999994e-05 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401682+0000", 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019894869999999999 2024-09-18T05:14:49.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401781+0000", 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8471e-05 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47581 3.4 e52/22 3:24a94b22:::rbd_data.118ba98b16f7.0000000000000011:head v 52'130, mlcod=52'128)", 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.41477905, 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033849169999999999, 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664664+0000", 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664684+0000", 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0044e-05 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664730+0000", 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6097000000000003e-05 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664751+0000", 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1024000000000001e-05 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664942+0000", 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190538 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664998+0000", 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6786999999999997e-05 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.667951+0000", 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029529040000000001 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668051+0000", 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9866999999999998e-05 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47585 3.4 e52/22 3:277480c1:::rbd_data.118ba98b16f7.0000000000000015:head v 52'131, mlcod=52'128)", 2024-09-18T05:14:49.139 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.414033823, 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027129139999999999, 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665410+0000", 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665425+0000", 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.499e-05 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665451+0000", 2024-09-18T05:14:49.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5936999999999999e-05 2024-09-18T05:14:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665468+0000", 2024-09-18T05:14:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7430000000000001e-05 2024-09-18T05:14:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665537+0000", 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8703999999999998e-05 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665585+0000", 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8060999999999999e-05 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668061+0000", 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024756779999999998 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668124+0000", 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3676999999999994e-05 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47704 3.0 e52/22 3:04568dbb:::rbd_data.118ba98b16f7.000000000000005e:head v 52'153, mlcod=52'151)", 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.876932+0000", 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.202513380999999, 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002262773, 2024-09-18T05:14:49.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876932+0000", 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876932+0000", 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876930+0000", 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.876987+0000", 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7064000000000001e-05 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877022+0000", 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5750000000000002e-05 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877038+0000", 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5509999999999999e-05 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877147+0000", 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108798 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.877203+0000", 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6153999999999998e-05 2024-09-18T05:14:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.879122+0000", 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00191877 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.879195+0000", 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3073999999999999e-05 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50861 3.9 e57/22 3:937da5aa:::rbd_data.118bea12bf49.0000000000000015:head v 57'133, mlcod=56'130)", 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.78170957, 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033859879999999999, 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297735+0000", 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297748+0000", 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3464e-05 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297799+0000", 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0232999999999998e-05 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297821+0000", 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2334e-05 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298165+0000", 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034369199999999999 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298223+0000", 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8457e-05 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301032+0000", 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028085050000000002 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301122+0000", 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0112999999999996e-05 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.152 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50880 3.0 e57/22 3:045763ee:::rbd_data.118bea12bf49.0000000000000073:head v 57'214, mlcod=57'211)", 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.770516183, 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003490136, 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308926+0000", 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308950+0000", 2024-09-18T05:14:49.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3453000000000001e-05 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309001+0000", 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0736999999999999e-05 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309022+0000", 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1437000000000002e-05 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309166+0000", 2024-09-18T05:14:49.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014386100000000001 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309242+0000", 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6459999999999996e-05 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312298+0000", 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030560700000000001 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312419+0000", 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120874 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50883 3.4 e57/22 3:227c9179:::rbd_data.118bea12bf49.00000000000000cb:head v 57'152, mlcod=56'149)", 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.767175440999999, 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026019060000000002, 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.157 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312268+0000", 2024-09-18T05:14:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312286+0000", 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7756000000000001e-05 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312325+0000", 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9029999999999997e-05 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312361+0000", 2024-09-18T05:14:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6303999999999997e-05 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312471+0000", 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010963099999999999 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312527+0000", 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6227000000000002e-05 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314758+0000", 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022307469999999999 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314872+0000", 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011420400000000001 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50934 3.4 e57/22 3:255d0e8e:::rbd_data.118bea12bf49.0000000000000001:head v 57'154, mlcod=56'150)", 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.748627841999999, 2024-09-18T05:14:49.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028140449999999998, 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330815+0000", 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330831+0000", 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5756e-05 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330862+0000", 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1180999999999998e-05 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330882+0000", 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0457000000000001e-05 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331013+0000", 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013070399999999999 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331082+0000", 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9369999999999995e-05 2024-09-18T05:14:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333550+0000", 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024677420000000002 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333631+0000", 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1230999999999995e-05 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.166 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50936 3.9 e57/22 3:907835c8:::rbd_data.118bea12bf49.0000000000000003:head v 57'135, mlcod=56'131)", 2024-09-18T05:14:49.168 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:49.168 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.745618782999999, 2024-09-18T05:14:49.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024933360000000001, 2024-09-18T05:14:49.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333824+0000", 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333844+0000", 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9562999999999999e-05 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333873+0000", 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9487000000000001e-05 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333891+0000", 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7787000000000001e-05 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334003+0000", 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011215 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334057+0000", 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3857999999999998e-05 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336229+0000", 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021715229999999999 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336320+0000", 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1124000000000004e-05 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:49.174 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:49.175 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T05:14:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:49.175 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:49.166+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:49.274 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:49.270+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:49.345 INFO:teuthology.orchestra.run.smithi017.stdout:flattening image image_client.0-clone27 2024-09-18T05:14:49.360 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:49.360 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:49.376 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:49.370+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:49.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:49.477 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:49.473+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:49.562 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:49.562 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:49.562 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:49.562 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:49.563 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:49.578 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:49.573+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:49.580 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:49.664 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-18T05:14:49.678 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:49.674+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:49.698 INFO:teuthology.orchestra.run.smithi017.stdout:3649 write 0xb2eaf08 thru 0xb2f2288 (0x7381 bytes) 2024-09-18T05:14:49.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.804851620000001, 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:14:49.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.804820677000002, 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:14:49.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:14:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:14:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:14:49.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.727 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.804795112999997, 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:14:49.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.732 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.804770396999999, 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:14:49.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:14:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:14:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:14:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:14:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:49.738 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.804744163000002, 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:14:49.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.804715254000001, 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:14:49.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:14:49.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:14:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:14:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:14:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:14:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:14:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:14:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.748 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.804691423999998, 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.749 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:14:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:14:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:14:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:14:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:14:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.804666947999998, 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:49.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:14:49.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:14:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:14:49.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:14:49.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.804549149000003, 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.801557193999997, 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:14:49.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.801479131999997, 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:14:49.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:14:49.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.801447844999998, 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:14:49.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:14:49.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.801421832000003, 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.781 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:14:49.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:14:49.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:14:49.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:14:49.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:14:49.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:14:49.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.787 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.788 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.788 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:49.788 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.801394059000003, 2024-09-18T05:14:49.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:14:49.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:49.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.801368996000001, 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:49.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:49.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:14:49.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:14:49.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:14:49.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:14:49.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:14:49.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:14:49.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:14:49.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:14:49.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:14:49.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:14:49.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.800 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.800 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.801 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:49.801 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.801343965999997, 2024-09-18T05:14:49.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:14:49.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.801 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.801 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.801 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.801 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:49.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:14:49.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.805 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.797219638000001, 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:14:49.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:14:49.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.797199093000003, 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:14:49.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.797179411000002, 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.815 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.5291079639999996, 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:14:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:49.826 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:49.828 INFO:teuthology.orchestra.run.smithi017.stdout:3650 write 0xd7cc0b5 thru 0xd7db736 (0xf682 bytes) 2024-09-18T05:14:49.828 INFO:teuthology.orchestra.run.smithi017.stdout:3651 read 0x6cd5805 thru 0x6ce2747 (0xcf43 bytes) 2024-09-18T05:14:49.828 INFO:teuthology.orchestra.run.smithi017.stdout:3652 writesame 0xa7bd41f thru 0xa7c4a4e data_size 0x7a(0x7630 bytes) 2024-09-18T05:14:49.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:49.830 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:49.830 INFO:teuthology.orchestra.run.smithi017.stdout:3657 write 0x808b4f8 thru 0x8091e1a (0x6923 bytes) 2024-09-18T05:14:49.830 INFO:teuthology.orchestra.run.smithi017.stdout:3658 write 0x292790f thru 0x292f6a6 (0x7d98 bytes) 2024-09-18T05:14:49.830 INFO:teuthology.orchestra.run.smithi017.stdout:3659 read 0x9065bbe thru 0x9069b88 (0x3fcb bytes) 2024-09-18T05:14:49.830 INFO:teuthology.orchestra.run.smithi017.stdout:3662 write 0x943fba3 thru 0x9443ecd (0x432b bytes) 2024-09-18T05:14:49.830 INFO:teuthology.orchestra.run.smithi017.stdout:3663 writesame 0xc680a16 thru 0xc684971 data_size 0xa(0x3f5c bytes) 2024-09-18T05:14:49.831 INFO:teuthology.orchestra.run.smithi017.stdout:3664 writesame 0x92ba6bc thru 0x92c30bb data_size 0x8a(0x8a00 bytes) 2024-09-18T05:14:49.831 INFO:teuthology.orchestra.run.smithi017.stdout:3665 write 0x19056f9 thru 0x1910c42 (0xb54a bytes) 2024-09-18T05:14:49.831 INFO:teuthology.orchestra.run.smithi017.stdout:3666 punch from 0xfc804f to 0xfd2dc4, (0xad75 bytes) 2024-09-18T05:14:49.831 INFO:teuthology.orchestra.run.smithi017.stdout:3667 writesame 0xe63b6e0 thru 0xe63f21e data_size 0x1(0x3b3f bytes) 2024-09-18T05:14:49.831 INFO:teuthology.orchestra.run.smithi017.stdout:3668 writesame 0xb563793 thru 0xb567c9f data_size 0x1(0x450d bytes) 2024-09-18T05:14:49.831 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:49.825+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:49.837 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:49.837 INFO:teuthology.orchestra.run.smithi017.stdout:3671 punch from 0xe07f244 to 0xe088c74, (0x9a30 bytes) 2024-09-18T05:14:49.837 INFO:teuthology.orchestra.run.smithi017.stdout:3672 write 0xc857585 thru 0xc8584d1 (0xf4d bytes) 2024-09-18T05:14:49.840 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:49.840 INFO:teuthology.orchestra.run.smithi017.stdout:3674 write 0x4398021 thru 0x439a748 (0x2728 bytes) 2024-09-18T05:14:49.854 INFO:teuthology.orchestra.run.smithi017.stdout:3675 write 0x7d4bdb6 thru 0x7d58947 (0xcb92 bytes) 2024-09-18T05:14:49.857 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:49.857 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:49.857 INFO:teuthology.orchestra.run.smithi017.stdout:3676 write 0x4da1c07 thru 0x4da620b (0x4605 bytes) 2024-09-18T05:14:49.868 INFO:teuthology.orchestra.run.smithi017.stdout:3678 read 0x31497a4 thru 0x31595de (0xfe3b bytes) 2024-09-18T05:14:49.869 INFO:teuthology.orchestra.run.smithi017.stdout:3680 punch from 0xba992cf to 0xbaa3f36, (0xac67 bytes) 2024-09-18T05:14:49.869 INFO:teuthology.orchestra.run.smithi017.stdout:3681 read 0x3fa0ee2 thru 0x3fa63f9 (0x5518 bytes) 2024-09-18T05:14:49.869 INFO:teuthology.orchestra.run.smithi017.stdout:3682 writesame 0xb694492 thru 0xb699b97 data_size 0x6(0x5706 bytes) 2024-09-18T05:14:49.876 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:49.877 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:49.893 INFO:teuthology.orchestra.run.smithi017.stdout:3683 trunc from 0xe63f21f to 0x15f678b 2024-09-18T05:14:49.894 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:49.895 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:49.921 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:49.921 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:49.929 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:49.925+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:49.938 INFO:teuthology.orchestra.run.smithi017.stdout:3684 punch from 0x14f4f12 to 0x150071d, (0xb80b bytes) 2024-09-18T05:14:49.938 INFO:teuthology.orchestra.run.smithi017.stdout:3685 read 0x68016 thru 0x7557a (0xd565 bytes) 2024-09-18T05:14:49.939 INFO:teuthology.orchestra.run.smithi017.stdout:3686 punch from 0x11e36de to 0x11e7e78, (0x479a bytes) 2024-09-18T05:14:49.939 INFO:teuthology.orchestra.run.smithi017.stdout:3687 punch from 0x6dcb5d to 0x6ddc56, (0x10f9 bytes) 2024-09-18T05:14:49.939 INFO:teuthology.orchestra.run.smithi017.stdout:3688 read 0x889e74 thru 0x8960c4 (0xc251 bytes) 2024-09-18T05:14:49.940 INFO:teuthology.orchestra.run.smithi017.stdout:3691 read 0xc60551 thru 0xc672dc (0x6d8c bytes) 2024-09-18T05:14:49.940 INFO:teuthology.orchestra.run.smithi017.stdout:3692 write 0xfbae65 thru 0xfbd3cf (0x256b bytes) 2024-09-18T05:14:49.942 INFO:teuthology.orchestra.run.smithi017.stdout:3693 read 0xf4d8ab thru 0xf4fafa (0x2250 bytes) 2024-09-18T05:14:49.945 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:49.945 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:49.958 INFO:teuthology.orchestra.run.smithi017.stdout:3694 trunc from 0x15f678b to 0xa9fe400 2024-09-18T05:14:49.970 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:49.971 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:49.973 INFO:teuthology.orchestra.run.smithi017.stdout:3697 write 0xb0a6135 thru 0xb0abd35 (0x5c01 bytes) 2024-09-18T05:14:49.975 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:49.975 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:3698 write 0xa83856a thru 0xa83b217 (0x2cae bytes) 2024-09-18T05:14:49.990 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:49.993 INFO:teuthology.orchestra.run.smithi017.stdout:3699 trunc from 0xb0abd36 to 0x339f643 2024-09-18T05:14:49.996 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:50.011 INFO:teuthology.orchestra.run.smithi017.stdout:3700 read 0x27c5d5b thru 0x27d5979 (0xfc1f bytes) 2024-09-18T05:14:50.011 INFO:teuthology.orchestra.run.smithi017.stdout:3701 punch from 0x2d0658e to 0x2d10767, (0xa1d9 bytes) 2024-09-18T05:14:50.014 INFO:teuthology.orchestra.run.smithi017.stdout:3702 trunc from 0x339f643 to 0x19e30d1 2024-09-18T05:14:50.022 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:50.023 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:50.030 INFO:teuthology.orchestra.run.smithi017.stdout:3703 punch from 0x1783b2d to 0x17925d9, (0xeaac bytes) 2024-09-18T05:14:50.030 INFO:teuthology.orchestra.run.smithi017.stdout:3704 read 0xa83210 thru 0xa8d746 (0xa537 bytes) 2024-09-18T05:14:50.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:50.022+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:50.050 INFO:teuthology.orchestra.run.smithi017.stdout:3705 write 0xb57d32f thru 0xb58666b (0x933d bytes) 2024-09-18T05:14:50.056 INFO:teuthology.orchestra.run.smithi017.stdout:3706 write 0x43f3f00 thru 0x43f656d (0x266e bytes) 2024-09-18T05:14:50.058 INFO:teuthology.orchestra.run.smithi017.stdout:3707 punch from 0x73c8117 to 0x73d0df5, (0x8cde bytes) 2024-09-18T05:14:50.058 INFO:teuthology.orchestra.run.smithi017.stdout:3709 read 0x99ca815 thru 0x99d6fb4 (0xc7a0 bytes) 2024-09-18T05:14:50.060 INFO:teuthology.orchestra.run.smithi017.stdout:3710 trunc from 0xb58666c to 0xc6afa4c 2024-09-18T05:14:50.067 INFO:teuthology.orchestra.run.smithi017.stdout:3711 trunc from 0xc6afa4c to 0xc49ee01 2024-09-18T05:14:50.074 INFO:teuthology.orchestra.run.smithi017.stdout:3714 read 0x33c70f4 thru 0x33cc0fb (0x5008 bytes) 2024-09-18T05:14:50.085 INFO:teuthology.orchestra.run.smithi017.stdout:3715 trunc from 0xc49ee01 to 0x5451283 2024-09-18T05:14:50.103 INFO:teuthology.orchestra.run.smithi017.stdout:3717 write 0x275fb29 thru 0x276a1bf (0xa697 bytes) 2024-09-18T05:14:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:3719 read 0x101d9e9 thru 0x102b780 (0xdd98 bytes) 2024-09-18T05:14:50.123 INFO:teuthology.orchestra.run.smithi017.stdout:3721 write 0xb5731de thru 0xb5756b9 (0x24dc bytes) 2024-09-18T05:14:50.131 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:50.126+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:50.139 INFO:teuthology.orchestra.run.smithi017.stdout:3722 write 0xcb077b4 thru 0xcb129bc (0xb209 bytes) 2024-09-18T05:14:50.155 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:50.156 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:50.156 INFO:teuthology.orchestra.run.smithi017.stdout:3723 write 0xcf5f1ee thru 0xcf6caf9 (0xd90c bytes) 2024-09-18T05:14:50.165 INFO:teuthology.orchestra.run.smithi017.stdout:3724 writesame 0x8e067b6 thru 0x8e0ac6a data_size 0x3(0x44b5 bytes) 2024-09-18T05:14:50.171 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:50.174 INFO:teuthology.orchestra.run.smithi017.stdout:3725 read 0xa44b4b5 thru 0xa451036 (0x5b82 bytes) 2024-09-18T05:14:50.175 INFO:teuthology.orchestra.run.smithi017.stdout:3726 write 0x899bf2d thru 0x89a3e33 (0x7f07 bytes) 2024-09-18T05:14:50.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:14:50.184 INFO:teuthology.orchestra.run.smithi017.stdout:3727 punch from 0x5bab2fd to 0x5bac1df, (0xee2 bytes) 2024-09-18T05:14:50.184 INFO:teuthology.orchestra.run.smithi017.stdout:3728 write 0xbd2aca2 thru 0xbd38b58 (0xdeb7 bytes) 2024-09-18T05:14:50.188 INFO:teuthology.orchestra.run.smithi017.stdout:3729 punch from 0x572dd7a to 0x5737a97, (0x9d1d bytes) 2024-09-18T05:14:50.188 INFO:teuthology.orchestra.run.smithi017.stdout:3730 writesame 0xaf0de82 thru 0xaf1c614 data_size 0x15(0xe793 bytes) 2024-09-18T05:14:50.192 INFO:teuthology.orchestra.run.smithi017.stdout:3732 punch from 0x9d00e12 to 0x9d0db18, (0xcd06 bytes) 2024-09-18T05:14:50.211 INFO:teuthology.orchestra.run.smithi017.stdout:3733 trunc from 0xcf6cafa to 0x86deae 2024-09-18T05:14:50.232 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:50.228+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:50.245 INFO:teuthology.orchestra.run.smithi017.stdout:3734 write 0x242d6a2 thru 0x2437ea6 (0xa805 bytes) 2024-09-18T05:14:50.247 INFO:teuthology.orchestra.run.smithi017.stdout:3735 punch from 0x22b8eeb to 0x22bb75d, (0x2872 bytes) 2024-09-18T05:14:50.247 INFO:teuthology.orchestra.run.smithi017.stdout:3736 read 0x1f993fc thru 0x1f9e229 (0x4e2e bytes) 2024-09-18T05:14:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.256 INFO:teuthology.orchestra.run.smithi017.stdout:3740 trunc from 0x2437ea7 to 0x759161e 2024-09-18T05:14:50.265 INFO:teuthology.orchestra.run.smithi017.stdout:3741 punch from 0x32411fa to 0x3249255, (0x805b bytes) 2024-09-18T05:14:50.266 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.266 INFO:teuthology.orchestra.run.smithi017.stdout:3743 punch from 0x5572c73 to 0x557f0fa, (0xc487 bytes) 2024-09-18T05:14:50.266 INFO:teuthology.orchestra.run.smithi017.stdout:3744 write 0x54717b7 thru 0x5476c1f (0x5469 bytes) 2024-09-18T05:14:50.267 INFO:teuthology.orchestra.run.smithi017.stdout:3746 punch from 0x3e0213e to 0x3e0b880, (0x9742 bytes) 2024-09-18T05:14:50.274 INFO:teuthology.orchestra.run.smithi017.stdout:3747 trunc from 0x759161e to 0xb8f02a6 2024-09-18T05:14:50.284 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.284 INFO:teuthology.orchestra.run.smithi017.stdout:3750 write 0x8ba0519 thru 0x8ba5ab6 (0x559e bytes) 2024-09-18T05:14:50.299 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:50.299 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:50.300 INFO:teuthology.orchestra.run.smithi017.stdout:3753 write 0xc6ba913 thru 0xc6c2fb5 (0x86a3 bytes) 2024-09-18T05:14:50.307 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.307 INFO:teuthology.orchestra.run.smithi017.stdout:3755 write 0xb5b5f9d thru 0xb5b6f0d (0xf71 bytes) 2024-09-18T05:14:50.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:50.324 INFO:teuthology.orchestra.run.smithi017.stdout:3756 trunc from 0xc6c2fb6 to 0x6f284d1 2024-09-18T05:14:50.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:50.326+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:50.340 INFO:teuthology.orchestra.run.smithi017.stdout:3757 punch from 0x6630e64 to 0x6635517, (0x46b3 bytes) 2024-09-18T05:14:50.340 INFO:teuthology.orchestra.run.smithi017.stdout:3758 trunc from 0x6f284d1 to 0x7002aee 2024-09-18T05:14:50.346 INFO:teuthology.orchestra.run.smithi017.stdout:3759 write 0x1d11b29 thru 0x1d1d826 (0xbcfe bytes) 2024-09-18T05:14:50.357 INFO:teuthology.orchestra.run.smithi017.stdout:3760 write 0x89f120e thru 0x89f6427 (0x521a bytes) 2024-09-18T05:14:50.360 INFO:teuthology.orchestra.run.smithi017.stdout:3761 read 0x21e4e47 thru 0x21f41af (0xf369 bytes) 2024-09-18T05:14:50.361 INFO:teuthology.orchestra.run.smithi017.stdout:3762 read 0x2f16713 thru 0x2f1c080 (0x596e bytes) 2024-09-18T05:14:50.361 INFO:teuthology.orchestra.run.smithi017.stdout:3763 read 0x10aafc4 thru 0x10b9ac3 (0xeb00 bytes) 2024-09-18T05:14:50.362 INFO:teuthology.orchestra.run.smithi017.stdout:3764 read 0x1d72ea0 thru 0x1d7c240 (0x93a1 bytes) 2024-09-18T05:14:50.372 INFO:teuthology.orchestra.run.smithi017.stdout:3765 trunc from 0x89f6428 to 0x1cefa82 2024-09-18T05:14:50.388 INFO:teuthology.orchestra.run.smithi017.stdout:3766 read 0xd56d6a thru 0xd5f657 (0x88ee bytes) 2024-09-18T05:14:50.416 INFO:teuthology.orchestra.run.smithi017.stdout:3768 write 0xd8f8daf thru 0xd8fb178 (0x23ca bytes) 2024-09-18T05:14:50.421 INFO:teuthology.orchestra.run.smithi017.stdout:3770 read 0xa307706 thru 0xa3144d8 (0xcdd3 bytes) 2024-09-18T05:14:50.421 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.421 INFO:teuthology.orchestra.run.smithi017.stdout:3772 read 0xb98c63b thru 0xb99c50a (0xfed0 bytes) 2024-09-18T05:14:50.421 INFO:teuthology.orchestra.run.smithi017.stdout:3773 read 0x4cfd769 thru 0x4cffea3 (0x273b bytes) 2024-09-18T05:14:50.422 INFO:teuthology.orchestra.run.smithi017.stdout:3774 punch from 0x8afd7f9 to 0x8b0d437, (0xfc3e bytes) 2024-09-18T05:14:50.422 INFO:teuthology.orchestra.run.smithi017.stdout:3775 write 0x9b19ef1 thru 0x9b1b2bd (0x13cd bytes) 2024-09-18T05:14:50.424 INFO:teuthology.orchestra.run.smithi017.stdout:3776 read 0x1a2dfad thru 0x1a30c7d (0x2cd1 bytes) 2024-09-18T05:14:50.434 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:50.430+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:50.434 INFO:teuthology.orchestra.run.smithi017.stdout:3778 write 0xe971f70 thru 0xe97b587 (0x9618 bytes) 2024-09-18T05:14:50.440 INFO:teuthology.orchestra.run.smithi017.stdout:3779 write 0x5eb8c84 thru 0x5eba7e5 (0x1b62 bytes) 2024-09-18T05:14:50.442 INFO:teuthology.orchestra.run.smithi017.stdout:3783 writesame 0xe739d76 thru 0xe741161 data_size 0x6(0x73ec bytes) 2024-09-18T05:14:50.451 INFO:teuthology.orchestra.run.smithi017.stdout:3784 write 0x6f2fc57 thru 0x6f39fa2 (0xa34c bytes) 2024-09-18T05:14:50.455 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.455 INFO:teuthology.orchestra.run.smithi017.stdout:3787 read 0x38beffc thru 0x38c7ce3 (0x8ce8 bytes) 2024-09-18T05:14:50.455 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.456 INFO:teuthology.orchestra.run.smithi017.stdout:3789 punch from 0x4a8f555 to 0x4a95766, (0x6211 bytes) 2024-09-18T05:14:50.456 INFO:teuthology.orchestra.run.smithi017.stdout:3790 write 0x357bfcf thru 0x35841d8 (0x820a bytes) 2024-09-18T05:14:50.458 INFO:teuthology.orchestra.run.smithi017.stdout:3793 punch from 0xa19b384 to 0xa1a057a, (0x51f6 bytes) 2024-09-18T05:14:50.458 INFO:teuthology.orchestra.run.smithi017.stdout:3794 write 0x54e21bf thru 0x54ed904 (0xb746 bytes) 2024-09-18T05:14:50.461 INFO:teuthology.orchestra.run.smithi017.stdout:3795 punch from 0x5d3cf44 to 0x5d49301, (0xc3bd bytes) 2024-09-18T05:14:50.461 INFO:teuthology.orchestra.run.smithi017.stdout:3796 write 0x66e9282 thru 0x66f3dd7 (0xab56 bytes) 2024-09-18T05:14:50.464 INFO:teuthology.orchestra.run.smithi017.stdout:3798 trunc from 0xe97b588 to 0xead6c69 2024-09-18T05:14:50.473 INFO:teuthology.orchestra.run.smithi017.stdout:3799 write 0xb8227a7 thru 0xb82fd67 (0xd5c1 bytes) 2024-09-18T05:14:50.478 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.479 INFO:teuthology.orchestra.run.smithi017.stdout:3802 punch from 0xc6df7e to 0xc779b1, (0x9a33 bytes) 2024-09-18T05:14:50.479 INFO:teuthology.orchestra.run.smithi017.stdout:3803 write 0x41a1c4d thru 0x41ae804 (0xcbb8 bytes) 2024-09-18T05:14:50.480 INFO:teuthology.orchestra.run.smithi017.stdout:3805 read 0xbc67039 thru 0xbc7349e (0xc466 bytes) 2024-09-18T05:14:50.482 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.482 INFO:teuthology.orchestra.run.smithi017.stdout:3807 punch from 0x66551d to 0x66df07, (0x89ea bytes) 2024-09-18T05:14:50.482 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.482 INFO:teuthology.orchestra.run.smithi017.stdout:3811 write 0x4c1f2de thru 0x4c216db (0x23fe bytes) 2024-09-18T05:14:50.485 INFO:teuthology.orchestra.run.smithi017.stdout:3812 punch from 0x6a5149 to 0x6a7291, (0x2148 bytes) 2024-09-18T05:14:50.485 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.489 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:50.489 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:50.497 INFO:teuthology.orchestra.run.smithi017.stdout:3814 trunc from 0xead6c69 to 0x66ed093 2024-09-18T05:14:50.505 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:50.523 INFO:teuthology.orchestra.run.smithi017.stdout:3816 read 0x1fe1188 thru 0x1feea22 (0xd89b bytes) 2024-09-18T05:14:50.535 INFO:teuthology.orchestra.run.smithi017.stdout:3817 writesame 0x9092956 thru 0x909398b data_size 0x2(0x1036 bytes) 2024-09-18T05:14:50.535 INFO:teuthology.orchestra.run.smithi017.stdout:3819 punch from 0x298d9c6 to 0x29908c6, (0x2f00 bytes) 2024-09-18T05:14:50.535 INFO:teuthology.orchestra.run.smithi017.stdout:3821 punch from 0x81cf262 to 0x81d3e4a, (0x4be8 bytes) 2024-09-18T05:14:50.550 INFO:teuthology.orchestra.run.smithi017.stdout:3822 writesame 0xd97a212 thru 0xd97e5eb data_size 0x2d(0x43da bytes) 2024-09-18T05:14:50.551 INFO:teuthology.orchestra.run.smithi017.stdout:3823 trunc from 0xd97e5ec to 0xe314ca2 2024-09-18T05:14:50.552 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:50.548+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:50.558 INFO:teuthology.orchestra.run.smithi017.stdout:3824 read 0x74fdd83 thru 0x750dd71 (0xffef bytes) 2024-09-18T05:14:50.559 INFO:teuthology.orchestra.run.smithi017.stdout:3825 punch from 0x2d91d63 to 0x2d965d9, (0x4876 bytes) 2024-09-18T05:14:50.559 INFO:teuthology.orchestra.run.smithi017.stdout:3827 write 0xa078cb4 thru 0xa083e41 (0xb18e bytes) 2024-09-18T05:14:50.579 INFO:teuthology.orchestra.run.smithi017.stdout:3828 trunc from 0xe314ca2 to 0x6b78ffc 2024-09-18T05:14:50.599 INFO:teuthology.orchestra.run.smithi017.stdout:3830 punch from 0x53be484 to 0x53be92d, (0x4a9 bytes) 2024-09-18T05:14:50.625 INFO:teuthology.orchestra.run.smithi017.stdout:3832 write 0xe5117f0 thru 0xe51deb6 (0xc6c7 bytes) 2024-09-18T05:14:50.632 INFO:teuthology.orchestra.run.smithi017.stdout:3833 writesame 0xad767ef thru 0xad854dd data_size 0x7(0xecef bytes) 2024-09-18T05:14:50.633 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:50.633 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:50.635 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:50.630+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:50.645 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.645 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.645 INFO:teuthology.orchestra.run.smithi017.stdout:3838 writesame 0x7abbd91 thru 0x7ac90b2 data_size 0x5e(0xd322 bytes) 2024-09-18T05:14:50.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:50.654 INFO:teuthology.orchestra.run.smithi017.stdout:3839 writesame 0x1396c6a thru 0x13a6812 data_size 0x19(0xfba9 bytes) 2024-09-18T05:14:50.658 INFO:teuthology.orchestra.run.smithi017.stdout:3840 read 0x9ba1841 thru 0x9ba2627 (0xde7 bytes) 2024-09-18T05:14:50.659 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.659 INFO:teuthology.orchestra.run.smithi017.stdout:3846 write 0xb29b873 thru 0xb2a94af (0xdc3d bytes) 2024-09-18T05:14:50.663 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.663 INFO:teuthology.orchestra.run.smithi017.stdout:3848 read 0x177a465 thru 0x177cff4 (0x2b90 bytes) 2024-09-18T05:14:50.664 INFO:teuthology.orchestra.run.smithi017.stdout:3849 write 0x3de3372 thru 0x3de3bb7 (0x846 bytes) 2024-09-18T05:14:50.667 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.667 INFO:teuthology.orchestra.run.smithi017.stdout:3851 write 0x54a0f2f thru 0x54a4136 (0x3208 bytes) 2024-09-18T05:14:50.669 INFO:teuthology.orchestra.run.smithi017.stdout:3852 read 0x17d3c54 thru 0x17d4b12 (0xebf bytes) 2024-09-18T05:14:50.670 INFO:teuthology.orchestra.run.smithi017.stdout:3853 write 0x846c25c thru 0x8471932 (0x56d7 bytes) 2024-09-18T05:14:50.678 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.680 INFO:teuthology.orchestra.run.smithi017.stdout:3855 trunc from 0xe51deb7 to 0xda5cd17 2024-09-18T05:14:50.699 INFO:teuthology.orchestra.run.smithi017.stdout:3856 read 0x758580c thru 0x75918fe (0xc0f3 bytes) 2024-09-18T05:14:50.700 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.700 INFO:teuthology.orchestra.run.smithi017.stdout:3858 write 0x1d94fbb thru 0x1d97fa3 (0x2fe9 bytes) 2024-09-18T05:14:50.703 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:50.703 INFO:teuthology.orchestra.run.smithi017.stdout:3862 write 0x2da6bdb thru 0x2db6460 (0xf886 bytes) 2024-09-18T05:14:50.706 INFO:teuthology.orchestra.run.smithi017.stdout:3863 read 0x76f4f0a thru 0x7702057 (0xd14e bytes) 2024-09-18T05:14:50.707 INFO:teuthology.orchestra.run.smithi017.stdout:3864 writesame 0x3c866b2 thru 0x3c885e5 data_size 0x2(0x1f34 bytes) 2024-09-18T05:14:50.713 INFO:teuthology.orchestra.run.smithi017.stdout:3866 read 0xd59b8af thru 0xd5a5f09 (0xa65b bytes) 2024-09-18T05:14:50.715 INFO:teuthology.orchestra.run.smithi017.stdout:3867 write 0xcd759b2 thru 0xcd85039 (0xf688 bytes) 2024-09-18T05:14:50.725 INFO:teuthology.orchestra.run.smithi017.stdout:3868 clone 29 order 21 su 262144 sc 13 2024-09-18T05:14:50.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:50.730+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:50.814 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:50.827 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:50.872 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:50.868+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:50.939 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:50.932+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:50.951 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:50.951 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:50.965 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:51.052 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:51.048+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:51.128 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:51.128 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:51.141 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:51.134+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:51.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:51.180 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:14:51.241 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:51.236+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:51.285 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone28 from 0xda5cd17 (overlap 0x86deae) to 0x35f2ac 2024-09-18T05:14:51.314 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:51.314 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:51.331 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:51.343 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:51.338+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:51.441 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-18T05:14:51.443 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:51.436+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:51.494 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:51.494 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:51.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:14:51.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:51.538+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:51.645 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:51.640+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:51.675 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:51.675 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:51.689 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:14:51.776 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:51.772+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:51.821 INFO:teuthology.orchestra.run.smithi017.stdout:3869 read 0x104ce03 thru 0x105b9a0 (0xeb9e bytes) 2024-09-18T05:14:51.822 INFO:teuthology.orchestra.run.smithi017.stdout:3871 punch from 0xb224a04 to 0xb232ae0, (0xe0dc bytes) 2024-09-18T05:14:51.829 INFO:teuthology.orchestra.run.smithi017.stdout:3873 write 0xd7b8b5c thru 0xd7c5973 (0xce18 bytes) 2024-09-18T05:14:51.840 INFO:teuthology.orchestra.run.smithi017.stdout:3874 write 0x6e80cbf thru 0x6e902ef (0xf631 bytes) 2024-09-18T05:14:51.847 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:51.840+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:51.854 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:51.854 INFO:teuthology.orchestra.run.smithi017.stdout:3876 read 0xd0838eb thru 0xd08f3ef (0xbb05 bytes) 2024-09-18T05:14:51.855 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:51.855 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:51.868 INFO:teuthology.orchestra.run.smithi017.stdout:3877 trunc from 0xda5cd17 to 0x4e77b06 2024-09-18T05:14:51.870 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:51.902 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:51.914 INFO:teuthology.orchestra.run.smithi017.stdout:3880 write 0x687e102 thru 0x6883354 (0x5253 bytes) 2024-09-18T05:14:51.923 INFO:teuthology.orchestra.run.smithi017.stdout:3881 read 0x4e8f1ce thru 0x4e941e4 (0x5017 bytes) 2024-09-18T05:14:51.923 INFO:teuthology.orchestra.run.smithi017.stdout:3882 read 0x26961bc thru 0x2699e5b (0x3ca0 bytes) 2024-09-18T05:14:51.924 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:51.924 INFO:teuthology.orchestra.run.smithi017.stdout:3885 write 0x332b4c7 thru 0x3334b68 (0x96a2 bytes) 2024-09-18T05:14:51.948 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:51.944+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:51.950 INFO:teuthology.orchestra.run.smithi017.stdout:3886 write 0x78c496c thru 0x78d264e (0xdce3 bytes) 2024-09-18T05:14:51.966 INFO:teuthology.orchestra.run.smithi017.stdout:3887 write 0x903e37a thru 0x9047718 (0x939f bytes) 2024-09-18T05:14:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:3888 read 0xcf6e76 thru 0xcf808c (0x1217 bytes) 2024-09-18T05:14:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:3890 write 0xc957d07 thru 0xc95b39d (0x3697 bytes) 2024-09-18T05:14:51.997 INFO:teuthology.orchestra.run.smithi017.stdout:3891 clone 30 order 25 su 262144 sc 15 2024-09-18T05:14:52.012 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:52.012 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:52.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:52.047 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:52.071 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:52.066+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:52.149 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:52.142+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:52.195 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:52.196 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:52.212 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:52.215 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:52.233 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:52.233 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:52.250 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:52.244+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:52.251 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:52.251 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:52.269 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:52.270 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:52.281 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone29 from 0xc95b39e (overlap 0x4e77b06) to 0x0 2024-09-18T05:14:52.328 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:52.351 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:52.344+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:52.362 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:52.363 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:52.363 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:52.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:52.363 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:52.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.363 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55852 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.363 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:52.363 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.72157848, 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052798855999999998, 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55852 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:52.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636908+0000", 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636907+0000", 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636913+0000", 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9170000000000003e-06 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636927+0000", 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4080000000000001e-05 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636938+0000", 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0251000000000001e-05 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689571+0000", 2024-09-18T05:14:52.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052632828999999999 2024-09-18T05:14:52.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689634+0000", 2024-09-18T05:14:52.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3139000000000007e-05 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689707+0000", 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3511999999999997e-05 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55853 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8142848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:52.368 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721536002000001, 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052962084999999999, 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55853 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636950+0000", 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636957+0000", 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:14:52.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636994+0000", 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6879999999999999e-05 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637005+0000", 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1430000000000001e-05 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689750+0000", 2024-09-18T05:14:52.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052744345999999998 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689837+0000", 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7581000000000001e-05 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689913+0000", 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5797999999999995e-05 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55854 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8159232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721471657, 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053068918, 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55854 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637014+0000", 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637020+0000", 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5149999999999997e-06 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637034+0000", 2024-09-18T05:14:52.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4696e-05 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637045+0000", 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0334e-05 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689962+0000", 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052916773 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690024+0000", 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2009999999999998e-05 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690084+0000", 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0485000000000001e-05 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55855 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721431092, 2024-09-18T05:14:52.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053239090000000003, 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55855 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637055+0000", 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637060+0000", 2024-09-18T05:14:52.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9139999999999999e-06 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637080+0000", 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9873000000000001e-05 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637091+0000", 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0852999999999999e-05 2024-09-18T05:14:52.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690124+0000", 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053033736999999997 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690217+0000", 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2263999999999996e-05 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690295+0000", 2024-09-18T05:14:52.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8193000000000002e-05 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55856 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721385924, 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053363617000000002, 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55856 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637100+0000", 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637106+0000", 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637120+0000", 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4885999999999999e-05 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637131+0000", 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.064e-05 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690344+0000", 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053212832000000002 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690404+0000", 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0516999999999997e-05 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690465+0000", 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0132e-05 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55857 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721346155999999, 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053529896, 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55857 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637140+0000", 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637145+0000", 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637158+0000", 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3465999999999999e-05 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637168+0000", 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4919999999999999e-06 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690506+0000", 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053337801999999997 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690595+0000", 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8925000000000007e-05 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690671+0000", 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5983999999999996e-05 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55858 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8224768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721308841000001, 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053665767000000003, 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55858 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:52.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637177+0000", 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637182+0000", 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.028e-06 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637197+0000", 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4341999999999999e-05 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637207+0000", 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0345e-05 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690719+0000", 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053511982 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690783+0000", 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3683999999999995e-05 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690844+0000", 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1116000000000002e-05 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55859 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8241152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.7212707, 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053835149999999998, 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.395 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55859 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637215+0000", 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637221+0000", 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4879999999999998e-06 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637239+0000", 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7665000000000001e-05 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637252+0000", 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3735e-05 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690887+0000", 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053635163 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690977+0000", 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9452999999999999e-05 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691051+0000", 2024-09-18T05:14:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4374000000000003e-05 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55860 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721199285000001, 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053934739000000002, 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.400 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55860 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637287+0000", 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637293+0000", 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637309+0000", 2024-09-18T05:14:52.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6214000000000001e-05 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637322+0000", 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2413e-05 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691101+0000", 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053779456000000003 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691164+0000", 2024-09-18T05:14:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2199000000000005e-05 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691222+0000", 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8758999999999998e-05 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.404 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55861 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8273920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721156827, 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054100101999999997, 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55861 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.405 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637329+0000", 2024-09-18T05:14:52.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:52.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637333+0000", 2024-09-18T05:14:52.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2619999999999999e-06 2024-09-18T05:14:52.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637340+0000", 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5279999999999998e-06 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637347+0000", 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691264+0000", 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916886999999997 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691353+0000", 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9560000000000003e-05 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691430+0000", 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6715e-05 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.409 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.410 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55862 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8290304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.410 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:52.410 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721121882, 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054235677000000003, 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55862 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:52.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637364+0000", 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637368+0000", 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637378+0000", 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0545e-05 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637384+0000", 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.592e-06 2024-09-18T05:14:52.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691479+0000", 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054095022 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691540+0000", 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0958999999999997e-05 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691601+0000", 2024-09-18T05:14:52.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0976e-05 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55863 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8306688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.721097935, 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054421542000000003, 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55863 2024-09-18T05:14:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637388+0000", 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637391+0000", 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637398+0000", 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8249999999999999e-06 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637403+0000", 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3879999999999999e-06 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691642+0000", 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054238572999999998 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691732+0000", 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0413000000000003e-05 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691810+0000", 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8079999999999998e-05 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55864 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.720411729, 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053905402999999998, 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55864 2024-09-18T05:14:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637413+0000", 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9993382 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638082+0000", 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066932099999999996 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638103+0000", 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638115+0000", 2024-09-18T05:14:52.423 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2935000000000001e-05 2024-09-18T05:14:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691859+0000", 2024-09-18T05:14:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053743055999999997 2024-09-18T05:14:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691920+0000", 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1087999999999995e-05 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691980+0000", 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0853999999999997e-05 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55865 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8339456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.720359261, 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054056874999999997, 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55865 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:14:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638127+0000", 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638133+0000", 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7869999999999998e-06 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638146+0000", 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3030000000000001e-05 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638156+0000", 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0523000000000001e-05 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692022+0000", 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053866149000000002 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692109+0000", 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6428000000000007e-05 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692184+0000", 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5760999999999995e-05 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55935 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7397376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.717850438999999, 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052706586, 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55935 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640636+0000", 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640635+0000", 2024-09-18T05:14:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640640+0000", 2024-09-18T05:14:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-18T05:14:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640649+0000", 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8130000000000007e-06 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640655+0000", 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1739999999999999e-06 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693173+0000", 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052518675000000001 2024-09-18T05:14:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693264+0000", 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0859999999999994e-05 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693343+0000", 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8870999999999998e-05 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55936 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7413760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.717827592999999, 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052856933000000002, 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55936 2024-09-18T05:14:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:14:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640661+0000", 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3479999999999998e-06 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640672+0000", 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0424999999999999e-05 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640677+0000", 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693392+0000", 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052714446999999998 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693456+0000", 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4426999999999998e-05 2024-09-18T05:14:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693516+0000", 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0154e-05 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55937 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7430144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.717805013, 2024-09-18T05:14:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053045085999999998, 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55937 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640681+0000", 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640685+0000", 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0799999999999999e-06 2024-09-18T05:14:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640700+0000", 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4768e-05 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640707+0000", 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.81e-06 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693559+0000", 2024-09-18T05:14:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052852022999999998 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693648+0000", 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8908999999999999e-05 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693727+0000", 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9123999999999997e-05 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55938 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7446528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.717774958, 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053184652999999998, 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55938 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640711+0000", 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640714+0000", 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0070000000000002e-06 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640721+0000", 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640728+0000", 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6479999999999997e-06 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693775+0000", 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047086 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693836+0000", 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1513999999999994e-05 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693897+0000", 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0315000000000001e-05 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55939 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7462912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.71775126, 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369857999999999, 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55939 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640735+0000", 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640739+0000", 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-06 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640750+0000", 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0668e-05 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640755+0000", 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4299999999999997e-06 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693938+0000", 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053182462 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694028+0000", 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0781999999999999e-05 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694105+0000", 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049e-05 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55940 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7479296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.717727010000001, 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053517447000000003, 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55940 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640759+0000", 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640769+0000", 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4730000000000006e-06 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640779+0000", 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9899999999999992e-06 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640784+0000", 2024-09-18T05:14:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694154+0000", 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369648999999998 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694217+0000", 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2540999999999996e-05 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694277+0000", 2024-09-18T05:14:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0671999999999998e-05 2024-09-18T05:14:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.458 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:52.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:52.459 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:52.460 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:52.462 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:52.454+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:52.520 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-18T05:14:52.528 INFO:teuthology.orchestra.run.smithi017.stdout:3892 punch from 0x8466929 to 0x8469e98, (0x356f bytes) 2024-09-18T05:14:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:3893 write 0x65829f2 thru 0x6583376 (0x985 bytes) 2024-09-18T05:14:52.551 INFO:teuthology.orchestra.run.smithi017.stdout:3895 read 0x7b26838 thru 0x7b28740 (0x1f09 bytes) 2024-09-18T05:14:52.552 INFO:teuthology.orchestra.run.smithi017.stdout:3896 writesame 0xbb9bf8f thru 0xbba2fe8 data_size 0x49(0x705a bytes) 2024-09-18T05:14:52.562 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:52.556+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:52.583 INFO:teuthology.orchestra.run.smithi017.stdout:3897 read 0x2d5dc9d thru 0x2d5eda4 (0x1108 bytes) 2024-09-18T05:14:52.584 INFO:teuthology.orchestra.run.smithi017.stdout:3899 read 0x8ef7247 thru 0x8f0354a (0xc304 bytes) 2024-09-18T05:14:52.584 INFO:teuthology.orchestra.run.smithi017.stdout:3900 read 0xc115a8d thru 0xc116ff0 (0x1564 bytes) 2024-09-18T05:14:52.589 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:52.589 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:52.594 INFO:teuthology.orchestra.run.smithi017.stdout:3902 writesame 0xe7533d1 thru 0xe76219b data_size 0x19(0xedcb bytes) 2024-09-18T05:14:52.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:3903 write 0x406320e thru 0x406e58b (0xb37e bytes) 2024-09-18T05:14:52.650 INFO:teuthology.orchestra.run.smithi017.stdout:3904 write 0xd36d169 thru 0xd377041 (0x9ed9 bytes) 2024-09-18T05:14:52.663 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:52.656+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:52.681 INFO:teuthology.orchestra.run.smithi017.stdout:3905 write 0x54108ad thru 0x5414036 (0x378a bytes) 2024-09-18T05:14:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:3906 read 0x10b7e80 thru 0x10c17b3 (0x9934 bytes) 2024-09-18T05:14:52.714 INFO:teuthology.orchestra.run.smithi017.stdout:3908 trunc from 0xe76219c to 0xab14dad 2024-09-18T05:14:52.755 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:52.756 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:52.764 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:52.758+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:52.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:52.818 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:52.818 INFO:teuthology.orchestra.run.smithi017.stdout:3911 read 0x9bf7e90 thru 0x9bfabfc (0x2d6d bytes) 2024-09-18T05:14:52.829 INFO:teuthology.orchestra.run.smithi017.stdout:3912 trunc from 0xab14dad to 0xf7624b 2024-09-18T05:14:52.852 INFO:teuthology.orchestra.run.smithi017.stdout:3913 write 0x644d745 thru 0x64521c2 (0x4a7e bytes) 2024-09-18T05:14:52.854 INFO:teuthology.orchestra.run.smithi017.stdout:3914 write 0x3160e62 thru 0x3163642 (0x27e1 bytes) 2024-09-18T05:14:52.865 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:52.858+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:52.870 INFO:teuthology.orchestra.run.smithi017.stdout:3915 writesame 0xa03fc1a thru 0xa0469c5 data_size 0x2(0x6dac bytes) 2024-09-18T05:14:52.872 INFO:teuthology.orchestra.run.smithi017.stdout:3916 writesame 0x897bb51 thru 0x897d508 data_size 0x4(0x19b8 bytes) 2024-09-18T05:14:52.873 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:52.876 INFO:teuthology.orchestra.run.smithi017.stdout:3918 trunc from 0xa0469c6 to 0xc26d0b2 2024-09-18T05:14:52.884 INFO:teuthology.orchestra.run.smithi017.stdout:3919 read 0x82d7337 thru 0x82e3c6c (0xc936 bytes) 2024-09-18T05:14:52.884 INFO:teuthology.orchestra.run.smithi017.stdout:3920 punch from 0x821f660 to 0x8221aa6, (0x2446 bytes) 2024-09-18T05:14:52.884 INFO:teuthology.orchestra.run.smithi017.stdout:3921 read 0x75b33d8 thru 0x75b8ff9 (0x5c22 bytes) 2024-09-18T05:14:52.886 INFO:teuthology.orchestra.run.smithi017.stdout:3922 trunc from 0xc26d0b2 to 0xac4969c 2024-09-18T05:14:52.899 INFO:teuthology.orchestra.run.smithi017.stdout:3923 write 0x52df760 thru 0x52eb6ef (0xbf90 bytes) 2024-09-18T05:14:52.911 INFO:teuthology.orchestra.run.smithi017.stdout:3924 write 0xc45b493 thru 0xc462bb4 (0x7722 bytes) 2024-09-18T05:14:52.913 INFO:teuthology.orchestra.run.smithi017.stdout:3926 read 0x6f6780d thru 0x6f6e210 (0x6a04 bytes) 2024-09-18T05:14:52.914 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:52.914 INFO:teuthology.orchestra.run.smithi017.stdout:3930 read 0x6922bab thru 0x692f6c8 (0xcb1e bytes) 2024-09-18T05:14:52.914 INFO:teuthology.orchestra.run.smithi017.stdout:3931 punch from 0x60f4e4a to 0x60fecb8, (0x9e6e bytes) 2024-09-18T05:14:52.914 INFO:teuthology.orchestra.run.smithi017.stdout:3933 read 0x560c2e1 thru 0x5612445 (0x6165 bytes) 2024-09-18T05:14:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:3934 trunc from 0xc462bb5 to 0x339029a 2024-09-18T05:14:52.949 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:52.949 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:52.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.716266048999998, 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.716198439000003, 2024-09-18T05:14:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.716151052999997, 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.716105646999999, 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.716060357000003, 2024-09-18T05:14:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.714425806000001, 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.714373487000003, 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.714255844, 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.714193925000004, 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.714135505000002, 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.714081878999998, 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.714034816000002, 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.713974737000001, 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.713914449999997, 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.713847133999998, 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.713798531000002, 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.713724912000004, 2024-09-18T05:14:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.713651429000002, 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.713594839000002, 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.713548707000001, 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.044 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:53.045 INFO:teuthology.orchestra.run.smithi017.stdout:3935 writesame 0xe4c7485 thru 0xe4cddb1 data_size 0x19(0x692d bytes) 2024-09-18T05:14:53.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:53.048 INFO:teuthology.orchestra.run.smithi017.stdout:3936 read 0xc9d7ca4 thru 0xc9e6486 (0xe7e3 bytes) 2024-09-18T05:14:53.048 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.048 INFO:teuthology.orchestra.run.smithi017.stdout:3939 read 0xa3e0de9 thru 0xa3e7f1a (0x7132 bytes) 2024-09-18T05:14:53.048 INFO:teuthology.orchestra.run.smithi017.stdout:3941 write 0xa109213 thru 0xa1119ca (0x87b8 bytes) 2024-09-18T05:14:53.048 INFO:teuthology.orchestra.run.smithi017.stdout:3942 read 0x75d9b9f thru 0x75ddb28 (0x3f8a bytes) 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3943 read 0xd76591a thru 0xd7696ea (0x3dd1 bytes) 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3944 trunc from 0xe4cddb2 to 0xa79b8b8 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3945 read 0x13b5550 thru 0x13ba75f (0x5210 bytes) 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3947 read 0x2fee42e thru 0x2ffa1b6 (0xbd89 bytes) 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3948 punch from 0x8217cbc to 0x82261b0, (0xe4f4 bytes) 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3951 read 0x650cded thru 0x6519979 (0xcb8d bytes) 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3952 write 0xa0353ee thru 0xa044023 (0xec36 bytes) 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3953 read 0xa493aa thru 0xa50fb3 (0x7c0a bytes) 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3954 read 0xb9ad81 thru 0xba2bf8 (0x7e78 bytes) 2024-09-18T05:14:53.049 INFO:teuthology.orchestra.run.smithi017.stdout:3955 read 0x8e1502b thru 0x8e1dfb8 (0x8f8e bytes) 2024-09-18T05:14:53.050 INFO:teuthology.orchestra.run.smithi017.stdout:3957 read 0x6d2c3f4 thru 0x6d2caaa (0x6b7 bytes) 2024-09-18T05:14:53.050 INFO:teuthology.orchestra.run.smithi017.stdout:3958 writesame 0x47f9285 thru 0x48091e4 data_size 0x48(0xff60 bytes) 2024-09-18T05:14:53.050 INFO:teuthology.orchestra.run.smithi017.stdout:3959 read 0x6f719c1 thru 0x6f728cf (0xf0f bytes) 2024-09-18T05:14:53.050 INFO:teuthology.orchestra.run.smithi017.stdout:3962 writesame 0xbf25ab9 thru 0xbf2ebfb data_size 0x1(0x9143 bytes) 2024-09-18T05:14:53.050 INFO:teuthology.orchestra.run.smithi017.stdout:3963 read 0x90ef753 thru 0x90f5913 (0x61c1 bytes) 2024-09-18T05:14:53.050 INFO:teuthology.orchestra.run.smithi017.stdout:3964 writesame 0x5ef331f thru 0x5ef9a53 data_size 0x1(0x6735 bytes) 2024-09-18T05:14:53.050 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:53.038+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:53.051 INFO:teuthology.orchestra.run.smithi017.stdout:3966 write 0x619b2fc thru 0x619f8ef (0x45f4 bytes) 2024-09-18T05:14:53.053 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.053 INFO:teuthology.orchestra.run.smithi017.stdout:3969 punch from 0x3a85c6b to 0x3a86c63, (0xff8 bytes) 2024-09-18T05:14:53.053 INFO:teuthology.orchestra.run.smithi017.stdout:3972 write 0xa8f9f84 thru 0xa906253 (0xc2d0 bytes) 2024-09-18T05:14:53.073 INFO:teuthology.orchestra.run.smithi017.stdout:3974 trunc from 0xbf2ebfc to 0x26e52f4 2024-09-18T05:14:53.089 INFO:teuthology.orchestra.run.smithi017.stdout:3975 read 0x1718d68 thru 0x171a517 (0x17b0 bytes) 2024-09-18T05:14:53.091 INFO:teuthology.orchestra.run.smithi017.stdout:3976 trunc from 0x26e52f4 to 0x3df7373 2024-09-18T05:14:53.124 INFO:teuthology.orchestra.run.smithi017.stdout:3980 write 0xd6bf051 thru 0xd6cb7b9 (0xc769 bytes) 2024-09-18T05:14:53.127 INFO:teuthology.orchestra.run.smithi017.stdout:3981 read 0x8236ad4 thru 0x82440f4 (0xd621 bytes) 2024-09-18T05:14:53.128 INFO:teuthology.orchestra.run.smithi017.stdout:3984 read 0x2eaacaa thru 0x2eb911a (0xe471 bytes) 2024-09-18T05:14:53.130 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.130 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.130 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.130 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.130 INFO:teuthology.orchestra.run.smithi017.stdout:3991 read 0x4714098 thru 0x471c526 (0x848f bytes) 2024-09-18T05:14:53.130 INFO:teuthology.orchestra.run.smithi017.stdout:3992 writesame 0xc08e22b thru 0xc094e1e data_size 0x62(0x6bf4 bytes) 2024-09-18T05:14:53.132 INFO:teuthology.orchestra.run.smithi017.stdout:3993 read 0x7f9555 thru 0x7ff869 (0x6315 bytes) 2024-09-18T05:14:53.133 INFO:teuthology.orchestra.run.smithi017.stdout:3995 read 0x27e123f thru 0x27ea88b (0x964d bytes) 2024-09-18T05:14:53.133 INFO:teuthology.orchestra.run.smithi017.stdout:3996 read 0xca9e574 thru 0xcaa7007 (0x8a94 bytes) 2024-09-18T05:14:53.134 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.134 INFO:teuthology.orchestra.run.smithi017.stdout:3998 writesame 0x67b90a8 thru 0x67c3781 data_size 0x7e(0xa6da bytes) 2024-09-18T05:14:53.136 INFO:teuthology.orchestra.run.smithi017.stdout:3999 read 0x1bf8889 thru 0x1c01f48 (0x96c0 bytes) 2024-09-18T05:14:53.137 INFO:teuthology.orchestra.run.smithi017.stdout:4000 punch from 0x9a655ce to 0x9a68591, (0x2fc3 bytes) 2024-09-18T05:14:53.137 INFO:teuthology.orchestra.run.smithi017.stdout:4001 punch from 0xaa8743a to 0xaa8eda7, (0x796d bytes) 2024-09-18T05:14:53.142 INFO:teuthology.orchestra.run.smithi017.stdout:4002 trunc from 0xd6cb7ba to 0xaaf23f8 2024-09-18T05:14:53.146 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:53.140+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:53.158 INFO:teuthology.orchestra.run.smithi017.stdout:4003 write 0xaa5ed7 thru 0xaac42f (0x6559 bytes) 2024-09-18T05:14:53.161 INFO:teuthology.orchestra.run.smithi017.stdout:4004 writesame 0x8feba3a thru 0x8fecc10 data_size 0x1(0x11d7 bytes) 2024-09-18T05:14:53.165 INFO:teuthology.orchestra.run.smithi017.stdout:4005 read 0x24a2681 thru 0x24b20fc (0xfa7c bytes) 2024-09-18T05:14:53.169 INFO:teuthology.orchestra.run.smithi017.stdout:4006 trunc from 0xaaf23f8 to 0xd70ad7e 2024-09-18T05:14:53.179 INFO:teuthology.orchestra.run.smithi017.stdout:4007 write 0x81bf63d thru 0x81c3675 (0x4039 bytes) 2024-09-18T05:14:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:4008 punch from 0x54af769 to 0x54b705c, (0x78f3 bytes) 2024-09-18T05:14:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:4009 punch from 0x9f9cc98 to 0x9fa6057, (0x93bf bytes) 2024-09-18T05:14:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:4010 write 0xab0f67e thru 0xab14e30 (0x57b3 bytes) 2024-09-18T05:14:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:4012 write 0x1105ae8 thru 0x11072ba (0x17d3 bytes) 2024-09-18T05:14:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:53.197 INFO:teuthology.orchestra.run.smithi017.stdout:4013 write 0xed56d30 thru 0xed617fe (0xaacf bytes) 2024-09-18T05:14:53.199 INFO:teuthology.orchestra.run.smithi017.stdout:4014 punch from 0x8b85d08 to 0x8b88e87, (0x317f bytes) 2024-09-18T05:14:53.199 INFO:teuthology.orchestra.run.smithi017.stdout:4015 punch from 0x599fea to 0x5a5f8f, (0xbfa5 bytes) 2024-09-18T05:14:53.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:53.210 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:14:53.214 INFO:teuthology.orchestra.run.smithi017.stdout:4016 trunc from 0xed617ff to 0x213dfa1 2024-09-18T05:14:53.227 INFO:teuthology.orchestra.run.smithi017.stdout:4017 read 0xbb62bd thru 0xbbc91d (0x6661 bytes) 2024-09-18T05:14:53.245 INFO:teuthology.orchestra.run.smithi017.stdout:4018 write 0x9ca9431 thru 0x9cab834 (0x2404 bytes) 2024-09-18T05:14:53.246 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:53.240+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:53.248 INFO:teuthology.orchestra.run.smithi017.stdout:4019 punch from 0x17e59d0 to 0x17e8407, (0x2a37 bytes) 2024-09-18T05:14:53.248 INFO:teuthology.orchestra.run.smithi017.stdout:4020 read 0x93d25fd thru 0x93d28fc (0x300 bytes) 2024-09-18T05:14:53.260 INFO:teuthology.orchestra.run.smithi017.stdout:4021 write 0xd1a1bec thru 0xd1a7188 (0x559d bytes) 2024-09-18T05:14:53.262 INFO:teuthology.orchestra.run.smithi017.stdout:4022 writesame 0x9eeeb9c thru 0x9ef48d7 data_size 0x36(0x5d3c bytes) 2024-09-18T05:14:53.265 INFO:teuthology.orchestra.run.smithi017.stdout:4023 punch from 0x54ea8e to 0x552241, (0x37b3 bytes) 2024-09-18T05:14:53.265 INFO:teuthology.orchestra.run.smithi017.stdout:4024 read 0x867213c thru 0x867254b (0x410 bytes) 2024-09-18T05:14:53.266 INFO:teuthology.orchestra.run.smithi017.stdout:4025 writesame 0x3adc8c0 thru 0x3ae2af0 data_size 0x1b(0x6231 bytes) 2024-09-18T05:14:53.267 INFO:teuthology.orchestra.run.smithi017.stdout:4026 read 0x6dd3749 thru 0x6ddd96d (0xa225 bytes) 2024-09-18T05:14:53.268 INFO:teuthology.orchestra.run.smithi017.stdout:4027 write 0x823006a thru 0x823062e (0x5c5 bytes) 2024-09-18T05:14:53.278 INFO:teuthology.orchestra.run.smithi017.stdout:4028 trunc from 0xd1a7189 to 0x5a91527 2024-09-18T05:14:53.291 INFO:teuthology.orchestra.run.smithi017.stdout:4030 punch from 0x318c5db to 0x31991c1, (0xcbe6 bytes) 2024-09-18T05:14:53.291 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.291 INFO:teuthology.orchestra.run.smithi017.stdout:4032 write 0x3895de4 thru 0x389c22d (0x644a bytes) 2024-09-18T05:14:53.294 INFO:teuthology.orchestra.run.smithi017.stdout:4033 punch from 0x37ad721 to 0x37b46a1, (0x6f80 bytes) 2024-09-18T05:14:53.294 INFO:teuthology.orchestra.run.smithi017.stdout:4034 read 0x32c0953 thru 0x32ce761 (0xde0f bytes) 2024-09-18T05:14:53.296 INFO:teuthology.orchestra.run.smithi017.stdout:4037 read 0x2b17fa6 thru 0x2b26be4 (0xec3f bytes) 2024-09-18T05:14:53.296 INFO:teuthology.orchestra.run.smithi017.stdout:4038 punch from 0x2ffc4ae to 0x30044e4, (0x8036 bytes) 2024-09-18T05:14:53.296 INFO:teuthology.orchestra.run.smithi017.stdout:4039 punch from 0x35020fc to 0x350f973, (0xd877 bytes) 2024-09-18T05:14:53.296 INFO:teuthology.orchestra.run.smithi017.stdout:4041 read 0x3a5158e thru 0x3a5c9a7 (0xb41a bytes) 2024-09-18T05:14:53.303 INFO:teuthology.orchestra.run.smithi017.stdout:4042 trunc from 0x5a91527 to 0xc90144c 2024-09-18T05:14:53.312 INFO:teuthology.orchestra.run.smithi017.stdout:4043 punch from 0x7dd8543 to 0x7ddb9fb, (0x34b8 bytes) 2024-09-18T05:14:53.312 INFO:teuthology.orchestra.run.smithi017.stdout:4044 write 0x1810eeb thru 0x181b8e3 (0xa9f9 bytes) 2024-09-18T05:14:53.322 INFO:teuthology.orchestra.run.smithi017.stdout:4046 write 0xde46c22 thru 0xde4d5cc (0x69ab bytes) 2024-09-18T05:14:53.332 INFO:teuthology.orchestra.run.smithi017.stdout:4048 write 0xe606602 thru 0xe614233 (0xdc32 bytes) 2024-09-18T05:14:53.335 INFO:teuthology.orchestra.run.smithi017.stdout:4049 punch from 0x5422494 to 0x5427f35, (0x5aa1 bytes) 2024-09-18T05:14:53.335 INFO:teuthology.orchestra.run.smithi017.stdout:4050 writesame 0x2ac3f7 thru 0x2b5d17 data_size 0x49(0x9921 bytes) 2024-09-18T05:14:53.336 INFO:teuthology.orchestra.run.smithi017.stdout:4051 writesame 0x4183d67 thru 0x4192c5d data_size 0x5(0xeef7 bytes) 2024-09-18T05:14:53.339 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:53.339 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:53.348 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:53.344+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:53.354 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:53.355 INFO:teuthology.orchestra.run.smithi017.stdout:4052 write 0x606785a thru 0x60755a4 (0xdd4b bytes) 2024-09-18T05:14:53.370 INFO:teuthology.orchestra.run.smithi017.stdout:4053 trunc from 0xe614234 to 0x2587125 2024-09-18T05:14:53.394 INFO:teuthology.orchestra.run.smithi017.stdout:4054 write 0x4e2f97a thru 0x4e3f040 (0xf6c7 bytes) 2024-09-18T05:14:53.397 INFO:teuthology.orchestra.run.smithi017.stdout:4055 trunc from 0x4e3f041 to 0x42d5725 2024-09-18T05:14:53.410 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.415 INFO:teuthology.orchestra.run.smithi017.stdout:4057 trunc from 0x42d5725 to 0x4a76b4 2024-09-18T05:14:53.448 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:53.442+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:53.452 INFO:teuthology.orchestra.run.smithi017.stdout:4058 write 0xdf929ed thru 0xdf9e45b (0xba6f bytes) 2024-09-18T05:14:53.454 INFO:teuthology.orchestra.run.smithi017.stdout:4060 writesame 0xaa60feb thru 0xaa66941 data_size 0x1(0x5957 bytes) 2024-09-18T05:14:53.485 INFO:teuthology.orchestra.run.smithi017.stdout:4061 write 0x7924cfc thru 0x7933e3f (0xf144 bytes) 2024-09-18T05:14:53.488 INFO:teuthology.orchestra.run.smithi017.stdout:4062 read 0x2b2d7c8 thru 0x2b340f6 (0x692f bytes) 2024-09-18T05:14:53.489 INFO:teuthology.orchestra.run.smithi017.stdout:4063 read 0xba79bf4 thru 0xba7ffd1 (0x63de bytes) 2024-09-18T05:14:53.490 INFO:teuthology.orchestra.run.smithi017.stdout:4066 punch from 0x49da210 to 0x49e9e49, (0xfc39 bytes) 2024-09-18T05:14:53.490 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.490 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.490 INFO:teuthology.orchestra.run.smithi017.stdout:4070 read 0x7a10ba1 thru 0x7a1da80 (0xcee0 bytes) 2024-09-18T05:14:53.490 INFO:teuthology.orchestra.run.smithi017.stdout:4071 read 0x52914cc thru 0x529cbfe (0xb733 bytes) 2024-09-18T05:14:53.491 INFO:teuthology.orchestra.run.smithi017.stdout:4072 write 0x9fb3100 thru 0x9fb5035 (0x1f36 bytes) 2024-09-18T05:14:53.492 INFO:teuthology.orchestra.run.smithi017.stdout:4073 punch from 0x4d9a369 to 0x4da95c0, (0xf257 bytes) 2024-09-18T05:14:53.493 INFO:teuthology.orchestra.run.smithi017.stdout:4074 trunc from 0xdf9e45c to 0xd65dd5b 2024-09-18T05:14:53.501 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:53.501 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.674568305000001, 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:14:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:14:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:14:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.680930562, 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.678313764999999, 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:14:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16290 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'52, mlcod=32'49)", 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.677223060999999, 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023378159999999999, 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819780+0000", 2024-09-18T05:14:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819796+0000", 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325999999999999e-05 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819826+0000", 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9583000000000001e-05 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819845+0000", 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8597000000000002e-05 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819950+0000", 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105356 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820003+0000", 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3295999999999999e-05 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822018+0000", 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020151779999999998 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822120+0000", 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101316 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.595778252999999, 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:14:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.221240559999998, 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:14:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17196 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'90, mlcod=32'86)", 2024-09-18T05:14:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.213353978000001, 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023459290000000001, 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283650+0000", 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283663+0000", 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2697999999999999e-05 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283682+0000", 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9012999999999999e-05 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283691+0000", 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7720000000000006e-06 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283777+0000", 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5923999999999999e-05 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283830+0000", 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2320000000000001e-05 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285942+0000", 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002112039 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285997+0000", 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5322000000000003e-05 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.530311378, 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:14:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:45232 3.9 e50/22 3:9465da8c:::rbd_data.118bbcb4fc94.000000000000000d:head v 50'101, mlcod=49'99)", 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.097588966, 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364489, 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399415+0000", 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399425+0000", 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5429999999999999e-06 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399455+0000", 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9887e-05 2024-09-18T05:14:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399472+0000", 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6821e-05 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399619+0000", 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146971 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399693+0000", 2024-09-18T05:14:53.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4004999999999994e-05 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401682+0000", 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019894869999999999 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401781+0000", 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8471e-05 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47581 3.4 e52/22 3:24a94b22:::rbd_data.118ba98b16f7.0000000000000011:head v 52'130, mlcod=52'128)", 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.832338819, 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033849169999999999, 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664664+0000", 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664684+0000", 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0044e-05 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664730+0000", 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6097000000000003e-05 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664751+0000", 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1024000000000001e-05 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664942+0000", 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190538 2024-09-18T05:14:53.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664998+0000", 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6786999999999997e-05 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.667951+0000", 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029529040000000001 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668051+0000", 2024-09-18T05:14:53.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9866999999999998e-05 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47585 3.4 e52/22 3:277480c1:::rbd_data.118ba98b16f7.0000000000000015:head v 52'131, mlcod=52'128)", 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.831593592000001, 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027129139999999999, 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665410+0000", 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665425+0000", 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.499e-05 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665451+0000", 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5936999999999999e-05 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665468+0000", 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7430000000000001e-05 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665537+0000", 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8703999999999998e-05 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665585+0000", 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8060999999999999e-05 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668061+0000", 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024756779999999998 2024-09-18T05:14:53.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668124+0000", 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3676999999999994e-05 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50861 3.9 e57/22 3:937da5aa:::rbd_data.118bea12bf49.0000000000000015:head v 57'133, mlcod=56'130)", 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.199269339000001, 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033859879999999999, 2024-09-18T05:14:53.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297735+0000", 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297748+0000", 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3464e-05 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297799+0000", 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0232999999999998e-05 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297821+0000", 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2334e-05 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298165+0000", 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034369199999999999 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298223+0000", 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8457e-05 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301032+0000", 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028085050000000002 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301122+0000", 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0112999999999996e-05 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.555 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50880 3.0 e57/22 3:045763ee:::rbd_data.118bea12bf49.0000000000000073:head v 57'214, mlcod=57'211)", 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.188075951999998, 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003490136, 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:53.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308926+0000", 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308950+0000", 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3453000000000001e-05 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309001+0000", 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0736999999999999e-05 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309022+0000", 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1437000000000002e-05 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309166+0000", 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014386100000000001 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309242+0000", 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6459999999999996e-05 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312298+0000", 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030560700000000001 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312419+0000", 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120874 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50883 3.4 e57/22 3:227c9179:::rbd_data.118bea12bf49.00000000000000cb:head v 57'152, mlcod=56'149)", 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.184735209999999, 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026019060000000002, 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312268+0000", 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312286+0000", 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7756000000000001e-05 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312325+0000", 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9029999999999997e-05 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312361+0000", 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6303999999999997e-05 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312471+0000", 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010963099999999999 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312527+0000", 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6227000000000002e-05 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314758+0000", 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022307469999999999 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314872+0000", 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011420400000000001 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50934 3.4 e57/22 3:255d0e8e:::rbd_data.118bea12bf49.0000000000000001:head v 57'154, mlcod=56'150)", 2024-09-18T05:14:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.166187611000002, 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028140449999999998, 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:53.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330815+0000", 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330831+0000", 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5756e-05 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330862+0000", 2024-09-18T05:14:53.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1180999999999998e-05 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330882+0000", 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0457000000000001e-05 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331013+0000", 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013070399999999999 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331082+0000", 2024-09-18T05:14:53.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9369999999999995e-05 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333550+0000", 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024677420000000002 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333631+0000", 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1230999999999995e-05 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50936 3.9 e57/22 3:907835c8:::rbd_data.118bea12bf49.0000000000000003:head v 57'135, mlcod=56'131)", 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.163178552000002, 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024933360000000001, 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333824+0000", 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333844+0000", 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9562999999999999e-05 2024-09-18T05:14:53.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333873+0000", 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9487000000000001e-05 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333891+0000", 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7787000000000001e-05 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334003+0000", 2024-09-18T05:14:53.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011215 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334057+0000", 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3857999999999998e-05 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336229+0000", 2024-09-18T05:14:53.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021715229999999999 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336320+0000", 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1124000000000004e-05 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.573 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:66941 3.0 e72/22 3:07b7f500:::rbd_data.118b17097827.0000000000000000:head v 72'269, mlcod=69'267)", 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.162114493, 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061242639999999999, 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334889+0000", 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336629+0000", 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017390940000000001 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336658+0000", 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9649999999999999e-05 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336672+0000", 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3896999999999999e-05 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336737+0000", 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4466000000000002e-05 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336766+0000", 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8968000000000001e-05 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.340973+0000", 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042071629999999999 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341015+0000", 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2113999999999997e-05 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.577 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:66942 3.0 e72/22 3:07b7f500:::rbd_data.118b17097827.0000000000000000:head v 72'271, mlcod=69'267)", 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.158282821, 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029717519999999998, 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:14:53.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338721+0000", 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338732+0000", 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1231e-05 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338747+0000", 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5262999999999999e-05 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338757+0000", 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5060000000000001e-06 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338863+0000", 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106136 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338888+0000", 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4706999999999999e-05 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341659+0000", 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027712639999999998 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341694+0000", 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5123000000000002e-05 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:70720 3.4 e72/22 3:265cd162:::rbd_data.118beb272ca1.0000000000000008:head v 72'168, mlcod=72'166)", 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.71207304800000004, 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0073855960000000003, 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.582 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784930+0000", 2024-09-18T05:14:53.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784944+0000", 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4226000000000001e-05 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784968+0000", 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3777999999999998e-05 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784980+0000", 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1296e-05 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.785034+0000", 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4289000000000001e-05 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.785059+0000", 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5375999999999999e-05 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.792252+0000", 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071932289999999998 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.792318+0000", 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5124999999999997e-05 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:70721 3.0 e72/22 3:011c2880:::rbd_data.118beb272ca1.0000000000000009:head v 72'276, mlcod=72'274)", 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:14:53.586 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.70531013499999995, 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078875809999999994, 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:53.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791693+0000", 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794951+0000", 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003257402 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794977+0000", 2024-09-18T05:14:53.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6078999999999999e-05 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794994+0000", 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6585000000000001e-05 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.795054+0000", 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538999999999998e-05 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.795083+0000", 2024-09-18T05:14:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8972e-05 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.799462+0000", 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043787540000000003 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.799582+0000", 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120661 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:53.590 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:53.591 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:53.591 INFO:teuthology.orchestra.run.smithi017.stdout:4075 read 0x78e842d thru 0x78f7696 (0xf26a bytes) 2024-09-18T05:14:53.592 INFO:teuthology.orchestra.run.smithi017.stdout:4076 writesame 0x60c3dc6 thru 0x60c6112 data_size 0x1(0x234d bytes) 2024-09-18T05:14:53.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:53.594 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.594 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.594 INFO:teuthology.orchestra.run.smithi017.stdout:4079 read 0xbfffb9b thru 0xc004a3e (0x4ea4 bytes) 2024-09-18T05:14:53.594 INFO:teuthology.orchestra.run.smithi017.stdout:4081 read 0x662d470 thru 0x662ef34 (0x1ac5 bytes) 2024-09-18T05:14:53.594 INFO:teuthology.orchestra.run.smithi017.stdout:4082 write 0x246f4d6 thru 0x247b25a (0xbd85 bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4087 trunc from 0xd65dd5b to 0xa594fdb 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4089 read 0x484ea2d thru 0x48514ba (0x2a8e bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4091 trunc from 0xa594fdb to 0x43d0049 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4092 punch from 0xb9752d to 0xb9a2d2, (0x2da5 bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4093 read 0x2808035 thru 0x281011c (0x80e8 bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4094 read 0x16d1fab thru 0x16e0ce4 (0xed3a bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4095 punch from 0x1b99976 to 0x1b9da10, (0x409a bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4097 write 0x1a3d50c thru 0x1a3dc68 (0x75d bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4098 write 0x85de1b4 thru 0x85e343c (0x5289 bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4099 read 0x173f30c thru 0x174968b (0xa380 bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4100 read 0x37db2f2 thru 0x37de7ee (0x34fd bytes) 2024-09-18T05:14:53.595 INFO:teuthology.orchestra.run.smithi017.stdout:4101 write 0xf1115 thru 0xffcf4 (0xebe0 bytes) 2024-09-18T05:14:53.596 INFO:teuthology.orchestra.run.smithi017.stdout:4102 writesame 0x83703be thru 0x837ec98 data_size 0x1(0xe8db bytes) 2024-09-18T05:14:53.596 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:53.588+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:53.621 INFO:teuthology.orchestra.run.smithi017.stdout:4103 read 0x64228a3 thru 0x6422ca8 (0x406 bytes) 2024-09-18T05:14:53.621 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.621 INFO:teuthology.orchestra.run.smithi017.stdout:4105 writesame 0x4e74443 thru 0x4e74c65 data_size 0x1(0x823 bytes) 2024-09-18T05:14:53.623 INFO:teuthology.orchestra.run.smithi017.stdout:4106 punch from 0x779c40d to 0x779fd7b, (0x396e bytes) 2024-09-18T05:14:53.624 INFO:teuthology.orchestra.run.smithi017.stdout:4107 read 0x38df90b thru 0x38dfcdc (0x3d2 bytes) 2024-09-18T05:14:53.624 INFO:teuthology.orchestra.run.smithi017.stdout:4108 write 0x3a9aade thru 0x3aa8804 (0xdd27 bytes) 2024-09-18T05:14:53.626 INFO:teuthology.orchestra.run.smithi017.stdout:4110 punch from 0x160fdb5 to 0x1614fa5, (0x51f0 bytes) 2024-09-18T05:14:53.627 INFO:teuthology.orchestra.run.smithi017.stdout:4111 punch from 0x81e8579 to 0x81f1b25, (0x95ac bytes) 2024-09-18T05:14:53.627 INFO:teuthology.orchestra.run.smithi017.stdout:4112 write 0x825bea0 thru 0x82612bd (0x541e bytes) 2024-09-18T05:14:53.640 INFO:teuthology.orchestra.run.smithi017.stdout:4114 writesame 0x92040b8 thru 0x920a8c0 data_size 0x1(0x6809 bytes) 2024-09-18T05:14:53.643 INFO:teuthology.orchestra.run.smithi017.stdout:4115 writesame 0x1de97d9 thru 0x1df6a38 data_size 0x33(0xd260 bytes) 2024-09-18T05:14:53.647 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.647 INFO:teuthology.orchestra.run.smithi017.stdout:4118 read 0x56eef0e thru 0x56fcfe4 (0xe0d7 bytes) 2024-09-18T05:14:53.648 INFO:teuthology.orchestra.run.smithi017.stdout:4119 writesame 0x8eac210 thru 0x8eb2226 data_size 0x1(0x6017 bytes) 2024-09-18T05:14:53.663 INFO:teuthology.orchestra.run.smithi017.stdout:4120 read 0x88c496 thru 0x897069 (0xabd4 bytes) 2024-09-18T05:14:53.663 INFO:teuthology.orchestra.run.smithi017.stdout:4121 read 0x137f97 thru 0x13de94 (0x5efe bytes) 2024-09-18T05:14:53.665 INFO:teuthology.orchestra.run.smithi017.stdout:4122 punch from 0x2bd0297 to 0x2bd90c8, (0x8e31 bytes) 2024-09-18T05:14:53.665 INFO:teuthology.orchestra.run.smithi017.stdout:4123 writesame 0x3b81861 thru 0x3b8cfae data_size 0x63(0xb74e bytes) 2024-09-18T05:14:53.669 INFO:teuthology.orchestra.run.smithi017.stdout:4125 punch from 0x4dc20c0 to 0x4dcccf5, (0xac35 bytes) 2024-09-18T05:14:53.670 INFO:teuthology.orchestra.run.smithi017.stdout:4126 trunc from 0x920a8c1 to 0xa8d35b5 2024-09-18T05:14:53.689 INFO:teuthology.orchestra.run.smithi017.stdout:4127 trunc from 0xa8d35b5 to 0x74c0544 2024-09-18T05:14:53.693 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:53.686+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:53.704 INFO:teuthology.orchestra.run.smithi017.stdout:4128 writesame 0x73c67d5 thru 0x73d55b0 data_size 0x1a(0xeddc bytes) 2024-09-18T05:14:53.707 INFO:teuthology.orchestra.run.smithi017.stdout:4129 read 0x73e36e3 thru 0x73e6142 (0x2a60 bytes) 2024-09-18T05:14:53.708 INFO:teuthology.orchestra.run.smithi017.stdout:4130 read 0x44892ad thru 0x4491b47 (0x889b bytes) 2024-09-18T05:14:53.709 INFO:teuthology.orchestra.run.smithi017.stdout:4131 writesame 0x4b21e6e thru 0x4b28c78 data_size 0xd(0x6e0b bytes) 2024-09-18T05:14:53.713 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.713 INFO:teuthology.orchestra.run.smithi017.stdout:4135 read 0x465f16e thru 0x466bd50 (0xcbe3 bytes) 2024-09-18T05:14:53.714 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.725 INFO:teuthology.orchestra.run.smithi017.stdout:4138 write 0x8ee723b thru 0x8eefba2 (0x8968 bytes) 2024-09-18T05:14:53.728 INFO:teuthology.orchestra.run.smithi017.stdout:4139 read 0x5591bfa thru 0x5592106 (0x50d bytes) 2024-09-18T05:14:53.728 INFO:teuthology.orchestra.run.smithi017.stdout:4141 read 0x5d98e1c thru 0x5da07bd (0x79a2 bytes) 2024-09-18T05:14:53.729 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:53.739 INFO:teuthology.orchestra.run.smithi017.stdout:4144 trunc from 0x8eefba3 to 0xeaad88b 2024-09-18T05:14:53.746 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:53.746 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:53.748 INFO:teuthology.orchestra.run.smithi017.stdout:4145 clone 31 order 20 su 262144 sc 8 2024-09-18T05:14:53.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:53.793 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:53.788+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:53.894 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:53.888+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:53.918 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:53.918 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:53.919 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:53.932 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:53.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:53.990+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:54.058 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.145602222999997, 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:54.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.064 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:54.064 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.145571279999999, 2024-09-18T05:14:54.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:14:54.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:14:54.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.145545716000001, 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.069 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:14:54.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.070 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:14:54.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:14:54.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:14:54.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:14:54.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:14:54.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:14:54.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:14:54.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.145521000000002, 2024-09-18T05:14:54.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:54.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.145494765999999, 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:14:54.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:14:54.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.145465856999998, 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:14:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:14:54.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.145442027000001, 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:54.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.096 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.145417551000001, 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:54.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:14:54.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:14:54.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:14:54.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:14:54.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:14:54.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:14:54.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:54.103 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.145299752, 2024-09-18T05:14:54.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:14:54.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:14:54.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.104 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:54.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:54.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:14:54.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:14:54.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:14:54.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:14:54.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:14:54.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.112 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.112 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.112 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.112 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:54.112 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.142307797000001, 2024-09-18T05:14:54.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:14:54.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.113 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.113 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.113 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.113 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:14:54.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.113 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:14:54.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:14:54.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:14:54.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:14:54.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:14:54.117 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.117 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.142229735000001, 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:14:54.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:54.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.123 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.142198448000002, 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.142172434999999, 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:14:54.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:14:54.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.142144662, 2024-09-18T05:14:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:14:54.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.137 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.142119598999997, 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:14:54.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:14:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.142094569000001, 2024-09-18T05:14:54.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:14:54.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:14:54.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.137970240999998, 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:14:54.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.137949696, 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:14:54.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.137930013999998, 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:14:54.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.869858567, 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:14:54.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:14:54.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:54.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:54.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:14:54.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:14:54.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.167 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:54.167 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:54.167 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:54.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:54.169 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:54.164+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:54.176 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-18T05:14:54.176 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:14:54.176 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-18T05:14:54.177 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.234624 2024-09-18T05:14:54.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0.23462404133887726 2024-09-18T05:14:54.192 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:14:54.269 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:54.262+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:54.302 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:71531 3.1a 3.ac0e573a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:54.300937+0000", 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.2539999999999993e-05, 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0912e-05, 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 71531 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:54.300937+0000", 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:54.300937+0000", 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:54.300935+0000", 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:54.300947+0000", 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2139e-05 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:54.300977+0000", 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785999999999999e-05 2024-09-18T05:14:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:54.300991+0000", 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4107000000000001e-05 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 1 2024-09-18T05:14:54.306 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:54.307 INFO:teuthology.orchestra.run.smithi017.stdout:leaving image image_client.0-clone30 intact 2024-09-18T05:14:54.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:54.370 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:54.364+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:54.441 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:54.441 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:54.441 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:54.441 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:54.455 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:54.468 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:54.514 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:54.510+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:54.517 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-18T05:14:54.519 INFO:teuthology.orchestra.run.smithi017.stdout:4147 punch from 0x43f5fc7 to 0x43ff2ee, (0x9327 bytes) 2024-09-18T05:14:54.524 INFO:teuthology.orchestra.run.smithi017.stdout:4149 write 0x4fad6c6 thru 0x4fb919c (0xbad7 bytes) 2024-09-18T05:14:54.530 INFO:teuthology.orchestra.run.smithi017.stdout:4151 write 0x3a2707 thru 0x3b058c (0xde86 bytes) 2024-09-18T05:14:54.535 INFO:teuthology.orchestra.run.smithi017.stdout:4152 read 0x72679e1 thru 0x726fd0e (0x832e bytes) 2024-09-18T05:14:54.536 INFO:teuthology.orchestra.run.smithi017.stdout:4153 write 0x5a0251f thru 0x5a1224d (0xfd2f bytes) 2024-09-18T05:14:54.541 INFO:teuthology.orchestra.run.smithi017.stdout:4154 read 0x13faf2d thru 0x1406741 (0xb815 bytes) 2024-09-18T05:14:54.542 INFO:teuthology.orchestra.run.smithi017.stdout:4155 read 0x251a0e9 thru 0x252247d (0x8395 bytes) 2024-09-18T05:14:54.542 INFO:teuthology.orchestra.run.smithi017.stdout:4158 writesame 0xd5d3785 thru 0xd5de599 data_size 0x5(0xae15 bytes) 2024-09-18T05:14:54.552 INFO:teuthology.orchestra.run.smithi017.stdout:4159 read 0x35f21e0 thru 0x35fa8e7 (0x8708 bytes) 2024-09-18T05:14:54.553 INFO:teuthology.orchestra.run.smithi017.stdout:4160 writesame 0xa4073e8 thru 0xa4161f0 data_size 0x1(0xee09 bytes) 2024-09-18T05:14:54.572 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:54.566+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:54.595 INFO:teuthology.orchestra.run.smithi017.stdout:4161 read 0xaa54dd2 thru 0xaa57592 (0x27c1 bytes) 2024-09-18T05:14:54.595 INFO:teuthology.orchestra.run.smithi017.stdout:4162 read 0xb81931d thru 0xb81d551 (0x4235 bytes) 2024-09-18T05:14:54.599 INFO:teuthology.orchestra.run.smithi017.stdout:4165 trunc from 0xeaad88b to 0xb9e5b8c 2024-09-18T05:14:54.609 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:54.609 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:54.628 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:54.628 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:54.634 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:54.634 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:54.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:54.634 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:54.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.634 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:34842 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.634 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.642468+0000", 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.989614480999997, 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054921899000000003, 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 34842 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642468+0000", 2024-09-18T05:14:54.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642468+0000", 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642467+0000", 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642488+0000", 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1195e-05 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642506+0000", 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7589e-05 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642519+0000", 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3478999999999999e-05 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697373+0000", 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054853784000000003 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697390+0000", 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6949e-05 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:34843 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.638 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.642531+0000", 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.989551390000003, 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054916773000000002, 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 34843 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642531+0000", 2024-09-18T05:14:54.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642531+0000", 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642530+0000", 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642548+0000", 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7317999999999999e-05 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642565+0000", 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7405e-05 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.642608+0000", 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2471e-05 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697434+0000", 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054826248000000001 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.697448+0000", 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4207e-05 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35040 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644793+0000", 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.987289998000001, 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054897967999999998, 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35040 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644793+0000", 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644793+0000", 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644792+0000", 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644802+0000", 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0053e-05 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644811+0000", 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7590000000000003e-06 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644818+0000", 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9129999999999997e-06 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699682+0000", 2024-09-18T05:14:54.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054864582000000002 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699691+0000", 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3010000000000007e-06 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35041 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644824+0000", 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.987259131000002, 2024-09-18T05:14:54.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054909866000000002, 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35041 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644824+0000", 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644824+0000", 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644823+0000", 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644826+0000", 2024-09-18T05:14:54.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3000000000000002e-06 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644835+0000", 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3429999999999996e-06 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644841+0000", 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.793e-06 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699718+0000", 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054876552000000002 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699733+0000", 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5571000000000001e-05 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35042 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.987235325999997, 2024-09-18T05:14:54.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054947252000000002, 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35042 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644847+0000", 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644850+0000", 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.089e-06 2024-09-18T05:14:54.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644858+0000", 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2470000000000008e-06 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644865+0000", 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8220000000000001e-06 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699785+0000", 2024-09-18T05:14:54.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054920552999999997 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699795+0000", 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1970000000000002e-06 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35043 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644871+0000", 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.987212094, 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05500414, 2024-09-18T05:14:54.655 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35043 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644871+0000", 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644871+0000", 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644870+0000", 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644883+0000", 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2592000000000001e-05 2024-09-18T05:14:54.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644892+0000", 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1190000000000003e-06 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644907+0000", 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839e-05 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699859+0000", 2024-09-18T05:14:54.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054952913999999999 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699875+0000", 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5328999999999998e-05 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35044 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.644913+0000", 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.987170083999999, 2024-09-18T05:14:54.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055016171000000003, 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35044 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644913+0000", 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644913+0000", 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644912+0000", 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644928+0000", 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5911999999999999e-05 2024-09-18T05:14:54.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644937+0000", 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0359999999999995e-06 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644944+0000", 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5859999999999999e-06 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699920+0000", 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054975475000000003 2024-09-18T05:14:54.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699929+0000", 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8619999999999992e-06 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35045 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645001+0000", 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.987082241000003, 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054993128000000002, 2024-09-18T05:14:54.663 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35045 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645001+0000", 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645001+0000", 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.644999+0000", 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645004+0000", 2024-09-18T05:14:54.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.386e-06 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645025+0000", 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1072000000000001e-05 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645033+0000", 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4929999999999998e-06 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699978+0000", 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054944686999999999 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.699994+0000", 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5642999999999999e-05 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.667 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35046 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645043+0000", 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.987039654, 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055002748999999997, 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35046 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645043+0000", 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645043+0000", 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645042+0000", 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645046+0000", 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8399999999999997e-06 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645055+0000", 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8230000000000001e-06 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645062+0000", 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6889999999999998e-06 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700035+0000", 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054973889999999997 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700046+0000", 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0441e-05 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35047 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.671 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645068+0000", 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.987015092999997, 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055041751, 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35047 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645068+0000", 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645068+0000", 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645067+0000", 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645070+0000", 2024-09-18T05:14:54.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5700000000000001e-06 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645078+0000", 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0320000000000003e-06 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645085+0000", 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6540000000000002e-06 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700094+0000", 2024-09-18T05:14:54.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055009007999999998 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700109+0000", 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5316999999999999e-05 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35048 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645092+0000", 2024-09-18T05:14:54.675 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.986990915, 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055077814000000003, 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35048 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645092+0000", 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645092+0000", 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645091+0000", 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645094+0000", 2024-09-18T05:14:54.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0800000000000002e-06 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645103+0000", 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3529999999999995e-06 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645110+0000", 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9059999999999996e-06 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700160+0000", 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055050864999999997 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700170+0000", 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2569999999999996e-06 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35049 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.679 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.986967534000001, 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055117828000000001, 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35049 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:54.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645115+0000", 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645118+0000", 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0900000000000001e-06 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645126+0000", 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3829999999999992e-06 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645133+0000", 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5760000000000002e-06 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700218+0000", 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055085150999999999 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700233+0000", 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5291e-05 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35050 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.683 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.986944354999999, 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055144048000000001, 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35050 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645138+0000", 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645141+0000", 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.129e-06 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645149+0000", 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.32e-06 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645156+0000", 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5560000000000004e-06 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700273+0000", 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055117753999999998 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700282+0000", 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.969e-06 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35051 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.9869214, 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055189845000000001, 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35051 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645161+0000", 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645164+0000", 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.083e-06 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645172+0000", 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2500000000000006e-06 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645182+0000", 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7389999999999994e-06 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700330+0000", 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055147843000000002 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700351+0000", 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1577e-05 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35053 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645188+0000", 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.986894995, 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055212911000000003, 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35053 2024-09-18T05:14:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645188+0000", 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645188+0000", 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645187+0000", 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645212+0000", 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4607999999999999e-05 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645228+0000", 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6631999999999999e-05 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645247+0000", 2024-09-18T05:14:54.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8748000000000001e-05 2024-09-18T05:14:54.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700392+0000", 2024-09-18T05:14:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055144679000000002 2024-09-18T05:14:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700401+0000", 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8810000000000002e-06 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35055 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.986828400999997, 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055212430999999999, 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35055 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645254+0000", 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645257+0000", 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645266+0000", 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.816e-06 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645273+0000", 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5799999999999997e-06 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700449+0000", 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055176493 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700467+0000", 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7589e-05 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35057 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645279+0000", 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.986803793, 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055246213000000002, 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35057 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645279+0000", 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645279+0000", 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645278+0000", 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645281+0000", 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1319999999999998e-06 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645290+0000", 2024-09-18T05:14:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3499999999999997e-06 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645296+0000", 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4790000000000001e-06 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700516+0000", 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055219621000000003 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700525+0000", 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2969999999999992e-06 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35059 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.986780348000003, 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055288944, 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35059 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645302+0000", 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645305+0000", 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0960000000000001e-06 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645313+0000", 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3399999999999998e-06 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645322+0000", 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5259999999999993e-06 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700574+0000", 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055251888999999998 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700591+0000", 2024-09-18T05:14:54.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7753000000000001e-05 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35061 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645328+0000", 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.986754906999998, 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055293502000000001, 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35061 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645328+0000", 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645328+0000", 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645327+0000", 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645339+0000", 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1432e-05 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645348+0000", 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2520000000000005e-06 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645355+0000", 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0929999999999997e-06 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700613+0000", 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055258003 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700621+0000", 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3909999999999998e-06 2024-09-18T05:14:54.712 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35063 3.3 3.7aeec123 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.645361+0000", 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.986721766000002, 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055301707999999998, 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:54.713 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35063 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645361+0000", 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645361+0000", 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:54.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645360+0000", 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645364+0000", 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3160000000000001e-06 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645372+0000", 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7830000000000004e-06 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:54.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.645379+0000", 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5629999999999997e-06 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700648+0000", 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055268912000000003 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.700663+0000", 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4807000000000001e-05 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:54.717 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:54.717 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:54.718 INFO:teuthology.orchestra.run.smithi017.stdout:4167 read 0x3f64b81 thru 0x3f66f3b (0x23bb bytes) 2024-09-18T05:14:54.718 INFO:teuthology.orchestra.run.smithi017.stdout:4168 write 0x6accb thru 0x73cff (0x9035 bytes) 2024-09-18T05:14:54.718 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:54.719 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:54.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:54.720 INFO:teuthology.orchestra.run.smithi017.stdout:4169 writesame 0xebd66ea thru 0xebe3ba2 data_size 0x1(0xd4b9 bytes) 2024-09-18T05:14:54.720 INFO:teuthology.orchestra.run.smithi017.stdout:4170 writesame 0x173e823 thru 0x1746a18 data_size 0xf(0x81f6 bytes) 2024-09-18T05:14:54.720 INFO:teuthology.orchestra.run.smithi017.stdout:4171 punch from 0x5240e12 to 0x52459a5, (0x4b93 bytes) 2024-09-18T05:14:54.720 INFO:teuthology.orchestra.run.smithi017.stdout:4172 read 0xdd34b6c thru 0xdd39afa (0x4f8f bytes) 2024-09-18T05:14:54.721 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:54.721 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:54.721 INFO:teuthology.orchestra.run.smithi017.stdout:4173 trunc from 0xebe3ba3 to 0x4e1d157 2024-09-18T05:14:54.722 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:54.722 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:54.722 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:54.723 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:54.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:54.714+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:54.723 INFO:teuthology.orchestra.run.smithi017.stdout:4174 write 0xa772c08 thru 0xa77ca0a (0x9e03 bytes) 2024-09-18T05:14:54.724 INFO:teuthology.orchestra.run.smithi017.stdout:4176 punch from 0x49333cc to 0x493c986, (0x95ba bytes) 2024-09-18T05:14:54.724 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:54.724 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:54.727 INFO:teuthology.orchestra.run.smithi017.stdout:4181 trunc from 0xa77ca0b to 0x7200921 2024-09-18T05:14:54.729 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:54.729 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:54.743 INFO:teuthology.orchestra.run.smithi017.stdout:4182 read 0x4474f1b thru 0x447901f (0x4105 bytes) 2024-09-18T05:14:54.743 INFO:teuthology.orchestra.run.smithi017.stdout:4183 writesame 0x4216624 thru 0x4220f7a data_size 0xb(0xa957 bytes) 2024-09-18T05:14:54.749 INFO:teuthology.orchestra.run.smithi017.stdout:4184 write 0x2985d09 thru 0x298a08e (0x4386 bytes) 2024-09-18T05:14:54.749 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:54.750 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:54.760 INFO:teuthology.orchestra.run.smithi017.stdout:4186 trunc from 0x7200921 to 0xbdf1865 2024-09-18T05:14:54.768 INFO:teuthology.orchestra.run.smithi017.stdout:4188 punch from 0x26c122d to 0x26ce116, (0xcee9 bytes) 2024-09-18T05:14:54.768 INFO:teuthology.orchestra.run.smithi017.stdout:4189 write 0x65fe0bf thru 0x6602fb2 (0x4ef4 bytes) 2024-09-18T05:14:54.772 INFO:teuthology.orchestra.run.smithi017.stdout:4191 punch from 0x4ee168a to 0x4ee899e, (0x7314 bytes) 2024-09-18T05:14:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:4192 write 0x2b78f81 thru 0x2b85e40 (0xcec0 bytes) 2024-09-18T05:14:54.777 INFO:teuthology.orchestra.run.smithi017.stdout:4193 writesame 0x7a2264b thru 0x7a2dd87 data_size 0x1(0xb73d bytes) 2024-09-18T05:14:54.806 INFO:teuthology.orchestra.run.smithi017.stdout:4195 punch from 0x6e9546 to 0x6eab3c, (0x15f6 bytes) 2024-09-18T05:14:54.806 INFO:teuthology.orchestra.run.smithi017.stdout:4196 clone 32 order 19 su 4096 sc 10 2024-09-18T05:14:54.819 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:54.814+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:54.853 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:54.853 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:54.867 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:54.921 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:54.916+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:54.988 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:54.988 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:55.002 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:55.044 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:55.040+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:55.124 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:55.120+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:55.168 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:55.168 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:55.182 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:55.203 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.5 primary-affinity to 0.234624 (8153762) 2024-09-18T05:14:55.224 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:55.220+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:55.325 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:55.320+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:55.346 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:55.346 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:55.361 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:55.426 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:55.418+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:55.526 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:55.526 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:55.527 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:55.522+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:55.540 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:55.628 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:55.622+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:55.659 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:55.659 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:55.676 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:14:55.729 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:55.724+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:55.798 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:55.798 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:55.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:14:55.830 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:55.822+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:55.931 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:55.926+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:55.980 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:55.980 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:55.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:14:56.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:56.030+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:56.118 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:56.118 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:56.133 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:14:56.134 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:56.130+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:56.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:14:56.235 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:56.228+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:56.275 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:56.275 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:56.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:14:56.333 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone31 from 0xbdf1865 (overlap 0x4e1d157) to 0x0 2024-09-18T05:14:56.336 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:56.330+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:56.437 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:56.432+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:56.449 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:56.450 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:56.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:14:56.539 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:56.532+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:56.551 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-18T05:14:56.629 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:56.629 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:56.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:56.634+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:56.648 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:14:56.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:56.734+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:56.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:14:56.812 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:56.812 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:56.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:14:56.840 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:56.836+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:56.918 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:56.937 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:56.937 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:56.941 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:56.934+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:56.952 INFO:teuthology.orchestra.run.smithi017.stdout:4197 read 0x2593423 thru 0x25a2a2a (0xf608 bytes) 2024-09-18T05:14:56.953 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:56.956 INFO:teuthology.orchestra.run.smithi017.stdout:4198 punch from 0x7369682 to 0x736fe9d, (0x681b bytes) 2024-09-18T05:14:56.961 INFO:teuthology.orchestra.run.smithi017.stdout:4199 writesame 0x5c0285a thru 0x5c10429 data_size 0x8(0xdbd0 bytes) 2024-09-18T05:14:56.978 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:56.978 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:56.991 INFO:teuthology.orchestra.run.smithi017.stdout:4200 trunc from 0xbdf1865 to 0x3951c71 2024-09-18T05:14:57.001 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:57.002 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:57.008 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:57.008 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:57.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:14:57.047 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:57.047 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:57.048 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:57.042+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:57.078 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:57.079 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:57.098 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:57.098 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:57.104 INFO:teuthology.orchestra.run.smithi017.stdout:4201 write 0x42eba7e thru 0x42f4071 (0x85f4 bytes) 2024-09-18T05:14:57.127 INFO:teuthology.orchestra.run.smithi017.stdout:4203 trunc from 0x42f4072 to 0xc62b72c 2024-09-18T05:14:57.133 INFO:teuthology.orchestra.run.smithi017.stdout:4204 write 0x8f0a6ec thru 0x8f13701 (0x9016 bytes) 2024-09-18T05:14:57.142 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:57.136+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:57.145 INFO:teuthology.orchestra.run.smithi017.stdout:4205 write 0x3d37cf8 thru 0x3d4268c (0xa995 bytes) 2024-09-18T05:14:57.160 INFO:teuthology.orchestra.run.smithi017.stdout:4206 writesame 0x79b3089 thru 0x79b3660 data_size 0x16(0x5d8 bytes) 2024-09-18T05:14:57.170 INFO:teuthology.orchestra.run.smithi017.stdout:4207 trunc from 0xc62b72c to 0x682e11b 2024-09-18T05:14:57.193 INFO:teuthology.orchestra.run.smithi017.stdout:4208 writesame 0x8a0968d thru 0x8a10eaa data_size 0x52(0x781e bytes) 2024-09-18T05:14:57.193 INFO:teuthology.orchestra.run.smithi017.stdout:4209 write 0xc75cd thru 0xd21db (0xac0f bytes) 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17054 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2818048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.969420010999997, 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036847963999999997, 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17054 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229108+0000", 2024-09-18T05:14:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229107+0000", 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229132+0000", 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4890000000000001e-05 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229150+0000", 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8139999999999999e-05 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229163+0000", 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2673e-05 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265675+0000", 2024-09-18T05:14:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036512201000000001 2024-09-18T05:14:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265804+0000", 2024-09-18T05:14:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129326 2024-09-18T05:14:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.265956+0000", 2024-09-18T05:14:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151674 2024-09-18T05:14:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17055 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2883584~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.969352401000002, 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037116175000000001, 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17055 2024-09-18T05:14:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229175+0000", 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229174+0000", 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229181+0000", 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5370000000000003e-06 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229198+0000", 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7085999999999999e-05 2024-09-18T05:14:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229211+0000", 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3383e-05 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266003+0000", 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036792159999999997 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266133+0000", 2024-09-18T05:14:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012984199999999999 2024-09-18T05:14:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266292+0000", 2024-09-18T05:14:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015830400000000001 2024-09-18T05:14:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17056 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.969305015000003, 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404570999999998, 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17056 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229223+0000", 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229222+0000", 2024-09-18T05:14:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229228+0000", 2024-09-18T05:14:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6670000000000001e-06 2024-09-18T05:14:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229244+0000", 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6733000000000001e-05 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229257+0000", 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3183000000000001e-05 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266333+0000", 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037075941000000001 2024-09-18T05:14:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266469+0000", 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551399999999999 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266627+0000", 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001585 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17057 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.969259608999998, 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037688518999999997, 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17057 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229268+0000", 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229267+0000", 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229273+0000", 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229289+0000", 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229302+0000", 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.311e-05 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266671+0000", 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037369055999999998 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266799+0000", 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012793400000000001 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.266957+0000", 2024-09-18T05:14:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157882 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17058 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3080192~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.969214319000002, 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037983472999999997, 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17058 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229314+0000", 2024-09-18T05:14:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229312+0000", 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229318+0000", 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229335+0000", 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6663e-05 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.229348+0000", 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2830000000000001e-05 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267000+0000", 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037652559000000002 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267131+0000", 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131058 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267297+0000", 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568299999999999 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17116 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2719744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967579768, 2024-09-18T05:14:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036881496999999999, 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17116 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230948+0000", 2024-09-18T05:14:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230947+0000", 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230954+0000", 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7360000000000001e-06 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230973+0000", 2024-09-18T05:14:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8749999999999998e-05 2024-09-18T05:14:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230987+0000", 2024-09-18T05:14:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3730000000000001e-05 2024-09-18T05:14:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267645+0000", 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036657796999999999 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267724+0000", 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9543999999999996e-05 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267830+0000", 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010537 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17117 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2785280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967527449000002, 2024-09-18T05:14:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037156242999999999, 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17117 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231000+0000", 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.230999+0000", 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231006+0000", 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5270000000000004e-06 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231024+0000", 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7853e-05 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231096+0000", 2024-09-18T05:14:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2009999999999997e-05 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267871+0000", 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.036775782 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.267992+0000", 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120264 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268157+0000", 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016496699999999999 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17118 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2850816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967409805999999, 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037404872999999998, 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17118 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231118+0000", 2024-09-18T05:14:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231117+0000", 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231125+0000", 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0490000000000004e-06 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231149+0000", 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4323000000000001e-05 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231166+0000", 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6399999999999999e-05 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268205+0000", 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037039504000000001 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268363+0000", 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000157422 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268523+0000", 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016030800000000001 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17119 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967347887000003, 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037672888000000002, 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17119 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231180+0000", 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231179+0000", 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231186+0000", 2024-09-18T05:14:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2799999999999998e-06 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231209+0000", 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2436999999999999e-05 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231224+0000", 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.539e-05 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268565+0000", 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037341050000000001 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268698+0000", 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013245999999999999 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268853+0000", 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000155348 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17120 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 2981888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967289467000001, 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.03796592, 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17120 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231238+0000", 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231237+0000", 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231244+0000", 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.956e-06 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231267+0000", 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2816e-05 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231280+0000", 2024-09-18T05:14:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3414000000000001e-05 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.268903+0000", 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037622137999999999 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269043+0000", 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014048700000000001 2024-09-18T05:14:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269204+0000", 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016130199999999999 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17121 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3047424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967235840999997, 2024-09-18T05:14:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038243620999999998, 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17121 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231292+0000", 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231291+0000", 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231297+0000", 2024-09-18T05:14:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6400000000000002e-06 2024-09-18T05:14:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231316+0000", 2024-09-18T05:14:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9369999999999999e-05 2024-09-18T05:14:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231328+0000", 2024-09-18T05:14:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2126e-05 2024-09-18T05:14:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269247+0000", 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037919258999999997 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269380+0000", 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132146 2024-09-18T05:14:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269536+0000", 2024-09-18T05:14:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015605999999999999 2024-09-18T05:14:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17122 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3112960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967188778000001, 2024-09-18T05:14:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038545902, 2024-09-18T05:14:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17122 2024-09-18T05:14:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231339+0000", 2024-09-18T05:14:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231338+0000", 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231359+0000", 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0852999999999998e-05 2024-09-18T05:14:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231375+0000", 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6453e-05 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231388+0000", 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2693e-05 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269582+0000", 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038194194000000001 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269727+0000", 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014489 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269885+0000", 2024-09-18T05:14:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015770199999999999 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17179 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3145728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967128699, 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038821222000000002, 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17179 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231399+0000", 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231398+0000", 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231404+0000", 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.293e-06 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231433+0000", 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9726e-05 2024-09-18T05:14:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231448+0000", 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4194e-05 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.269927+0000", 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038479447999999999 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270062+0000", 2024-09-18T05:14:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013457399999999999 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270220+0000", 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015883299999999999 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17180 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3211264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967068412000003, 2024-09-18T05:14:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039273677999999999, 2024-09-18T05:14:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17180 2024-09-18T05:14:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231459+0000", 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231458+0000", 2024-09-18T05:14:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231470+0000", 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1494e-05 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231495+0000", 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5003000000000001e-05 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231514+0000", 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8600000000000001e-05 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270263+0000", 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.038749798000000002 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270393+0000", 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930099999999999 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270733+0000", 2024-09-18T05:14:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000340446 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17181 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.967001095999997, 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039593201000000001, 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17181 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231527+0000", 2024-09-18T05:14:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231526+0000", 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231532+0000", 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8399999999999997e-06 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231550+0000", 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7193e-05 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231564+0000", 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4513e-05 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270787+0000", 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039223358999999999 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.270944+0000", 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156835 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271120+0000", 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569100000000001 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17182 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3342336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.966952493000001, 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039893757000000002, 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17182 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231575+0000", 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231574+0000", 2024-09-18T05:14:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231581+0000", 2024-09-18T05:14:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5239999999999997e-06 2024-09-18T05:14:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231601+0000", 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0472999999999999e-05 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231635+0000", 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3296000000000001e-05 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271171+0000", 2024-09-18T05:14:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039535985000000003 2024-09-18T05:14:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271302+0000", 2024-09-18T05:14:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013080399999999999 2024-09-18T05:14:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271469+0000", 2024-09-18T05:14:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000167539 2024-09-18T05:14:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17183 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3407872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.966878874000002, 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040158310000000003, 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17183 2024-09-18T05:14:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231649+0000", 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231648+0000", 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231670+0000", 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1903e-05 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231694+0000", 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4409999999999998e-05 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231709+0000", 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5026e-05 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271515+0000", 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.039806179999999997 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271656+0000", 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140347 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271807+0000", 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151667 2024-09-18T05:14:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17184 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3473408~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.966805391000001, 2024-09-18T05:14:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040404938000000001, 2024-09-18T05:14:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17184 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231722+0000", 2024-09-18T05:14:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231721+0000", 2024-09-18T05:14:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231728+0000", 2024-09-18T05:14:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1040000000000001e-06 2024-09-18T05:14:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231753+0000", 2024-09-18T05:14:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4510000000000001e-05 2024-09-18T05:14:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231767+0000", 2024-09-18T05:14:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4029000000000001e-05 2024-09-18T05:14:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271854+0000", 2024-09-18T05:14:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040087040999999997 2024-09-18T05:14:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.271973+0000", 2024-09-18T05:14:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011938399999999999 2024-09-18T05:14:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272127+0000", 2024-09-18T05:14:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015402699999999999 2024-09-18T05:14:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17185 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3538944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.966748801000001, 2024-09-18T05:14:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040782647999999998, 2024-09-18T05:14:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17185 2024-09-18T05:14:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231779+0000", 2024-09-18T05:14:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231778+0000", 2024-09-18T05:14:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231784+0000", 2024-09-18T05:14:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1430000000000003e-06 2024-09-18T05:14:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231801+0000", 2024-09-18T05:14:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6966e-05 2024-09-18T05:14:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231814+0000", 2024-09-18T05:14:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2799999999999999e-05 2024-09-18T05:14:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272173+0000", 2024-09-18T05:14:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040359459 2024-09-18T05:14:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272311+0000", 2024-09-18T05:14:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137675 2024-09-18T05:14:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272562+0000", 2024-09-18T05:14:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000250602 2024-09-18T05:14:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:17186 3.0 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.966702669, 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.041212178000000002, 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 17186 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231825+0000", 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231824+0000", 2024-09-18T05:14:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231830+0000", 2024-09-18T05:14:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:14:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231856+0000", 2024-09-18T05:14:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6570000000000001e-05 2024-09-18T05:14:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.231870+0000", 2024-09-18T05:14:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272629+0000", 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040759019 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.272831+0000", 2024-09-18T05:14:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000202597 2024-09-18T05:14:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.273037+0000", 2024-09-18T05:14:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020597200000000001 2024-09-18T05:14:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.317 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:14:57.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:14:57.320 INFO:teuthology.orchestra.run.smithi017.stdout:4210 read 0x24193ca thru 0x2426e00 (0xda37 bytes) 2024-09-18T05:14:57.320 INFO:teuthology.orchestra.run.smithi017.stdout:4212 clone 33 order 20 su 262144 sc 8 2024-09-18T05:14:57.320 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:57.312+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:57.419 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:14:57.412+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:14:57.486 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:57.486 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:57.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:14:57.546 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:57.542+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:57.616 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:57.616 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:57.616 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:57.616 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:57.616 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:57.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:57.614+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:57.629 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:14:57.721 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:57.714+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:57.792 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 65.966074208999999, 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:14:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:14:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:14:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.972436465999998, 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:14:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:14:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.969819669000003, 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16290 3.4 e32/22 3:23e3b04c:::rbd_data.118b8ff5784d.0000000000000021:head v 32'52, mlcod=32'49)", 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.968728964999997, 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023378159999999999, 2024-09-18T05:14:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819782+0000", 2024-09-18T05:14:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819780+0000", 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819796+0000", 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6325999999999999e-05 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819826+0000", 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9583000000000001e-05 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819845+0000", 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8597000000000002e-05 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819950+0000", 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105356 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820003+0000", 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3295999999999999e-05 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822018+0000", 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020151779999999998 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.822120+0000", 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101316 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.887284157000003, 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:14:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.512746464000003, 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:14:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:14:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:14:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:14:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17196 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'90, mlcod=32'86)", 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.504859881999998, 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023459290000000001, 2024-09-18T05:14:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283651+0000", 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283650+0000", 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283663+0000", 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2697999999999999e-05 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283682+0000", 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9012999999999999e-05 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283691+0000", 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7720000000000006e-06 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283777+0000", 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5923999999999999e-05 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.283830+0000", 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2320000000000001e-05 2024-09-18T05:14:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285942+0000", 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002112039 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.285997+0000", 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5322000000000003e-05 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.821817281999998, 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:45232 3.9 e50/22 3:9465da8c:::rbd_data.118bbcb4fc94.000000000000000d:head v 50'101, mlcod=49'99)", 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.389094870000001, 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364489, 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399416+0000", 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399415+0000", 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399425+0000", 2024-09-18T05:14:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5429999999999999e-06 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399455+0000", 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9887e-05 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399472+0000", 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6821e-05 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399619+0000", 2024-09-18T05:14:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146971 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.399693+0000", 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4004999999999994e-05 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401682+0000", 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019894869999999999 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:26.401781+0000", 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8471e-05 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47581 3.4 e52/22 3:24a94b22:::rbd_data.118ba98b16f7.0000000000000011:head v 52'130, mlcod=52'128)", 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.123844723000001, 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033849169999999999, 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664664+0000", 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664684+0000", 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0044e-05 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664730+0000", 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6097000000000003e-05 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664751+0000", 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1024000000000001e-05 2024-09-18T05:14:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664942+0000", 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190538 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664998+0000", 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6786999999999997e-05 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.667951+0000", 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029529040000000001 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668051+0000", 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9866999999999998e-05 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47585 3.4 e52/22 3:277480c1:::rbd_data.118ba98b16f7.0000000000000015:head v 52'131, mlcod=52'128)", 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.123099495999998, 2024-09-18T05:14:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027129139999999999, 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665410+0000", 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665425+0000", 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.499e-05 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665451+0000", 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5936999999999999e-05 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665468+0000", 2024-09-18T05:14:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7430000000000001e-05 2024-09-18T05:14:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665537+0000", 2024-09-18T05:14:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8703999999999998e-05 2024-09-18T05:14:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665585+0000", 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8060999999999999e-05 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668061+0000", 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024756779999999998 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668124+0000", 2024-09-18T05:14:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3676999999999994e-05 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50861 3.9 e57/22 3:937da5aa:::rbd_data.118bea12bf49.0000000000000015:head v 57'133, mlcod=56'130)", 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.490775243000002, 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033859879999999999, 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297735+0000", 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297748+0000", 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3464e-05 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297799+0000", 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0232999999999998e-05 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297821+0000", 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2334e-05 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298165+0000", 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034369199999999999 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298223+0000", 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8457e-05 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301032+0000", 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028085050000000002 2024-09-18T05:14:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301122+0000", 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0112999999999996e-05 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50880 3.0 e57/22 3:045763ee:::rbd_data.118bea12bf49.0000000000000073:head v 57'214, mlcod=57'211)", 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.479581855999999, 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003490136, 2024-09-18T05:14:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308926+0000", 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308950+0000", 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3453000000000001e-05 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309001+0000", 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0736999999999999e-05 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309022+0000", 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1437000000000002e-05 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309166+0000", 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014386100000000001 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309242+0000", 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6459999999999996e-05 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312298+0000", 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030560700000000001 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312419+0000", 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120874 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50883 3.4 e57/22 3:227c9179:::rbd_data.118bea12bf49.00000000000000cb:head v 57'152, mlcod=56'149)", 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.476241114, 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026019060000000002, 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312268+0000", 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312286+0000", 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7756000000000001e-05 2024-09-18T05:14:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312325+0000", 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9029999999999997e-05 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312361+0000", 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6303999999999997e-05 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312471+0000", 2024-09-18T05:14:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010963099999999999 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312527+0000", 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6227000000000002e-05 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314758+0000", 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022307469999999999 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314872+0000", 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011420400000000001 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50934 3.4 e57/22 3:255d0e8e:::rbd_data.118bea12bf49.0000000000000001:head v 57'154, mlcod=56'150)", 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.457693514999999, 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028140449999999998, 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330815+0000", 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330831+0000", 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5756e-05 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330862+0000", 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1180999999999998e-05 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330882+0000", 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0457000000000001e-05 2024-09-18T05:14:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331013+0000", 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013070399999999999 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331082+0000", 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9369999999999995e-05 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333550+0000", 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024677420000000002 2024-09-18T05:14:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333631+0000", 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1230999999999995e-05 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50936 3.9 e57/22 3:907835c8:::rbd_data.118bea12bf49.0000000000000003:head v 57'135, mlcod=56'131)", 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.454684455999999, 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024933360000000001, 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333824+0000", 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333844+0000", 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9562999999999999e-05 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333873+0000", 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9487000000000001e-05 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333891+0000", 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7787000000000001e-05 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334003+0000", 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011215 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334057+0000", 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3857999999999998e-05 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336229+0000", 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021715229999999999 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336320+0000", 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1124000000000004e-05 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:66941 3.0 e72/22 3:07b7f500:::rbd_data.118b17097827.0000000000000000:head v 72'269, mlcod=69'267)", 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.4536203969999999, 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061242639999999999, 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334889+0000", 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336629+0000", 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017390940000000001 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336658+0000", 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9649999999999999e-05 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336672+0000", 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3896999999999999e-05 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336737+0000", 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4466000000000002e-05 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336766+0000", 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8968000000000001e-05 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.340973+0000", 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042071629999999999 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341015+0000", 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2113999999999997e-05 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:66942 3.0 e72/22 3:07b7f500:::rbd_data.118b17097827.0000000000000000:head v 72'271, mlcod=69'267)", 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.4497887250000003, 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029717519999999998, 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:14:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338721+0000", 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338732+0000", 2024-09-18T05:14:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1231e-05 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338747+0000", 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5262999999999999e-05 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338757+0000", 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5060000000000001e-06 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338863+0000", 2024-09-18T05:14:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106136 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338888+0000", 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4706999999999999e-05 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341659+0000", 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027712639999999998 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341694+0000", 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5123000000000002e-05 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:70720 3.4 e72/22 3:265cd162:::rbd_data.118beb272ca1.0000000000000008:head v 72'168, mlcod=72'166)", 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.0035789519999998, 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0073855960000000003, 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784930+0000", 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784944+0000", 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4226000000000001e-05 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784968+0000", 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3777999999999998e-05 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784980+0000", 2024-09-18T05:14:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1296e-05 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.785034+0000", 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4289000000000001e-05 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.785059+0000", 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5375999999999999e-05 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.792252+0000", 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071932289999999998 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.792318+0000", 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5124999999999997e-05 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:70721 3.0 e72/22 3:011c2880:::rbd_data.118beb272ca1.0000000000000009:head v 72'276, mlcod=72'274)", 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:14:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.9968160390000005, 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078875809999999994, 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:14:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791693+0000", 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794951+0000", 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003257402 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794977+0000", 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6078999999999999e-05 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794994+0000", 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6585000000000001e-05 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.795054+0000", 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538999999999998e-05 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.795083+0000", 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8972e-05 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.799462+0000", 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043787540000000003 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.799582+0000", 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120661 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:57.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:57.881 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:57.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:14:57.883 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:57.878+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:57.983 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:57.980+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:58.054 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:58.054 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:14:58.054 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:58.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:14:58.114 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:58.110+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:58.186 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:58.180+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:58.187 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:58.187 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:14:58.187 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:14:58.188 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:14:58.188 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:58.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:14:58.287 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:58.280+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:58.379 INFO:teuthology.orchestra.run.smithi017.stdout:leaving image image_client.0-clone32 intact 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.467489873999995, 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.382 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.384 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.467458930999996, 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:14:58.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:14:58.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:14:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:14:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.467433366999998, 2024-09-18T05:14:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:14:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.467408651, 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.398 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:14:58.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:14:58.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.467382416999996, 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:14:58.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:14:58.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.467353508000002, 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:14:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.467329677999999, 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:14:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.467305202000006, 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.467187402999997, 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:14:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:14:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.464195447999998, 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:14:58.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:14:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.464117385999998, 2024-09-18T05:14:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:14:58.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:14:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.464086098999999, 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:14:58.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:14:58.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.464060086000003, 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:14:58.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.464032313000004, 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:14:58.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.445 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.464007249999995, 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:14:58.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:14:58.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.463982220000005, 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:14:58.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.459857892000002, 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.454 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:58.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.458 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.459837347000004, 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.459817665000003, 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.463 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:14:58.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:14:58.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:14:58.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.191746218, 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:14:58.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:14:58.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:14:58.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:14:58.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:14:58.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:14:58.473 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:14:58.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:14:58.475 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:14:58.470+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:14:58.576 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:58.572+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:58.579 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-18T05:14:58.606 INFO:teuthology.orchestra.run.smithi017.stdout:4213 writesame 0xabb9180 thru 0xabba3fb data_size 0xe(0x127c bytes) 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:75654 3.1c 3:3b97b143:::rbd_object_map.118bd6fb3c7:head [call lock.assert_locked in=44b,call rbd.object_map_resize in=29b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.611479+0000", 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0014384619999999999, 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014872970000000001, 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "waiting for sub ops", 2024-09-18T05:14:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 75654 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.611479+0000", 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.611479+0000", 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.611477+0000", 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.611489+0000", 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.199e-05 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.611518+0000", 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9059000000000001e-05 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.611533+0000", 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4233000000000001e-05 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.611591+0000", 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8224999999999999e-05 2024-09-18T05:14:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.611677+0000", 2024-09-18T05:14:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6373999999999997e-05 2024-09-18T05:14:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-18T05:14:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.611925+0000", 2024-09-18T05:14:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024738599999999999 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.612871+0000", 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00094591800000000002 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 1 2024-09-18T05:14:58.619 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:58.623 INFO:teuthology.orchestra.run.smithi017.stdout:4215 write 0xd5be60e thru 0xd5c13fc (0x2def bytes) 2024-09-18T05:14:58.631 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:14:58.632 INFO:teuthology.orchestra.run.smithi017.stdout:4217 read 0x4d41dd thru 0x4d688d (0x26b1 bytes) 2024-09-18T05:14:58.633 INFO:teuthology.orchestra.run.smithi017.stdout:4219 punch from 0xa86e16e to 0xa87c12d, (0xdfbf bytes) 2024-09-18T05:14:58.633 INFO:teuthology.orchestra.run.smithi017.stdout:4221 punch from 0x2b16e79 to 0x2b1cb8d, (0x5d14 bytes) 2024-09-18T05:14:58.634 INFO:teuthology.orchestra.run.smithi017.stdout:4222 read 0x5fceb4f thru 0x5fd2c98 (0x414a bytes) 2024-09-18T05:14:58.634 INFO:teuthology.orchestra.run.smithi017.stdout:4223 read 0x7ff42a3 thru 0x8001977 (0xd6d5 bytes) 2024-09-18T05:14:58.634 INFO:teuthology.orchestra.run.smithi017.stdout:4224 writesame 0xb33eb08 thru 0xb340be4 data_size 0x1(0x20dd bytes) 2024-09-18T05:14:58.647 INFO:teuthology.orchestra.run.smithi017.stdout:4225 writesame 0x81382a2 thru 0x81473b4 data_size 0x1(0xf113 bytes) 2024-09-18T05:14:58.677 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:58.670+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:58.701 INFO:teuthology.orchestra.run.smithi017.stdout:4226 punch from 0xc95bb6a to 0xc963206, (0x769c bytes) 2024-09-18T05:14:58.702 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:58.702 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:58.702 INFO:teuthology.orchestra.run.smithi017.stdout:4232 write 0x2843e72 thru 0x28501e7 (0xc376 bytes) 2024-09-18T05:14:58.736 INFO:teuthology.orchestra.run.smithi017.stdout:4233 punch from 0x894d6df to 0x8959ff4, (0xc915 bytes) 2024-09-18T05:14:58.736 INFO:teuthology.orchestra.run.smithi017.stdout:4234 read 0xc1d2cc9 thru 0xc1e18ea (0xec22 bytes) 2024-09-18T05:14:58.736 INFO:teuthology.orchestra.run.smithi017.stdout:4235 punch from 0x20ba421 to 0x20bdf0f, (0x3aee bytes) 2024-09-18T05:14:58.736 INFO:teuthology.orchestra.run.smithi017.stdout:4237 write 0x44981a5 thru 0x44a7d55 (0xfbb1 bytes) 2024-09-18T05:14:58.744 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:58.744 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:58.744 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:58.744 INFO:teuthology.orchestra.run.smithi017.stdout:4243 write 0x2b4154e thru 0x2b453eb (0x3e9e bytes) 2024-09-18T05:14:58.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:58.770+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:58.797 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:58.797 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:14:58.797 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:14:58.797 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:14:58.797 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:58.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:14:58.834 INFO:teuthology.orchestra.run.smithi017.stdout:4244 write 0x6f3fe3f thru 0x6f43fbb (0x417d bytes) 2024-09-18T05:14:58.841 INFO:teuthology.orchestra.run.smithi017.stdout:4245 punch from 0x27151b0 to 0x2716198, (0xfe8 bytes) 2024-09-18T05:14:58.841 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:58.841 INFO:teuthology.orchestra.run.smithi017.stdout:4247 write 0x1bc56c0 thru 0x1bcc642 (0x6f83 bytes) 2024-09-18T05:14:58.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:14:58.874+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:14:58.896 INFO:teuthology.orchestra.run.smithi017.stdout:4248 read 0x5d370a6 thru 0x5d3ddfc (0x6d57 bytes) 2024-09-18T05:14:58.896 INFO:teuthology.orchestra.run.smithi017.stdout:4251 writesame 0x7d62c21 thru 0x7d63475 data_size 0x3(0x855 bytes) 2024-09-18T05:14:58.901 INFO:teuthology.orchestra.run.smithi017.stdout:4252 read 0x4060a73 thru 0x406b528 (0xaab6 bytes) 2024-09-18T05:14:58.902 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:58.903 INFO:teuthology.orchestra.run.smithi017.stdout:4254 read 0x5594c0 thru 0x55a7b4 (0x12f5 bytes) 2024-09-18T05:14:58.913 INFO:teuthology.orchestra.run.smithi017.stdout:4255 trunc from 0xd5c13fd to 0xa6d6200 2024-09-18T05:14:58.928 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:58.929 INFO:teuthology.orchestra.run.smithi017.stdout:4257 writesame 0x541fd5f thru 0x5428760 data_size 0x5(0x8a02 bytes) 2024-09-18T05:14:58.936 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:58.936 INFO:teuthology.orchestra.run.smithi017.stdout:4259 read 0x58eae20 thru 0x58ee801 (0x39e2 bytes) 2024-09-18T05:14:58.936 INFO:teuthology.orchestra.run.smithi017.stdout:4260 write 0x797894e thru 0x79833f4 (0xaaa7 bytes) 2024-09-18T05:14:58.942 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:58.942 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:14:58.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:14:58.942 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:58.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.942 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.942 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:14:58.942 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.191652929, 2024-09-18T05:14:58.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:14:58.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.946 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19164393900000001, 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:14:58.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19163497199999999, 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:14:58.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.191626189, 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.956 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:14:58.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19161741299999999, 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.960 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19160712099999999, 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:14:58.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.191593234, 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.969 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:14:58.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19158402799999999, 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.974 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:14:58.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:14:58.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:14:58.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:14:58.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:14:58.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:14:58.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.980 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.980 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:14:58.980 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19157532999999999, 2024-09-18T05:14:58.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:14:58.980 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.980 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.980 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.980 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.980 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.984 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19156626500000001, 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:14:58.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19154290700000001, 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:14:58.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:14:58.994 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19153324199999999, 2024-09-18T05:14:58.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:14:58.994 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:58.994 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:58.994 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:58.994 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:58.994 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:58.994 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:14:58.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:14:58.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19150688499999999, 2024-09-18T05:14:59.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:14:59.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:14:59.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.004 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19149335300000001, 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.005 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:14:59.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:59.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19148190200000001, 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:59.009 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:59.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:14:59.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.191472421, 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:14:59.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:14:59.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19146233900000001, 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:59.018 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:59.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.022 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19145325099999999, 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:59.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:14:59.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:59.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.191443694, 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:59.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:14:59.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:59.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:14:59.031 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.19143487300000001, 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:14:59.035 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.036 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.036 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.036 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:59.038 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:14:59.038 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:59.032+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:4261 trunc from 0xa6d6200 to 0xe31b913 2024-09-18T05:14:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:4262 read 0x47be14a thru 0x47ccde4 (0xec9b bytes) 2024-09-18T05:14:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:4263 writesame 0xad50da6 thru 0xad5c164 data_size 0x1(0xb3bf bytes) 2024-09-18T05:14:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:4264 trunc from 0xe31b913 to 0xb7d6879 2024-09-18T05:14:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:4265 read 0x23d879 thru 0x24bd91 (0xe519 bytes) 2024-09-18T05:14:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:4266 write 0x51e88da thru 0x51f092b (0x8052 bytes) 2024-09-18T05:14:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:4270 write 0x4cbbd9b thru 0x4cbfa56 (0x3cbc bytes) 2024-09-18T05:14:59.048 INFO:teuthology.orchestra.run.smithi017.stdout:4271 trunc from 0xb7d6879 to 0x244d284 2024-09-18T05:14:59.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:14:59.138 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:59.132+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:59.201 INFO:teuthology.orchestra.run.smithi017.stdout:4272 write 0xf524ba thru 0xf56199 (0x3ce0 bytes) 2024-09-18T05:14:59.219 INFO:teuthology.orchestra.run.smithi017.stdout:4273 writesame 0x22dc396 thru 0x22e39be data_size 0x3(0x7629 bytes) 2024-09-18T05:14:59.227 INFO:teuthology.orchestra.run.smithi017.stdout:4274 punch from 0x179c4a5 to 0x17a9a24, (0xd57f bytes) 2024-09-18T05:14:59.227 INFO:teuthology.orchestra.run.smithi017.stdout:4275 punch from 0x232c4cd to 0x2334c23, (0x8756 bytes) 2024-09-18T05:14:59.236 INFO:teuthology.orchestra.run.smithi017.stdout:4278 write 0x3b22c97 thru 0x3b2c160 (0x94ca bytes) 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4491.0:78917 3.1c e77/74 3:3b97b143:::rbd_object_map.118bd6fb3c7:head v 77'582, mlcod=77'580)", 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:59.236527+0000", 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00094304600000000001, 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00097552499999999998, 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:59.236527+0000", 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:59.236527+0000", 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:14:59.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:59.236526+0000", 2024-09-18T05:14:59.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:59.236534+0000", 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0360000000000006e-06 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:59.236547+0000", 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3377000000000001e-05 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:59.236554+0000", 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5590000000000002e-06 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:59.236602+0000", 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7719999999999997e-05 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:14:59.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:59.236623+0000", 2024-09-18T05:14:59.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.124e-05 2024-09-18T05:14:59.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.244 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:14:59.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:14:59.244 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-18T05:14:59.244 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 1 2024-09-18T05:14:59.244 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:14:59.245 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:14:59.234+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:14:59.246 INFO:teuthology.orchestra.run.smithi017.stdout:4279 punch from 0x185ff86 to 0x186a13b, (0xa1b5 bytes) 2024-09-18T05:14:59.246 INFO:teuthology.orchestra.run.smithi017.stdout:4280 read 0x1eeeaf1 thru 0x1ef4551 (0x5a61 bytes) 2024-09-18T05:14:59.246 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.246 INFO:teuthology.orchestra.run.smithi017.stdout:4284 read 0x37b6c47 thru 0x37c5540 (0xe8fa bytes) 2024-09-18T05:14:59.246 INFO:teuthology.orchestra.run.smithi017.stdout:4286 read 0x33170a0 thru 0x3323662 (0xc5c3 bytes) 2024-09-18T05:14:59.246 INFO:teuthology.orchestra.run.smithi017.stdout:4287 punch from 0x2dceb0a to 0x2dceba8, (0x9e bytes) 2024-09-18T05:14:59.246 INFO:teuthology.orchestra.run.smithi017.stdout:4288 trunc from 0x3b2c161 to 0x5d4f2bd 2024-09-18T05:14:59.255 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.256 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:14:59.265 INFO:teuthology.orchestra.run.smithi017.stdout:4291 write 0x8ab43f4 thru 0x8ab4587 (0x194 bytes) 2024-09-18T05:14:59.284 INFO:teuthology.orchestra.run.smithi017.stdout:4293 write 0xe88c3f3 thru 0xe89ad7b (0xe989 bytes) 2024-09-18T05:14:59.289 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.289 INFO:teuthology.orchestra.run.smithi017.stdout:4298 read 0x938630 thru 0x939a95 (0x1466 bytes) 2024-09-18T05:14:59.290 INFO:teuthology.orchestra.run.smithi017.stdout:4299 writesame 0xd748d56 thru 0xd755ecf data_size 0x1(0xd17a bytes) 2024-09-18T05:14:59.298 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:14:59.299 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:14:59.315 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:14:59.315 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:14:59.318 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.319 INFO:teuthology.orchestra.run.smithi017.stdout:4301 read 0x1ffe400 thru 0x2003197 (0x4d98 bytes) 2024-09-18T05:14:59.319 INFO:teuthology.orchestra.run.smithi017.stdout:4302 write 0xced1b4b thru 0xced33a7 (0x185d bytes) 2024-09-18T05:14:59.320 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:14:59.324 INFO:teuthology.orchestra.run.smithi017.stdout:4304 write 0x8cfec30 thru 0x8d03474 (0x4845 bytes) 2024-09-18T05:14:59.334 INFO:teuthology.orchestra.run.smithi017.stdout:4305 trunc from 0xe89ad7c to 0xb7661b7 2024-09-18T05:14:59.334 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:14:59.334 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:14:59.346 INFO:teuthology.orchestra.run.smithi017.stdout:4306 writesame 0x51db210 thru 0x51dbbd5 data_size 0x9(0x9c6 bytes) 2024-09-18T05:14:59.348 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:59.344+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:59.350 INFO:teuthology.orchestra.run.smithi017.stdout:4307 read 0x7b193e2 thru 0x7b21240 (0x7e5f bytes) 2024-09-18T05:14:59.352 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:14:59.352 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:14:59.355 INFO:teuthology.orchestra.run.smithi017.stdout:4308 trunc from 0xb7661b7 to 0x85cfeba 2024-09-18T05:14:59.368 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.368 INFO:teuthology.orchestra.run.smithi017.stdout:4310 read 0x5d66057 thru 0x5d6edfd (0x8da7 bytes) 2024-09-18T05:14:59.368 INFO:teuthology.orchestra.run.smithi017.stdout:4311 write 0xcf9b33 thru 0xcffb7a (0x6048 bytes) 2024-09-18T05:14:59.371 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:14:59.371 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:14:59.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:14:59.396 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:14:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:4313 write 0xe3ad86b thru 0xe3b9cd9 (0xc46f bytes) 2024-09-18T05:14:59.414 INFO:teuthology.orchestra.run.smithi017.stdout:4314 write 0x1d05ac3 thru 0x1d148de (0xee1c bytes) 2024-09-18T05:14:59.415 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:14:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:14:59.440 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:59.436+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:59.440 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:59.441 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:59.444 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:14:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:14:59.444 INFO:teuthology.orchestra.run.smithi017.stdout:4315 write 0xc3f7045 thru 0xc3fd063 (0x601f bytes) 2024-09-18T05:14:59.449 INFO:teuthology.orchestra.run.smithi017.stdout:4316 punch from 0x6bbf5d to 0x6c584e, (0x98f1 bytes) 2024-09-18T05:14:59.450 INFO:teuthology.orchestra.run.smithi017.stdout:4317 punch from 0x672472f to 0x673328b, (0xeb5c bytes) 2024-09-18T05:14:59.450 INFO:teuthology.orchestra.run.smithi017.stdout:4319 punch from 0x1d348ea to 0x1d3ed2b, (0xa441 bytes) 2024-09-18T05:14:59.450 INFO:teuthology.orchestra.run.smithi017.stdout:4320 read 0x7c5fc51 thru 0x7c612eb (0x169b bytes) 2024-09-18T05:14:59.450 INFO:teuthology.orchestra.run.smithi017.stdout:4321 write 0x209c859 thru 0x20a4978 (0x8120 bytes) 2024-09-18T05:14:59.452 INFO:teuthology.orchestra.run.smithi017.stdout:4322 punch from 0x4dbc045 to 0x4dca1df, (0xe19a bytes) 2024-09-18T05:14:59.453 INFO:teuthology.orchestra.run.smithi017.stdout:4324 read 0x9fb83f9 thru 0x9fc02f1 (0x7ef9 bytes) 2024-09-18T05:14:59.453 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.453 INFO:teuthology.orchestra.run.smithi017.stdout:4326 read 0x48d7469 thru 0x48dc7fd (0x5395 bytes) 2024-09-18T05:14:59.453 INFO:teuthology.orchestra.run.smithi017.stdout:4327 writesame 0x3515aad thru 0x352587d data_size 0x79(0xfdd1 bytes) 2024-09-18T05:14:59.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:14:59.458 INFO:teuthology.orchestra.run.smithi017.stdout:4328 write 0x287bf6b thru 0x28893ff (0xd495 bytes) 2024-09-18T05:14:59.464 INFO:teuthology.orchestra.run.smithi017.stdout:4329 writesame 0x4335985 thru 0x4337df1 data_size 0x5(0x246d bytes) 2024-09-18T05:14:59.469 INFO:teuthology.orchestra.run.smithi017.stdout:4330 writesame 0xbfadf07 thru 0xbfbc4d1 data_size 0x1(0xe5cb bytes) 2024-09-18T05:14:59.500 INFO:teuthology.orchestra.run.smithi017.stdout:4331 punch from 0x9c9080b to 0x9c9a293, (0x9a88 bytes) 2024-09-18T05:14:59.508 INFO:teuthology.orchestra.run.smithi017.stdout:4332 trunc from 0xe3b9cda to 0x8a5d2e0 2024-09-18T05:14:59.525 INFO:teuthology.orchestra.run.smithi017.stdout:4336 writesame 0x7632627 thru 0x763d79a data_size 0x29(0xb174 bytes) 2024-09-18T05:14:59.546 INFO:teuthology.orchestra.run.smithi017.stdout:4338 write 0xb2b7555 thru 0xb2c3347 (0xbdf3 bytes) 2024-09-18T05:14:59.549 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:14:59.544+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:14:59.552 INFO:teuthology.orchestra.run.smithi017.stdout:4340 punch from 0x5a47761 to 0x5a51968, (0xa207 bytes) 2024-09-18T05:14:59.552 INFO:teuthology.orchestra.run.smithi017.stdout:4342 writesame 0x5343d80 thru 0x5348532 data_size 0x1(0x47b3 bytes) 2024-09-18T05:14:59.568 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.568 INFO:teuthology.orchestra.run.smithi017.stdout:4345 punch from 0xce281f to 0xceb5f5, (0x8dd6 bytes) 2024-09-18T05:14:59.568 INFO:teuthology.orchestra.run.smithi017.stdout:4346 writesame 0x68ec2af thru 0x68f8424 data_size 0x1(0xc176 bytes) 2024-09-18T05:14:59.626 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:59.626 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:59.634 INFO:teuthology.orchestra.run.smithi017.stdout:4348 write 0xc093fdd thru 0xc094acb (0xaef bytes) 2024-09-18T05:14:59.641 INFO:teuthology.orchestra.run.smithi017.stdout:4349 read 0x81c9377 thru 0x81cb5fc (0x2286 bytes) 2024-09-18T05:14:59.642 INFO:teuthology.orchestra.run.smithi017.stdout:4350 read 0x397f7f9 thru 0x398790d (0x8115 bytes) 2024-09-18T05:14:59.642 INFO:teuthology.orchestra.run.smithi017.stdout:4351 writesame 0x137c808 thru 0x13820ec data_size 0x1(0x58e5 bytes) 2024-09-18T05:14:59.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:14:59.643 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:14:59.636+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:14:59.720 INFO:teuthology.orchestra.run.smithi017.stdout:4352 read 0x190a5aa thru 0x19117ac (0x7203 bytes) 2024-09-18T05:14:59.721 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.721 INFO:teuthology.orchestra.run.smithi017.stdout:4354 write 0x80b6df5 thru 0x80b9232 (0x243e bytes) 2024-09-18T05:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout:4356 read 0xad8661 thru 0xadaceb (0x268b bytes) 2024-09-18T05:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout:4357 punch from 0x9637cfd to 0x963cbeb, (0x4eee bytes) 2024-09-18T05:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout:4358 writesame 0xa135653 thru 0xa13a83b data_size 0x1(0x51e9 bytes) 2024-09-18T05:14:59.740 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:14:59.743 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:59.738+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:59.811 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:59.811 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:59.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:14:59.844 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:14:59.838+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:14:59.945 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:14:59.940+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:14:59.947 INFO:teuthology.orchestra.run.smithi017.stdout:4361 write 0xdd81e16 thru 0xdd905ad (0xe798 bytes) 2024-09-18T05:14:59.949 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:14:59.949 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:14:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:4364 writesame 0x9dd4c5c thru 0x9dd586f data_size 0x2(0xc14 bytes) 2024-09-18T05:14:59.963 INFO:teuthology.orchestra.run.smithi017.stdout:4365 write 0xc236e47 thru 0xc2447fd (0xd9b7 bytes) 2024-09-18T05:14:59.965 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:14:59.971 INFO:teuthology.orchestra.run.smithi017.stdout:4367 punch from 0x7eada8 to 0x7ebd27, (0xf7f bytes) 2024-09-18T05:14:59.971 INFO:teuthology.orchestra.run.smithi017.stdout:4369 writesame 0x2847974 thru 0x284a1a4 data_size 0x1(0x2831 bytes) 2024-09-18T05:14:59.980 INFO:teuthology.orchestra.run.smithi017.stdout:4370 write 0x5944438 thru 0x594a298 (0x5e61 bytes) 2024-09-18T05:14:59.986 INFO:teuthology.orchestra.run.smithi017.stdout:4371 write 0x503cde thru 0x50471e (0xa41 bytes) 2024-09-18T05:15:00.027 INFO:teuthology.orchestra.run.smithi017.stdout:4372 flatten 2024-09-18T05:15:00.056 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:00.052+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:00.147 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:00.140+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:00.168 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:00.169 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:00.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:00.231 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-18T05:15:00.232 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:15:00.232 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-18T05:15:00.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-18T05:15:00.234 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:15:00.272 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:00.266+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:00.290 INFO:teuthology.orchestra.run.smithi017.stdout:4373 read 0xcdfb7 thru 0xd5e52 (0x7e9c bytes) 2024-09-18T05:15:00.292 INFO:teuthology.orchestra.run.smithi017.stdout:4374 writesame 0xbd83888 thru 0xbd8b711 data_size 0x3(0x7e8a bytes) 2024-09-18T05:15:00.301 INFO:teuthology.orchestra.run.smithi017.stdout:4375 punch from 0xc9214aa to 0xc931364, (0xfeba bytes) 2024-09-18T05:15:00.301 INFO:teuthology.orchestra.run.smithi017.stdout:4376 punch from 0xa49e477 to 0xa4a398a, (0x5513 bytes) 2024-09-18T05:15:00.301 INFO:teuthology.orchestra.run.smithi017.stdout:4377 writesame 0xd7fa48a thru 0xd808359 data_size 0xb8(0xded0 bytes) 2024-09-18T05:15:00.305 INFO:teuthology.orchestra.run.smithi017.stdout:4378 write 0x4228f59 thru 0x42331de (0xa286 bytes) 2024-09-18T05:15:00.309 INFO:teuthology.orchestra.run.smithi017.stdout:4379 write 0x7e9dfdc thru 0x7ea690c (0x8931 bytes) 2024-09-18T05:15:00.313 INFO:teuthology.orchestra.run.smithi017.stdout:4380 write 0xd27232 thru 0xd2c336 (0x5105 bytes) 2024-09-18T05:15:00.317 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:00.318 INFO:teuthology.orchestra.run.smithi017.stdout:4382 trunc from 0xdd905ae to 0xd16722f 2024-09-18T05:15:00.333 INFO:teuthology.orchestra.run.smithi017.stdout:4383 punch from 0xcb0c710 to 0xcb1a5ba, (0xdeaa bytes) 2024-09-18T05:15:00.333 INFO:teuthology.orchestra.run.smithi017.stdout:4384 read 0x5c5358d thru 0x5c5bd5f (0x87d3 bytes) 2024-09-18T05:15:00.334 INFO:teuthology.orchestra.run.smithi017.stdout:4385 writesame 0x9c6b8 thru 0xa022f data_size 0xb(0x3b78 bytes) 2024-09-18T05:15:00.336 INFO:teuthology.orchestra.run.smithi017.stdout:4386 punch from 0xb6740a5 to 0xb68347a, (0xf3d5 bytes) 2024-09-18T05:15:00.336 INFO:teuthology.orchestra.run.smithi017.stdout:4387 write 0x519e17a thru 0x51acb55 (0xe9dc bytes) 2024-09-18T05:15:00.339 INFO:teuthology.orchestra.run.smithi017.stdout:4390 writesame 0x1fd1112 thru 0x1fddc71 data_size 0x10(0xcb60 bytes) 2024-09-18T05:15:00.342 INFO:teuthology.orchestra.run.smithi017.stdout:4391 read 0x3c5d16e thru 0x3c67d5c (0xabef bytes) 2024-09-18T05:15:00.342 INFO:teuthology.orchestra.run.smithi017.stdout:4392 read 0x691a067 thru 0x691fe56 (0x5df0 bytes) 2024-09-18T05:15:00.343 INFO:teuthology.orchestra.run.smithi017.stdout:4393 write 0x5477655 thru 0x547deea (0x6896 bytes) 2024-09-18T05:15:00.346 INFO:teuthology.orchestra.run.smithi017.stdout:4394 read 0x9c3abb9 thru 0x9c3cdae (0x21f6 bytes) 2024-09-18T05:15:00.346 INFO:teuthology.orchestra.run.smithi017.stdout:4396 read 0xa36e4fa thru 0xa37937e (0xae85 bytes) 2024-09-18T05:15:00.346 INFO:teuthology.orchestra.run.smithi017.stdout:4398 write 0x6f66c7d thru 0x6f76988 (0xfd0c bytes) 2024-09-18T05:15:00.348 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:00.342+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:00.349 INFO:teuthology.orchestra.run.smithi017.stdout:4400 read 0x8a1d585 thru 0x8a2a0c0 (0xcb3c bytes) 2024-09-18T05:15:00.349 INFO:teuthology.orchestra.run.smithi017.stdout:4401 writesame 0x9e4853c thru 0x9e532e2 data_size 0x11(0xada7 bytes) 2024-09-18T05:15:00.351 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:00.351 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:00.353 INFO:teuthology.orchestra.run.smithi017.stdout:4404 write 0x5c4d0fe thru 0x5c4d58d (0x490 bytes) 2024-09-18T05:15:00.358 INFO:teuthology.orchestra.run.smithi017.stdout:4406 punch from 0x4c4923c to 0x4c51239, (0x7ffd bytes) 2024-09-18T05:15:00.358 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:00.358 INFO:teuthology.orchestra.run.smithi017.stdout:4408 writesame 0xc7278ba thru 0xc72faa3 data_size 0x8a(0x81ea bytes) 2024-09-18T05:15:00.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:00.372 INFO:teuthology.orchestra.run.smithi017.stdout:4409 write 0xe7fab91 thru 0xe806058 (0xb4c8 bytes) 2024-09-18T05:15:00.378 INFO:teuthology.orchestra.run.smithi017.stdout:4410 write 0x1e55615 thru 0x1e5d20e (0x7bfa bytes) 2024-09-18T05:15:00.382 INFO:teuthology.orchestra.run.smithi017.stdout:4411 read 0xb3b4818 thru 0xb3c23e1 (0xdbca bytes) 2024-09-18T05:15:00.382 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:00.394 INFO:teuthology.orchestra.run.smithi017.stdout:4414 trunc from 0xe806059 to 0x6f9a5e2 2024-09-18T05:15:00.407 INFO:teuthology.orchestra.run.smithi017.stdout:4415 write 0x5a779e6 thru 0x5a7f52a (0x7b45 bytes) 2024-09-18T05:15:00.409 INFO:teuthology.orchestra.run.smithi017.stdout:4417 read 0x12f6f5f thru 0x12f90b3 (0x2155 bytes) 2024-09-18T05:15:00.410 INFO:teuthology.orchestra.run.smithi017.stdout:4418 read 0x563329e thru 0x56402a6 (0xd009 bytes) 2024-09-18T05:15:00.410 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:00.410 INFO:teuthology.orchestra.run.smithi017.stdout:4420 read 0x3a761 thru 0x3f985 (0x5225 bytes) 2024-09-18T05:15:00.416 INFO:teuthology.orchestra.run.smithi017.stdout:4421 trunc from 0x6f9a5e2 to 0x32be8c8 2024-09-18T05:15:00.430 INFO:teuthology.orchestra.run.smithi017.stdout:4422 read 0x1bf0 thru 0xcc4f (0xb060 bytes) 2024-09-18T05:15:00.449 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:00.444+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:00.452 INFO:teuthology.orchestra.run.smithi017.stdout:4424 write 0xd84113e thru 0xd84f4f0 (0xe3b3 bytes) 2024-09-18T05:15:00.457 INFO:teuthology.orchestra.run.smithi017.stdout:4427 clone 34 order 25 su 4194304 sc 9 2024-09-18T05:15:00.497 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:00.498 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:00.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:00.550 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:00.546+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:00.651 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:00.644+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:00.679 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:00.679 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:00.693 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:00.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:00.746+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:00.826 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:00.826 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:00.840 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:00.854 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:00.852+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:00.956 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:00.950+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:01.009 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:01.009 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:01.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:01.058 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:01.052+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:01.159 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:01.156+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:01.184 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:01.185 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:01.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:01.248 INFO:teuthology.orchestra.run.smithi017.stdout:moved 3 / 82 (3.65854%) 2024-09-18T05:15:01.248 INFO:teuthology.orchestra.run.smithi017.stdout:avg 10.25 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 3.19179 -> 2.90474 (expected baseline 2.99479) 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.2 with 5 -> 6 pgs (0.487805 -> 0.585366 * mean) 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.0 with 13 -> 13 pgs (1.26829 -> 1.26829 * mean) 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:oload 110 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 3 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0005 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0005 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 weight 1.0000 -> 0.7706 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 weight 1.0000 -> 0.8387 2024-09-18T05:15:01.249 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 weight 1.0000 -> 0.8923 2024-09-18T05:15:01.262 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:01.254+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:01.271 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-18T05:15:01.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-18T05:15:01.331 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:01.332 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:01.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:01.362 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:01.356+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:01.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:01.466 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:01.462+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:01.523 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:01.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:01.567 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:01.564+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:01.611 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:01.620 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 82 (0%) 2024-09-18T05:15:01.620 INFO:teuthology.orchestra.run.smithi017.stdout:avg 10.25 2024-09-18T05:15:01.620 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 2.90474 -> 2.90474 (expected baseline 2.99479) 2024-09-18T05:15:01.620 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.6 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-18T05:15:01.621 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.0 with 13 -> 13 pgs (1.26829 -> 1.26829 * mean) 2024-09-18T05:15:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:15:01.621 INFO:teuthology.orchestra.run.smithi017.stdout:oload 1000 2024-09-18T05:15:01.621 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 3 2024-09-18T05:15:01.621 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-18T05:15:01.621 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0005 2024-09-18T05:15:01.621 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0047 2024-09-18T05:15:01.621 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2024-09-18T05:15:01.629 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:01.640 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-18T05:15:01.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-18T05:15:01.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:01.648 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:01.661 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77168 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2203648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.570112398, 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049653801999999997, 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77168 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087448+0000", 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087454+0000", 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2539999999999998e-06 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087471+0000", 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6912999999999999e-05 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087484+0000", 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-18T05:15:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.131161+0000", 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.043676751999999999 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.134176+0000", 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030155300000000002 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137103+0000", 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029268459999999999 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77173 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2326528~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.087735+0000", 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.569826704, 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047399058000000001, 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77173 2024-09-18T05:15:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087735+0000", 2024-09-18T05:15:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087735+0000", 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087733+0000", 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087740+0000", 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6699999999999997e-06 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087757+0000", 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7309999999999999e-05 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087770+0000", 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3027000000000001e-05 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.134901+0000", 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047130094999999997 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135012+0000", 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111369 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135134+0000", 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000121971 2024-09-18T05:15:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77178 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2125824~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088063+0000", 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5694988680000002, 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047341704999999998, 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77178 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088063+0000", 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088063+0000", 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088062+0000", 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088085+0000", 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3470000000000001e-05 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088104+0000", 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.931e-05 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088118+0000", 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3463e-05 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135167+0000", 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047048985000000001 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135282+0000", 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115499 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135404+0000", 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122061 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77179 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2166784~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088131+0000", 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5694305379999998, 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047521819999999999, 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77179 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088131+0000", 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088131+0000", 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088130+0000", 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088136+0000", 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5699999999999998e-06 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088153+0000", 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6857000000000001e-05 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088179+0000", 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6282999999999999e-05 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135437+0000", 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047257637999999998 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135534+0000", 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7021000000000005e-05 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135653+0000", 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118798 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77180 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2207744~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088192+0000", 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5693699219999999, 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047705227000000003, 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77180 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088192+0000", 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088192+0000", 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088190+0000", 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088197+0000", 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8600000000000004e-06 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088215+0000", 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.821e-05 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088229+0000", 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3236e-05 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135689+0000", 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047460624 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135776+0000", 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6664999999999998e-05 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135897+0000", 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120868 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77181 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2248704~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088240+0000", 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5693214520000001, 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047913169999999998, 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77181 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088240+0000", 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088240+0000", 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088239+0000", 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088255+0000", 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5943e-05 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088277+0000", 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2223000000000001e-05 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088291+0000", 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.135937+0000", 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047645166000000003 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136035+0000", 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8707000000000002e-05 2024-09-18T05:15:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136153+0000", 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77182 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2289664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.569257849, 2024-09-18T05:15:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048114297, 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77182 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088303+0000", 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088309+0000", 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5969999999999997e-06 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088330+0000", 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1339999999999999e-05 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088365+0000", 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5036000000000001e-05 2024-09-18T05:15:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136187+0000", 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047821474000000003 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136288+0000", 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010091599999999999 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136418+0000", 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013007700000000001 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77183 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2330624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5691839490000001, 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048282688999999997, 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77183 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088377+0000", 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088383+0000", 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9029999999999998e-06 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088404+0000", 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996999999999999e-05 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088420+0000", 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5353e-05 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136450+0000", 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048030394999999997 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136554+0000", 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103442 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136660+0000", 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010664500000000001 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77188 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2129920~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.568782959, 2024-09-18T05:15:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048117532999999997, 2024-09-18T05:15:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77188 2024-09-18T05:15:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088778+0000", 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088784+0000", 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8000000000000001e-06 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088802+0000", 2024-09-18T05:15:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088835+0000", 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2846999999999999e-05 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136693+0000", 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047858165000000001 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136783+0000", 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9862000000000001e-05 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136896+0000", 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112792 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77190 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2170880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5686182349999997, 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048251255, 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77190 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088942+0000", 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088973+0000", 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0737000000000001e-05 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088996+0000", 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3013000000000001e-05 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089023+0000", 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7183e-05 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136930+0000", 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047907155 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137033+0000", 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103205 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137195+0000", 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016126899999999999 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77192 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2211840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.568470569, 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048391998999999998, 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77192 2024-09-18T05:15:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089090+0000", 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089096+0000", 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089113+0000", 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6379999999999999e-05 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089130+0000", 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7730000000000001e-05 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137239+0000", 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048108962999999998 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137342+0000", 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010229399999999999 2024-09-18T05:15:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137483+0000", 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141235 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77193 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2252800~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5684191050000003, 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048619480999999999, 2024-09-18T05:15:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77193 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089141+0000", 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089158+0000", 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6362999999999999e-05 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089178+0000", 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0469999999999999e-05 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089192+0000", 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4204e-05 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137535+0000", 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048342382000000003 2024-09-18T05:15:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137639+0000", 2024-09-18T05:15:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104042 2024-09-18T05:15:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137762+0000", 2024-09-18T05:15:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012304699999999999 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77194 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2293760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5683553290000001, 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048842564999999998, 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77194 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089205+0000", 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089212+0000", 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5100000000000004e-06 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089229+0000", 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7263000000000001e-05 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089242+0000", 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3027000000000001e-05 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137800+0000", 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048558220999999999 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137928+0000", 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128183 2024-09-18T05:15:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138049+0000", 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120387 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77195 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2334720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5683080889999998, 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049100602, 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77195 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089252+0000", 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089258+0000", 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089276+0000", 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.719e-05 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089291+0000", 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5347000000000001e-05 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138091+0000", 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048800518000000001 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138223+0000", 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131889 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138354+0000", 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013071099999999999 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77202 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2134016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5678822060000002, 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048921765999999998, 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77202 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089677+0000", 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089695+0000", 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.804e-05 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089735+0000", 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0080000000000003e-05 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089748+0000", 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2493e-05 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138392+0000", 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048644219000000002 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138489+0000", 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6836999999999995e-05 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138601+0000", 2024-09-18T05:15:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112494 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77203 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2174976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5678049659999997, 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049108851000000002, 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77203 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089756+0000", 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089761+0000", 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1000000000000003e-06 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089770+0000", 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999999e-06 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089777+0000", 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138641+0000", 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048863453000000001 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138737+0000", 2024-09-18T05:15:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5828000000000005e-05 2024-09-18T05:15:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138865+0000", 2024-09-18T05:15:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128804 2024-09-18T05:15:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77204 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2215936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5677782430000002, 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049349094000000003, 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77204 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089786+0000", 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4529999999999998e-06 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089795+0000", 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4130000000000006e-06 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089801+0000", 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8600000000000004e-06 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138903+0000", 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049101643 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139001+0000", 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7707000000000005e-05 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139132+0000", 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013160099999999999 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77205 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2256896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5677543529999998, 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049589756999999998, 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77205 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089825+0000", 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8340000000000001e-05 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089842+0000", 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6606999999999999e-05 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089854+0000", 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.292e-05 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139170+0000", 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049315335000000002 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139269+0000", 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9339000000000006e-05 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139397+0000", 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127806 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77206 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2297856~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5676948500000001, 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049792218999999999, 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77206 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089866+0000", 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089872+0000", 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9599999999999997e-06 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089888+0000", 2024-09-18T05:15:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-05 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089920+0000", 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890000000000001e-05 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139435+0000", 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049514916999999999 2024-09-18T05:15:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139530+0000", 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4847999999999997e-05 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139659+0000", 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012879999999999999 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77207 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2338816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.5676228500000002, 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04998259, 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77207 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089937+0000", 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089944+0000", 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089963+0000", 2024-09-18T05:15:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8623000000000001e-05 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089976+0000", 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3203999999999999e-05 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139698+0000", 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049722211000000002 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139796+0000", 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7200000000000004e-05 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139921+0000", 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012560499999999999 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:01.755 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:01.757 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:01.757 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:01.758 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:01.759 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:01.760 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:01.760 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:01.760 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:01.761 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:01.761 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:01.761 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:01.761 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:01.750+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:01.858 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:01.852+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:01.931 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:01.931 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:01.933 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 82 (0%) 2024-09-18T05:15:01.933 INFO:teuthology.orchestra.run.smithi017.stdout:avg 10.25 2024-09-18T05:15:01.933 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 2.90474 -> 2.90474 (expected baseline 2.99479) 2024-09-18T05:15:01.933 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.6 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-18T05:15:01.933 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.0 with 13 -> 13 pgs (1.26829 -> 1.26829 * mean) 2024-09-18T05:15:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:15:01.933 INFO:teuthology.orchestra.run.smithi017.stdout:oload 1000 2024-09-18T05:15:01.934 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 0.05 2024-09-18T05:15:01.934 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-18T05:15:01.934 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0005 2024-09-18T05:15:01.934 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0047 2024-09-18T05:15:01.934 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2024-09-18T05:15:01.954 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:15:01.959 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-18T05:15:01.959 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-09-18T05:15:01.959 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:01.954+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:02.059 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:02.054+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:02.079 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:02.080 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:02.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:15:02.161 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:02.156+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:02.261 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.434521855, 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:15:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.440884111999999, 2024-09-18T05:15:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:15:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.438267314999997, 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:15:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:15:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.355731802999998, 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:15:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:15:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.981194109999997, 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:15:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:15:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:15:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.290264927999999, 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:15:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:15:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47581 3.4 e52/22 3:24a94b22:::rbd_data.118ba98b16f7.0000000000000011:head v 52'130, mlcod=52'128)", 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.592292368999999, 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033849169999999999, 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664664+0000", 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664684+0000", 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0044e-05 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664730+0000", 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6097000000000003e-05 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664751+0000", 2024-09-18T05:15:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1024000000000001e-05 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664942+0000", 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190538 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664998+0000", 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6786999999999997e-05 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.667951+0000", 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029529040000000001 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668051+0000", 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9866999999999998e-05 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47585 3.4 e52/22 3:277480c1:::rbd_data.118ba98b16f7.0000000000000015:head v 52'131, mlcod=52'128)", 2024-09-18T05:15:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.591547142000003, 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027129139999999999, 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:15:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665410+0000", 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665425+0000", 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.499e-05 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665451+0000", 2024-09-18T05:15:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5936999999999999e-05 2024-09-18T05:15:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665468+0000", 2024-09-18T05:15:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7430000000000001e-05 2024-09-18T05:15:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665537+0000", 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8703999999999998e-05 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665585+0000", 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8060999999999999e-05 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668061+0000", 2024-09-18T05:15:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024756779999999998 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668124+0000", 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3676999999999994e-05 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50861 3.9 e57/22 3:937da5aa:::rbd_data.118bea12bf49.0000000000000015:head v 57'133, mlcod=56'130)", 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:15:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.959222888999999, 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033859879999999999, 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297735+0000", 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297748+0000", 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3464e-05 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297799+0000", 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0232999999999998e-05 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297821+0000", 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2334e-05 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298165+0000", 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034369199999999999 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298223+0000", 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8457e-05 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301032+0000", 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028085050000000002 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301122+0000", 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0112999999999996e-05 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50880 3.0 e57/22 3:045763ee:::rbd_data.118bea12bf49.0000000000000073:head v 57'214, mlcod=57'211)", 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.948029502000001, 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003490136, 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308926+0000", 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:15:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308950+0000", 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3453000000000001e-05 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309001+0000", 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0736999999999999e-05 2024-09-18T05:15:02.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309022+0000", 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1437000000000002e-05 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309166+0000", 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014386100000000001 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309242+0000", 2024-09-18T05:15:02.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6459999999999996e-05 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312298+0000", 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030560700000000001 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312419+0000", 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120874 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50883 3.4 e57/22 3:227c9179:::rbd_data.118bea12bf49.00000000000000cb:head v 57'152, mlcod=56'149)", 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.944688759999998, 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026019060000000002, 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312268+0000", 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312286+0000", 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7756000000000001e-05 2024-09-18T05:15:02.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312325+0000", 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9029999999999997e-05 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312361+0000", 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6303999999999997e-05 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312471+0000", 2024-09-18T05:15:02.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010963099999999999 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312527+0000", 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6227000000000002e-05 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314758+0000", 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022307469999999999 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314872+0000", 2024-09-18T05:15:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011420400000000001 2024-09-18T05:15:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.312 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50934 3.4 e57/22 3:255d0e8e:::rbd_data.118bea12bf49.0000000000000001:head v 57'154, mlcod=56'150)", 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.926141161, 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028140449999999998, 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330815+0000", 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330831+0000", 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5756e-05 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330862+0000", 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1180999999999998e-05 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330882+0000", 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0457000000000001e-05 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331013+0000", 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013070399999999999 2024-09-18T05:15:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331082+0000", 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9369999999999995e-05 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333550+0000", 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024677420000000002 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333631+0000", 2024-09-18T05:15:02.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1230999999999995e-05 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50936 3.9 e57/22 3:907835c8:::rbd_data.118bea12bf49.0000000000000003:head v 57'135, mlcod=56'131)", 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.923132102, 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024933360000000001, 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333824+0000", 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333844+0000", 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9562999999999999e-05 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333873+0000", 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9487000000000001e-05 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333891+0000", 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7787000000000001e-05 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334003+0000", 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011215 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334057+0000", 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3857999999999998e-05 2024-09-18T05:15:02.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336229+0000", 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021715229999999999 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336320+0000", 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1124000000000004e-05 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:66941 3.0 e72/22 3:07b7f500:::rbd_data.118b17097827.0000000000000000:head v 72'269, mlcod=69'267)", 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9220680429999994, 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061242639999999999, 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334889+0000", 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336629+0000", 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017390940000000001 2024-09-18T05:15:02.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336658+0000", 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9649999999999999e-05 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336672+0000", 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3896999999999999e-05 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336737+0000", 2024-09-18T05:15:02.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4466000000000002e-05 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336766+0000", 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8968000000000001e-05 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.340973+0000", 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042071629999999999 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341015+0000", 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2113999999999997e-05 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:66942 3.0 e72/22 3:07b7f500:::rbd_data.118b17097827.0000000000000000:head v 72'271, mlcod=69'267)", 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9182363710000008, 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029717519999999998, 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.326 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338721+0000", 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338732+0000", 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1231e-05 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338747+0000", 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5262999999999999e-05 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338757+0000", 2024-09-18T05:15:02.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5060000000000001e-06 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338863+0000", 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106136 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338888+0000", 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4706999999999999e-05 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341659+0000", 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027712639999999998 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341694+0000", 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5123000000000002e-05 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:70720 3.4 e72/22 3:265cd162:::rbd_data.118beb272ca1.0000000000000008:head v 72'168, mlcod=72'166)", 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:15:02.330 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4720265979999994, 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0073855960000000003, 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784930+0000", 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784944+0000", 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4226000000000001e-05 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784968+0000", 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3777999999999998e-05 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784980+0000", 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1296e-05 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.785034+0000", 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4289000000000001e-05 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.785059+0000", 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5375999999999999e-05 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.792252+0000", 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071932289999999998 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.792318+0000", 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5124999999999997e-05 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:70721 3.0 e72/22 3:011c2880:::rbd_data.118beb272ca1.0000000000000009:head v 72'276, mlcod=72'274)", 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.465263685, 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078875809999999994, 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.335 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791693+0000", 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794951+0000", 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003257402 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794977+0000", 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6078999999999999e-05 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794994+0000", 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6585000000000001e-05 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.795054+0000", 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538999999999998e-05 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.795083+0000", 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8972e-05 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.799462+0000", 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043787540000000003 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.799582+0000", 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120661 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.339 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:76487 3.9 e77/22 3:92ea6217:::rbd_data.118bd6fb3c7.000000000000001f:head v 77'177, mlcod=76'175)", 2024-09-18T05:15:02.340 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:58.888523+0000", 2024-09-18T05:15:02.340 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.368435893, 2024-09-18T05:15:02.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005330006, 2024-09-18T05:15:02.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.340 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.888523+0000", 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.888523+0000", 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.888522+0000", 2024-09-18T05:15:02.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890185+0000", 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016627949999999999 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890216+0000", 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1149999999999998e-05 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890231+0000", 2024-09-18T05:15:02.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5474000000000001e-05 2024-09-18T05:15:02.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890319+0000", 2024-09-18T05:15:02.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7600000000000002e-05 2024-09-18T05:15:02.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890364+0000", 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.456e-05 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.893773+0000", 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034090600000000002 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.893853+0000", 2024-09-18T05:15:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0123000000000005e-05 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:76558 3.4 e77/22 3:2688020f:::rbd_data.118bd6fb3c7.000000000000004a:head v 77'218, mlcod=75'216)", 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.018894+0000", 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.2380649799999999, 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025181159999999999, 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018894+0000", 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018894+0000", 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018891+0000", 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:02.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018928+0000", 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6683000000000001e-05 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018966+0000", 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7759999999999998e-05 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018981+0000", 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5123000000000001e-05 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.019093+0000", 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011257 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.019138+0000", 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5009999999999998e-05 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.021349+0000", 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022109289999999999 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.021412+0000", 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2377000000000003e-05 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:76564 3.9 e77/22 3:9735bd83:::rbd_data.118bd6fb3c7.0000000000000050:head v 77'180, mlcod=77'178)", 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.051981+0000", 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.2049780299999999, 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027799980000000001, 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.051981+0000", 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.051981+0000", 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.051979+0000", 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052027+0000", 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8050000000000002e-05 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052070+0000", 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3446999999999999e-05 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052089+0000", 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.827e-05 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052593+0000", 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050478600000000002 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052684+0000", 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0543000000000004e-05 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.054686+0000", 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020015850000000002 2024-09-18T05:15:02.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.054761+0000", 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4950000000000006e-05 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.354 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:02.355 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:02.254+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:02.356 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:02.356 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 82 (0%) 2024-09-18T05:15:02.356 INFO:teuthology.orchestra.run.smithi017.stdout:avg 10.25 2024-09-18T05:15:02.356 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 2.90474 -> 2.90474 (expected baseline 2.99479) 2024-09-18T05:15:02.356 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.6 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-18T05:15:02.356 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.0 with 13 -> 13 pgs (1.26829 -> 1.26829 * mean) 2024-09-18T05:15:02.356 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:15:02.357 INFO:teuthology.orchestra.run.smithi017.stdout:oload 1000 2024-09-18T05:15:02.357 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 3 2024-09-18T05:15:02.357 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-18T05:15:02.357 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0005 2024-09-18T05:15:02.357 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0047 2024-09-18T05:15:02.357 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2024-09-18T05:15:02.358 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-18T05:15:02.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-18T05:15:02.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:15:02.362 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:02.356+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:02.462 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:02.458+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:02.511 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:02.512 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:02.512 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:02.512 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:02.529 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:02.563 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:02.556+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:02.663 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:02.660+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:02.681 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:02.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:02.682 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:02.682 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:02.682 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:02.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:02.695 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 82 (0%) 2024-09-18T05:15:02.695 INFO:teuthology.orchestra.run.smithi017.stdout:avg 10.25 2024-09-18T05:15:02.695 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 2.90474 -> 2.90474 (expected baseline 2.99479) 2024-09-18T05:15:02.695 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.6 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-18T05:15:02.696 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.0 with 13 -> 13 pgs (1.26829 -> 1.26829 * mean) 2024-09-18T05:15:02.696 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:15:02.696 INFO:teuthology.orchestra.run.smithi017.stdout:oload 1000 2024-09-18T05:15:02.696 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 0.05 2024-09-18T05:15:02.696 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2024-09-18T05:15:02.696 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0005 2024-09-18T05:15:02.696 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0047 2024-09-18T05:15:02.696 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2024-09-18T05:15:02.765 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:02.760+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:02.808 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.894032271, 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:15:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.894001328000002, 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:15:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:15:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.893975764000004, 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:15:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:15:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.893951048000005, 2024-09-18T05:15:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.893924814000002, 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.893895904999994, 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:15:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.893872075000004, 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:15:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:15:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:15:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:15:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:15:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.893847598999997, 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.893729800000003, 2024-09-18T05:15:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:15:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:15:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:15:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.890737845000004, 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:15:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:15:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.890659783000004, 2024-09-18T05:15:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:15:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:15:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:15:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:15:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:15:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:15:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:15:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.890628496000005, 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:15:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.890602482999995, 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:15:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.890574709999996, 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.879 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.890549647, 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:15:02.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.890524616999997, 2024-09-18T05:15:02.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:15:02.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.889 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.886400288999994, 2024-09-18T05:15:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:15:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:15:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:15:02.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:15:02.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:02.896 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.886379743999996, 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:02.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.886360061999994, 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:15:02.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:15:02.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:15:02.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.618288615000001, 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:02.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:02.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:02.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:15:02.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:02.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:02.913 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:02.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:02.915 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:02.908+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:03.015 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:03.010+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:03.047 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:03.047 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:03.047 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:03.047 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:03.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:03.117 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:03.112+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:03.184 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:03.185 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:03.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:03.218 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:03.214+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:15:03.319 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:03.312+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:03.378 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:03.378 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:03.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:03.378 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:03.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6254808159999996, 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:03.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:15:03.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6254718260000001, 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:15:03.383 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:15:03.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6254628589999998, 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:15:03.391 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6254540760000005, 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:15:03.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6254453, 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.397 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:03.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6254350080000002, 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:03.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.405 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6254211210000005, 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:03.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:15:03.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6254119149999999, 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.410 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:15:03.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6254032169999997, 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:15:03.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6253941520000001, 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:03.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6253707940000002, 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.423 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:03.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.427 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6253611289999998, 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:03.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.431 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6253347720000004, 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.432 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:03.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6253212399999999, 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.436 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.440 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6253097890000001, 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:15:03.444 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6253003079999999, 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.445 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:15:03.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6252902259999997, 2024-09-18T05:15:03.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:03.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6252811380000001, 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.454 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:03.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6252715809999998, 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:15:03.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.62526276, 2024-09-18T05:15:03.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:15:03.463 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:03.463 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:03.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:03.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:03.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:03.463 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:15:03.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.463 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:03.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:03.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:15:03.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:15:03.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.467 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:03.467 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:03.467 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:03.468 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:03.469 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:03.462+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:03.570 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:03.564+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:03.648 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:03.649 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:03.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:03.670 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:03.666+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:03.771 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:03.766+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:03.771 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:03.835 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:03.835 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:03.835 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:03.835 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:03.835 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:03.840 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-18T05:15:03.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:03.896 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:03.892+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:03.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:03.966+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:03.991 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:04.015 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:04.015 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:04.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.352348652000003, 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.017 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:04.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.017 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:04.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:04.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:04.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:04.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:04.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:04.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:04.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:04.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:04.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.352281734000002, 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.022 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:04.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:04.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.026 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.352193223999997, 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:04.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:04.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:04.031 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.352142667999999, 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.032 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.037 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.352079553000003, 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:04.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.352032633, 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:04.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351978754000001, 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:04.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351931620999999, 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.052 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:04.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:04.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:04.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.057 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.058 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:04.058 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351883999000002, 2024-09-18T05:15:04.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:04.058 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.058 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.058 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.058 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.058 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.058 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:04.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:04.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351761177999997, 2024-09-18T05:15:04.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:04.064 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.064 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.064 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:04.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.064 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:04.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351679848000003, 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:04.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:04.073 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351608605000003, 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:04.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:04.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:04.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:04.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:04.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:04.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:04.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:04.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.078 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.079 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.079 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.079 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:04.079 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351558394000001, 2024-09-18T05:15:04.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:04.079 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.080 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.080 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.080 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.080 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.080 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:04.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.080 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:04.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:04.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:04.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:04.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:04.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:04.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:04.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:04.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:04.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351481200000002, 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:04.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:04.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:04.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:04.090 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.090 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.090 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.091 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.091 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:04.091 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351431329999997, 2024-09-18T05:15:04.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:04.091 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.091 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.092 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.092 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.092 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:04.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.092 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:04.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:04.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:04.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:04.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351356758999998, 2024-09-18T05:15:04.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:04.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.103 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351290980999998, 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:04.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351243945, 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:04.108 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:04.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:04.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351181852000003, 2024-09-18T05:15:04.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:04.115 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.115 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.115 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:04.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.115 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.351135472999999, 2024-09-18T05:15:04.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:04.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:04.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:04.126 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:04.126 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:04.127 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:04.127 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:04.128 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:04.128 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:04.129 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:04.120+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:04.129 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:04.154 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:04.154 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:04.188 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:04.188 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:04.224 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:04.225 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:04.228 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:04.224+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:04.257 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:04.258 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:04.295 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:04.296 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:04.302 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:04.303 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:04.317 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:04.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:04.362+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:04.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:04.426+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:04.503 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:04.504 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:04.520 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:04.568 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:04.564+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:04.634 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:04.628+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:04.645 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:04.645 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:04.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:04.739 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:04.734+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:04.825 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:04.825 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:04.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:04.842 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:04.834+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:04.943 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:04.938+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:04.963 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:04.963 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:04.978 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:05.044 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:05.040+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:05.102 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:05.103 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:05.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:05.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:05.158+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:05.245 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:05.240+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:05.249 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:05.249 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:05.262 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:05.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:15:05.347 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:05.340+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:05.447 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:05.442+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:05.477 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:05.477 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:05.496 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:05.590 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:05.586+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:05.606 INFO:teuthology.orchestra.run.smithi017.stdout:4428 read 0x31acbd5 thru 0x31b8335 (0xb761 bytes) 2024-09-18T05:15:05.607 INFO:teuthology.orchestra.run.smithi017.stdout:4429 write 0x2f345e0 thru 0x2f3a087 (0x5aa8 bytes) 2024-09-18T05:15:05.619 INFO:teuthology.orchestra.run.smithi017.stdout:4430 writesame 0xa09cadd thru 0xa0ab4d7 data_size 0x2b(0xe9fb bytes) 2024-09-18T05:15:05.635 INFO:teuthology.orchestra.run.smithi017.stdout:4431 punch from 0x803aac6 to 0x8041c7a, (0x71b4 bytes) 2024-09-18T05:15:05.635 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:05.636 INFO:teuthology.orchestra.run.smithi017.stdout:4433 write 0x3cc2a6 thru 0x3d4b42 (0x889d bytes) 2024-09-18T05:15:05.650 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:05.646+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:05.657 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:05.658 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:05.668 INFO:teuthology.orchestra.run.smithi017.stdout:4436 write 0xeb547f4 thru 0xeb61ac8 (0xd2d5 bytes) 2024-09-18T05:15:05.673 INFO:teuthology.orchestra.run.smithi017.stdout:4437 writesame 0xb763efb thru 0xb764cce data_size 0xa(0xdd4 bytes) 2024-09-18T05:15:05.673 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:05.675 INFO:teuthology.orchestra.run.smithi017.stdout:4438 read 0x9ac8b05 thru 0x9ad89ec (0xfee8 bytes) 2024-09-18T05:15:05.675 INFO:teuthology.orchestra.run.smithi017.stdout:4439 punch from 0xd56d568 to 0xd5775e0, (0xa078 bytes) 2024-09-18T05:15:05.675 INFO:teuthology.orchestra.run.smithi017.stdout:4440 write 0xc94f0d thru 0xca11f4 (0xc2e8 bytes) 2024-09-18T05:15:05.683 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:05.683 INFO:teuthology.orchestra.run.smithi017.stdout:4442 write 0x94db298 thru 0x94e2c22 (0x798b bytes) 2024-09-18T05:15:05.705 INFO:teuthology.orchestra.run.smithi017.stdout:4444 read 0x305b97c thru 0x306908e (0xd713 bytes) 2024-09-18T05:15:05.706 INFO:teuthology.orchestra.run.smithi017.stdout:4445 writesame 0x9426513 thru 0x942fc20 data_size 0xf(0x970e bytes) 2024-09-18T05:15:05.711 INFO:teuthology.orchestra.run.smithi017.stdout:4446 read 0x6e12e5d thru 0x6e1c109 (0x92ad bytes) 2024-09-18T05:15:05.712 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:05.713 INFO:teuthology.orchestra.run.smithi017.stdout:4449 read 0xa4ebd8e thru 0xa4fac1b (0xee8e bytes) 2024-09-18T05:15:05.713 INFO:teuthology.orchestra.run.smithi017.stdout:4451 punch from 0xafab85a to 0xafb1010, (0x57b6 bytes) 2024-09-18T05:15:05.713 INFO:teuthology.orchestra.run.smithi017.stdout:4454 write 0x30a91b1 thru 0x30ab4b0 (0x2300 bytes) 2024-09-18T05:15:05.715 INFO:teuthology.orchestra.run.smithi017.stdout:4456 punch from 0x9b8f118 to 0x9b965b6, (0x749e bytes) 2024-09-18T05:15:05.715 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:05.715 INFO:teuthology.orchestra.run.smithi017.stdout:4459 read 0x3ead12a thru 0x3eb59b4 (0x888b bytes) 2024-09-18T05:15:05.715 INFO:teuthology.orchestra.run.smithi017.stdout:4460 writesame 0xaa625db thru 0xaa68f6e data_size 0x3a(0x6994 bytes) 2024-09-18T05:15:05.747 INFO:teuthology.orchestra.run.smithi017.stdout:4461 trunc from 0xeb61ac9 to 0x37bc39 2024-09-18T05:15:05.751 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:05.744+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:05.800 INFO:teuthology.orchestra.run.smithi017.stdout:4462 write 0x38d5799 thru 0x38e540e (0xfc76 bytes) 2024-09-18T05:15:05.803 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:05.803 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:05.806 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:05.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:05.825 INFO:teuthology.orchestra.run.smithi017.stdout:4464 write 0x854745f thru 0x8551a05 (0xa5a7 bytes) 2024-09-18T05:15:05.833 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:05.833 INFO:teuthology.orchestra.run.smithi017.stdout:4466 read 0x6ef78c4 thru 0x6efee6d (0x75aa bytes) 2024-09-18T05:15:05.834 INFO:teuthology.orchestra.run.smithi017.stdout:4467 punch from 0x13429ac to 0x1347a2d, (0x5081 bytes) 2024-09-18T05:15:05.834 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:05.834 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:05.835 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:05.835 INFO:teuthology.orchestra.run.smithi017.stdout:4472 writesame 0x3d3dc24 thru 0x3d4294f data_size 0x16(0x4d2c bytes) 2024-09-18T05:15:05.837 INFO:teuthology.orchestra.run.smithi017.stdout:4475 write 0x4f2b840 thru 0x4f32512 (0x6cd3 bytes) 2024-09-18T05:15:05.844 INFO:teuthology.orchestra.run.smithi017.stdout:4476 writesame 0x7875319 thru 0x7881b4a data_size 0x7d(0xc832 bytes) 2024-09-18T05:15:05.851 INFO:teuthology.orchestra.run.smithi017.stdout:4477 write 0x3d078d0 thru 0x3d09d2d (0x245e bytes) 2024-09-18T05:15:05.851 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:05.844+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:05.853 INFO:teuthology.orchestra.run.smithi017.stdout:4478 writesame 0x1f81541 thru 0x1f87974 data_size 0x4(0x6434 bytes) 2024-09-18T05:15:05.871 INFO:teuthology.orchestra.run.smithi017.stdout:4480 trunc from 0x8551a06 to 0x544451c 2024-09-18T05:15:05.897 INFO:teuthology.orchestra.run.smithi017.stdout:4481 writesame 0x6aaa4ef thru 0x6aaec4d data_size 0xb(0x475f bytes) 2024-09-18T05:15:05.897 INFO:teuthology.orchestra.run.smithi017.stdout:4482 write 0x3726329 thru 0x372ff4c (0x9c24 bytes) 2024-09-18T05:15:05.903 INFO:teuthology.orchestra.run.smithi017.stdout:4483 read 0xc37cfc thru 0xc42623 (0xa928 bytes) 2024-09-18T05:15:05.904 INFO:teuthology.orchestra.run.smithi017.stdout:4484 read 0x5344e11 thru 0x534a44c (0x563c bytes) 2024-09-18T05:15:05.904 INFO:teuthology.orchestra.run.smithi017.stdout:4485 clone 35 order 20 su 131072 sc 11 2024-09-18T05:15:05.950 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:05.950 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:05.952 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:05.948+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:05.963 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:06.053 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:06.048+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:06.129 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:06.129 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:06.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:06.154 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:06.148+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:06.255 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:06.250+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:06.268 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:06.268 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:06.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:15:06.288 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:15:06.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:06.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:06.354+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:leaving image image_client.0-clone34 intact 2024-09-18T05:15:06.439 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:06.439 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:06.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:06.450+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:06.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:15:06.498 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:06.499 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:06.516 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:06.516 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:06.529 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-18T05:15:06.533 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:06.550 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:06.558 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:06.552+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:06.571 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:06.571 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:06.591 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:06.592 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:06.612 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:06.612 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:06.636 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:06.637 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:1456 3.0 e26/22 3:01a5d251:::rbd_data.118b4598dbfb.0000000000000034:head v 26'11, mlcod=26'9)", 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 74.815365967999995, 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003895697, 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822437+0000", 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822434+0000", 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822455+0000", 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1229999999999998e-05 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822497+0000", 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1689e-05 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822518+0000", 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.12e-05 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822646+0000", 2024-09-18T05:15:06.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012778900000000001 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.822695+0000", 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9719999999999998e-05 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826219+0000", 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003523549 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.826332+0000", 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011343 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16288 3.4 e32/22 3:23ae9222:::rbd_data.118b8ff5784d.000000000000001f:head v 32'51, mlcod=32'49)", 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 65.821728225000001, 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034272999999999999, 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816074+0000", 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816072+0000", 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:06.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816095+0000", 2024-09-18T05:15:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.279e-05 2024-09-18T05:15:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816139+0000", 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3936000000000001e-05 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816159+0000", 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0596999999999999e-05 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816286+0000", 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012644899999999999 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.816365+0000", 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9408999999999998e-05 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819409+0000", 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030436500000000002 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.819502+0000", 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2942999999999994e-05 2024-09-18T05:15:06.650 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16292 3.0 e32/22 3:06a93bb7:::rbd_data.118b8ff5784d.0000000000000023:head v 32'87, mlcod=32'85)", 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 65.819111427999999, 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002364905, 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818691+0000", 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818689+0000", 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:06.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818712+0000", 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2209999999999999e-05 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818749+0000", 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7719000000000003e-05 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818768+0000", 2024-09-18T05:15:06.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8284e-05 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818887+0000", 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119515 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.818944+0000", 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6634e-05 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.820969+0000", 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020253910000000001 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.821056+0000", 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7106000000000003e-05 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:16345 3.9 e32/22 3:97ec87eb:::rbd_data.118b8ff5784d.0000000000000019:head v 32'55, mlcod=31'52)", 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:15:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 65.736575916000007, 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002453415, 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901227+0000", 2024-09-18T05:15:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901224+0000", 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901334+0000", 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011003899999999999 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901368+0000", 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3033e-05 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901383+0000", 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5970000000000001e-05 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901509+0000", 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125809 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.901577+0000", 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7725999999999995e-05 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903608+0000", 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020310910000000001 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:00.903680+0000", 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2080000000000001e-05 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:17195 3.0 e33/22 3:0157aed1:::rbd_data.118b8ff5784d.0000000000000002:head v 33'88, mlcod=32'86)", 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 65.362038222999999, 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005869684, 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:15:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275764+0000", 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.275763+0000", 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277297+0000", 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015346400000000001 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277359+0000", 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1724999999999996e-05 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277371+0000", 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1858999999999999e-05 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277488+0000", 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011712 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.277528+0000", 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9954999999999999e-05 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281565+0000", 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040373120000000004 2024-09-18T05:15:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:01.281634+0000", 2024-09-18T05:15:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8831999999999994e-05 2024-09-18T05:15:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:26938 3.0 e39/22 3:048b3b42:::rbd_data.118b9f2c0487.0000000000000061:head v 39'118, mlcod=39'116)", 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.671109041000001, 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024687099999999998, 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966694+0000", 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966692+0000", 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966752+0000", 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9973000000000003e-05 2024-09-18T05:15:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966784+0000", 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2116000000000002e-05 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966797+0000", 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.966936+0000", 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013843800000000001 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.967001+0000", 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5627e-05 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969068+0000", 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020663399999999998 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:10.969162+0000", 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4692999999999996e-05 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47581 3.4 e52/22 3:24a94b22:::rbd_data.118ba98b16f7.0000000000000011:head v 52'130, mlcod=52'128)", 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.973136482000001, 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033849169999999999, 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664666+0000", 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664664+0000", 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664684+0000", 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0044e-05 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664730+0000", 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6097000000000003e-05 2024-09-18T05:15:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664751+0000", 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1024000000000001e-05 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664942+0000", 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190538 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.664998+0000", 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6786999999999997e-05 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.667951+0000", 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029529040000000001 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668051+0000", 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9866999999999998e-05 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:47585 3.4 e52/22 3:277480c1:::rbd_data.118ba98b16f7.0000000000000015:head v 52'131, mlcod=52'128)", 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.972391254999998, 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027129139999999999, 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:15:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665411+0000", 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665410+0000", 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665425+0000", 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.499e-05 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665451+0000", 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5936999999999999e-05 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665468+0000", 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7430000000000001e-05 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665537+0000", 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8703999999999998e-05 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.665585+0000", 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8060999999999999e-05 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668061+0000", 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024756779999999998 2024-09-18T05:15:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:29.668124+0000", 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3676999999999994e-05 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50861 3.9 e57/22 3:937da5aa:::rbd_data.118bea12bf49.0000000000000015:head v 57'133, mlcod=56'130)", 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:15:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.340067001999998, 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033859879999999999, 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297736+0000", 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297735+0000", 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297748+0000", 2024-09-18T05:15:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3464e-05 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297799+0000", 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0232999999999998e-05 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.297821+0000", 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2334e-05 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298165+0000", 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034369199999999999 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.298223+0000", 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8457e-05 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301032+0000", 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028085050000000002 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.301122+0000", 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0112999999999996e-05 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50880 3.0 e57/22 3:045763ee:::rbd_data.118bea12bf49.0000000000000073:head v 57'214, mlcod=57'211)", 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.328873614999999, 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003490136, 2024-09-18T05:15:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308929+0000", 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308926+0000", 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.308950+0000", 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3453000000000001e-05 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309001+0000", 2024-09-18T05:15:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0736999999999999e-05 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309022+0000", 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1437000000000002e-05 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309166+0000", 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014386100000000001 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.309242+0000", 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6459999999999996e-05 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312298+0000", 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030560700000000001 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312419+0000", 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120874 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50883 3.4 e57/22 3:227c9179:::rbd_data.118bea12bf49.00000000000000cb:head v 57'152, mlcod=56'149)", 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.325532873, 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026019060000000002, 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312270+0000", 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312268+0000", 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312286+0000", 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7756000000000001e-05 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312325+0000", 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9029999999999997e-05 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312361+0000", 2024-09-18T05:15:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6303999999999997e-05 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312471+0000", 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010963099999999999 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.312527+0000", 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6227000000000002e-05 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314758+0000", 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022307469999999999 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.314872+0000", 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011420400000000001 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50934 3.4 e57/22 3:255d0e8e:::rbd_data.118bea12bf49.0000000000000001:head v 57'154, mlcod=56'150)", 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.306985273999999, 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028140449999999998, 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330817+0000", 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330815+0000", 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330831+0000", 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5756e-05 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330862+0000", 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1180999999999998e-05 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.330882+0000", 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0457000000000001e-05 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331013+0000", 2024-09-18T05:15:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013070399999999999 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.331082+0000", 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9369999999999995e-05 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333550+0000", 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024677420000000002 2024-09-18T05:15:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333631+0000", 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1230999999999995e-05 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:50936 3.9 e57/22 3:907835c8:::rbd_data.118bea12bf49.0000000000000003:head v 57'135, mlcod=56'131)", 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.303976214999999, 2024-09-18T05:15:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024933360000000001, 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333826+0000", 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333824+0000", 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333844+0000", 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9562999999999999e-05 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333873+0000", 2024-09-18T05:15:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9487000000000001e-05 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.333891+0000", 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7787000000000001e-05 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334003+0000", 2024-09-18T05:15:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011215 2024-09-18T05:15:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.334057+0000", 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3857999999999998e-05 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336229+0000", 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021715229999999999 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:34.336320+0000", 2024-09-18T05:15:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1124000000000004e-05 2024-09-18T05:15:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:66941 3.0 e72/22 3:07b7f500:::rbd_data.118b17097827.0000000000000000:head v 72'269, mlcod=69'267)", 2024-09-18T05:15:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:15:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.302912156, 2024-09-18T05:15:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061242639999999999, 2024-09-18T05:15:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334891+0000", 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.334889+0000", 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336629+0000", 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017390940000000001 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336658+0000", 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9649999999999999e-05 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336672+0000", 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3896999999999999e-05 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336737+0000", 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4466000000000002e-05 2024-09-18T05:15:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.336766+0000", 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8968000000000001e-05 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.340973+0000", 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042071629999999999 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341015+0000", 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2113999999999997e-05 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:66942 3.0 e72/22 3:07b7f500:::rbd_data.118b17097827.0000000000000000:head v 72'271, mlcod=69'267)", 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.299080483999999, 2024-09-18T05:15:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029717519999999998, 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338722+0000", 2024-09-18T05:15:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338721+0000", 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338732+0000", 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1231e-05 2024-09-18T05:15:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338747+0000", 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5262999999999999e-05 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338757+0000", 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5060000000000001e-06 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338863+0000", 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106136 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.338888+0000", 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4706999999999999e-05 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341659+0000", 2024-09-18T05:15:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027712639999999998 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.341694+0000", 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5123000000000002e-05 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:70720 3.4 e72/22 3:265cd162:::rbd_data.118beb272ca1.0000000000000008:head v 72'168, mlcod=72'166)", 2024-09-18T05:15:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.852870711, 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0073855960000000003, 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784932+0000", 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784930+0000", 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784944+0000", 2024-09-18T05:15:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4226000000000001e-05 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784968+0000", 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3777999999999998e-05 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.784980+0000", 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1296e-05 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.785034+0000", 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4289000000000001e-05 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.785059+0000", 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5375999999999999e-05 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.792252+0000", 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071932289999999998 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.792318+0000", 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5124999999999997e-05 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:70721 3.0 e72/22 3:011c2880:::rbd_data.118beb272ca1.0000000000000009:head v 72'276, mlcod=72'274)", 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.846107798, 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078875809999999994, 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791695+0000", 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.791693+0000", 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794951+0000", 2024-09-18T05:15:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003257402 2024-09-18T05:15:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794977+0000", 2024-09-18T05:15:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6078999999999999e-05 2024-09-18T05:15:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.794994+0000", 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6585000000000001e-05 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.795054+0000", 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0538999999999998e-05 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.795083+0000", 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8972e-05 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.799462+0000", 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043787540000000003 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:52.799582+0000", 2024-09-18T05:15:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120661 2024-09-18T05:15:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:76487 3.9 e77/22 3:92ea6217:::rbd_data.118bd6fb3c7.000000000000001f:head v 77'177, mlcod=76'175)", 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:58.888523+0000", 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.7492800060000002, 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005330006, 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.888523+0000", 2024-09-18T05:15:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.888523+0000", 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.888522+0000", 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890185+0000", 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016627949999999999 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890216+0000", 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1149999999999998e-05 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890231+0000", 2024-09-18T05:15:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5474000000000001e-05 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890319+0000", 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7600000000000002e-05 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.890364+0000", 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.456e-05 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.893773+0000", 2024-09-18T05:15:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034090600000000002 2024-09-18T05:15:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:58.893853+0000", 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0123000000000005e-05 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:76558 3.4 e77/22 3:2688020f:::rbd_data.118bd6fb3c7.000000000000004a:head v 77'218, mlcod=75'216)", 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.018894+0000", 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.6189090930000001, 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025181159999999999, 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018894+0000", 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018894+0000", 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018891+0000", 2024-09-18T05:15:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018928+0000", 2024-09-18T05:15:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6683000000000001e-05 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018966+0000", 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7759999999999998e-05 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.018981+0000", 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5123000000000001e-05 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.019093+0000", 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011257 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.019138+0000", 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5009999999999998e-05 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.021349+0000", 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022109289999999999 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.021412+0000", 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2377000000000003e-05 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:76564 3.9 e77/22 3:9735bd83:::rbd_data.118bd6fb3c7.0000000000000050:head v 77'180, mlcod=77'178)", 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.051981+0000", 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5858221429999997, 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027799980000000001, 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.051981+0000", 2024-09-18T05:15:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.051981+0000", 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.051979+0000", 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052027+0000", 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8050000000000002e-05 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052070+0000", 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3446999999999999e-05 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052089+0000", 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.827e-05 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052593+0000", 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050478600000000002 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.052684+0000", 2024-09-18T05:15:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0543000000000004e-05 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.054686+0000", 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020015850000000002 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.054761+0000", 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4950000000000006e-05 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:06.742 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:06.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:06.745 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:06.738+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:06.845 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:06.840+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:06.915 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:06.915 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:06.917 INFO:teuthology.orchestra.run.smithi017.stdout:4486 punch from 0x5241dfc to 0x524f3ea, (0xd5ee bytes) 2024-09-18T05:15:06.925 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:06.926 INFO:teuthology.orchestra.run.smithi017.stdout:4489 punch from 0xea9f7b to 0xead836, (0x38bb bytes) 2024-09-18T05:15:06.926 INFO:teuthology.orchestra.run.smithi017.stdout:4490 read 0x2ea602c thru 0x2eb2397 (0xc36c bytes) 2024-09-18T05:15:06.926 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:06.926 INFO:teuthology.orchestra.run.smithi017.stdout:4492 write 0x2b092cd thru 0x2b16f04 (0xdc38 bytes) 2024-09-18T05:15:06.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:06.944 INFO:teuthology.orchestra.run.smithi017.stdout:4493 trunc from 0x6aaec4e to 0xe2dc94b 2024-09-18T05:15:06.945 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:06.940+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:06.956 INFO:teuthology.orchestra.run.smithi017.stdout:4494 punch from 0xc7df019 to 0xc7e4361, (0x5348 bytes) 2024-09-18T05:15:06.956 INFO:teuthology.orchestra.run.smithi017.stdout:4496 write 0x1ad13e6 thru 0x1ad8871 (0x748c bytes) 2024-09-18T05:15:06.966 INFO:teuthology.orchestra.run.smithi017.stdout:4497 read 0x2d7583d thru 0x2d7df5f (0x8723 bytes) 2024-09-18T05:15:06.966 INFO:teuthology.orchestra.run.smithi017.stdout:4499 write 0xb6a8cb2 thru 0xb6ac3ac (0x36fb bytes) 2024-09-18T05:15:06.972 INFO:teuthology.orchestra.run.smithi017.stdout:4500 write 0x7fe386f thru 0x7feaf49 (0x76db bytes) 2024-09-18T05:15:06.984 INFO:teuthology.orchestra.run.smithi017.stdout:4502 trunc from 0xe2dc94b to 0xb682b1c 2024-09-18T05:15:07.012 INFO:teuthology.orchestra.run.smithi017.stdout:4503 writesame 0xe332713 thru 0xe341d75 data_size 0x1d(0xf663 bytes) 2024-09-18T05:15:07.012 INFO:teuthology.orchestra.run.smithi017.stdout:4504 read 0x93e2876 thru 0x93ef9af (0xd13a bytes) 2024-09-18T05:15:07.012 INFO:teuthology.orchestra.run.smithi017.stdout:4505 punch from 0x1d7819b to 0x1d82c5f, (0xaac4 bytes) 2024-09-18T05:15:07.012 INFO:teuthology.orchestra.run.smithi017.stdout:4506 trunc from 0xe341d76 to 0xddec84e 2024-09-18T05:15:07.024 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:07.024 INFO:teuthology.orchestra.run.smithi017.stdout:4509 punch from 0x518bc98 to 0x5191065, (0x53cd bytes) 2024-09-18T05:15:07.035 INFO:teuthology.orchestra.run.smithi017.stdout:4510 write 0xe0e942a thru 0xe0e9769 (0x340 bytes) 2024-09-18T05:15:07.042 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:07.042 INFO:teuthology.orchestra.run.smithi017.stdout:4512 read 0x2a6ba0f thru 0x2a73081 (0x7673 bytes) 2024-09-18T05:15:07.043 INFO:teuthology.orchestra.run.smithi017.stdout:4513 write 0x2cc49d8 thru 0x2ccb944 (0x6f6d bytes) 2024-09-18T05:15:07.046 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:07.042+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:07.050 INFO:teuthology.orchestra.run.smithi017.stdout:4515 read 0x9d0ee35 thru 0x9d1be3a (0xd006 bytes) 2024-09-18T05:15:07.050 INFO:teuthology.orchestra.run.smithi017.stdout:4516 punch from 0x4cd559a to 0x4cd76d3, (0x2139 bytes) 2024-09-18T05:15:07.060 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:07.060 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:07.061 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:07.061 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:07.061 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:07.063 INFO:teuthology.orchestra.run.smithi017.stdout:4518 write 0xe8efcef thru 0xe8f63db (0x66ed bytes) 2024-09-18T05:15:07.070 INFO:teuthology.orchestra.run.smithi017.stdout:4520 writesame 0x2f76fc1 thru 0x2f7eeb1 data_size 0x1(0x7ef1 bytes) 2024-09-18T05:15:07.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:07.094 INFO:teuthology.orchestra.run.smithi017.stdout:4523 writesame 0x8d70c7e thru 0x8d76363 data_size 0x7(0x56e6 bytes) 2024-09-18T05:15:07.102 INFO:teuthology.orchestra.run.smithi017.stdout:4524 punch from 0x1f509a8 to 0x1f5e919, (0xdf71 bytes) 2024-09-18T05:15:07.102 INFO:teuthology.orchestra.run.smithi017.stdout:4527 read 0x5d5d0b4 thru 0x5d6477c (0x76c9 bytes) 2024-09-18T05:15:07.103 INFO:teuthology.orchestra.run.smithi017.stdout:4528 write 0x33116bc thru 0x3313ef2 (0x2837 bytes) 2024-09-18T05:15:07.110 INFO:teuthology.orchestra.run.smithi017.stdout:4529 read 0x1f39b41 thru 0x1f3b08c (0x154c bytes) 2024-09-18T05:15:07.111 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:07.111 INFO:teuthology.orchestra.run.smithi017.stdout:4531 read 0x3377c16 thru 0x3380524 (0x890f bytes) 2024-09-18T05:15:07.112 INFO:teuthology.orchestra.run.smithi017.stdout:4532 writesame 0x3d79e1f thru 0x3d84961 data_size 0x1(0xab43 bytes) 2024-09-18T05:15:07.147 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:07.142+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:07.168 INFO:teuthology.orchestra.run.smithi017.stdout:4533 write 0x681bd0 thru 0x688c05 (0x7036 bytes) 2024-09-18T05:15:07.178 INFO:teuthology.orchestra.run.smithi017.stdout:4534 punch from 0xb2f3c2e to 0xb302b1d, (0xeeef bytes) 2024-09-18T05:15:07.179 INFO:teuthology.orchestra.run.smithi017.stdout:4535 punch from 0x7041251 to 0x70450f1, (0x3ea0 bytes) 2024-09-18T05:15:07.179 INFO:teuthology.orchestra.run.smithi017.stdout:4536 write 0x1a85021 thru 0x1a9180c (0xc7ec bytes) 2024-09-18T05:15:07.190 INFO:teuthology.orchestra.run.smithi017.stdout:4537 write 0x23b383e thru 0x23bd15b (0x991e bytes) 2024-09-18T05:15:07.213 INFO:teuthology.orchestra.run.smithi017.stdout:4538 trunc from 0xe8f63dc to 0x7c4ec31 2024-09-18T05:15:07.216 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:07.216 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.301668675000002, 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:15:07.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.222 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.301637732000003, 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.226 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.301612168000005, 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:15:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.231 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.301587452000007, 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.235 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.301561218000003, 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:15:07.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.301532308999995, 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.240 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.301508479000006, 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:07.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.248 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.301484002999999, 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:15:07.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:15:07.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:15:07.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:15:07.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.254 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.301366204000004, 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:07.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.258 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.298374249000005, 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.259 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:15:07.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:07.263 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.298296187000005, 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:15:07.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.298264900000007, 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.269 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:15:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.298238886999997, 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:15:07.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.298211113999997, 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:15:07.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.298186051000002, 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:15:07.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.286 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.298161020999999, 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:15:07.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.294036692999995, 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:15:07.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.294016147999997, 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.293996465999996, 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:15:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.025925018999999, 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:15:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:15:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:15:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:15:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:07.312 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:07.313 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:07.314 INFO:teuthology.orchestra.run.smithi017.stdout:4542 punch from 0x50de4d5 to 0x50e2da6, (0x48d1 bytes) 2024-09-18T05:15:07.314 INFO:teuthology.orchestra.run.smithi017.stdout:4543 write 0xdfe146b thru 0xdfe7647 (0x61dd bytes) 2024-09-18T05:15:07.314 INFO:teuthology.orchestra.run.smithi017.stdout:4546 writesame 0x44f951f thru 0x4509324 data_size 0x23(0xfe06 bytes) 2024-09-18T05:15:07.314 INFO:teuthology.orchestra.run.smithi017.stdout:4549 write 0xe9eaa06 thru 0xe9f9db4 (0xf3af bytes) 2024-09-18T05:15:07.314 INFO:teuthology.orchestra.run.smithi017.stdout:4550 read 0x59b6f89 thru 0x59be038 (0x70b0 bytes) 2024-09-18T05:15:07.315 INFO:teuthology.orchestra.run.smithi017.stdout:4551 write 0x3fe99a4 thru 0x3fec8dd (0x2f3a bytes) 2024-09-18T05:15:07.315 INFO:teuthology.orchestra.run.smithi017.stdout:4552 writesame 0x9d278b5 thru 0x9d28bd3 data_size 0x5(0x131f bytes) 2024-09-18T05:15:07.315 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:07.306+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:07.318 INFO:teuthology.orchestra.run.smithi017.stdout:4553 read 0x6b16db4 thru 0x6b16ff5 (0x242 bytes) 2024-09-18T05:15:07.319 INFO:teuthology.orchestra.run.smithi017.stdout:4554 writesame 0xb70b8 thru 0xc5908 data_size 0x1(0xe851 bytes) 2024-09-18T05:15:07.353 INFO:teuthology.orchestra.run.smithi017.stdout:4555 writesame 0xa039028 thru 0xa03f8b6 data_size 0x1d(0x688f bytes) 2024-09-18T05:15:07.359 INFO:teuthology.orchestra.run.smithi017.stdout:4558 write 0x42a74f7 thru 0x42aeec1 (0x79cb bytes) 2024-09-18T05:15:07.365 INFO:teuthology.orchestra.run.smithi017.stdout:4560 write 0xd5ea7b3 thru 0xd5fa5a0 (0xfdee bytes) 2024-09-18T05:15:07.371 INFO:teuthology.orchestra.run.smithi017.stdout:4561 punch from 0x730cb2 to 0x73a484, (0x97d2 bytes) 2024-09-18T05:15:07.378 INFO:teuthology.orchestra.run.smithi017.stdout:4562 trunc from 0xe9f9db5 to 0xb58310c 2024-09-18T05:15:07.398 INFO:teuthology.orchestra.run.smithi017.stdout:4565 write 0x7fe2acb thru 0x7fe4454 (0x198a bytes) 2024-09-18T05:15:07.400 INFO:teuthology.orchestra.run.smithi017.stdout:4566 read 0x9ef849 thru 0x9f6822 (0x6fda bytes) 2024-09-18T05:15:07.401 INFO:teuthology.orchestra.run.smithi017.stdout:4567 read 0x9c24774 thru 0x9c277c6 (0x3053 bytes) 2024-09-18T05:15:07.401 INFO:teuthology.orchestra.run.smithi017.stdout:4568 read 0x5a2fc16 thru 0x5a3eb32 (0xef1d bytes) 2024-09-18T05:15:07.401 INFO:teuthology.orchestra.run.smithi017.stdout:4569 read 0x1ea30ec thru 0x1eb1f2a (0xee3f bytes) 2024-09-18T05:15:07.402 INFO:teuthology.orchestra.run.smithi017.stdout:4570 writesame 0x491fca0 thru 0x4926527 data_size 0x3c(0x6888 bytes) 2024-09-18T05:15:07.406 INFO:teuthology.orchestra.run.smithi017.stdout:4571 read 0x602693f thru 0x602b519 (0x4bdb bytes) 2024-09-18T05:15:07.407 INFO:teuthology.orchestra.run.smithi017.stdout:4572 read 0x783e2a1 thru 0x7844fb4 (0x6d14 bytes) 2024-09-18T05:15:07.407 INFO:teuthology.orchestra.run.smithi017.stdout:4573 write 0xac50c40 thru 0xac5225e (0x161f bytes) 2024-09-18T05:15:07.413 INFO:teuthology.orchestra.run.smithi017.stdout:4574 write 0x8528f6d thru 0x85376e9 (0xe77d bytes) 2024-09-18T05:15:07.413 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:07.408+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:07.417 INFO:teuthology.orchestra.run.smithi017.stdout:4575 write 0xbc6d9e thru 0xbd17cd (0xaa30 bytes) 2024-09-18T05:15:07.427 INFO:teuthology.orchestra.run.smithi017.stdout:4579 punch from 0x68f6a17 to 0x6900272, (0x985b bytes) 2024-09-18T05:15:07.427 INFO:teuthology.orchestra.run.smithi017.stdout:4580 flatten 2024-09-18T05:15:07.466 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.466 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100305 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.463215+0000", 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.001070496, 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010979570000000001, 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100305 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463215+0000", 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463215+0000", 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463214+0000", 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463218+0000", 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.704e-06 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463227+0000", 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3929999999999997e-06 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463234+0000", 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1520000000000003e-06 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464301+0000", 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001066771 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100310 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.463849+0000", 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00043610099999999999, 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00054222999999999999, 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100310 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463849+0000", 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463849+0000", 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463848+0000", 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463858+0000", 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0413e-05 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463885+0000", 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7402e-05 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463900+0000", 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4941e-05 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100311 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.473 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.463914+0000", 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00037123199999999999, 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00053636500000000002, 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100311 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463914+0000", 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463914+0000", 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463913+0000", 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463919+0000", 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0419999999999999e-06 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463930+0000", 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1035e-05 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463940+0000", 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9040000000000004e-06 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.476 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100312 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.463965+0000", 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00032063399999999998, 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057050700000000005, 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100312 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463965+0000", 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463965+0000", 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463964+0000", 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463969+0000", 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0989999999999998e-06 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463983+0000", 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4154999999999999e-05 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.463992+0000", 2024-09-18T05:15:07.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6520000000000001e-06 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100315 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.464114+0000", 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00017185099999999999, 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050876100000000004, 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.480 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100315 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464114+0000", 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464114+0000", 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464112+0000", 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464119+0000", 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2259999999999999e-06 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464138+0000", 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8672999999999999e-05 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464150+0000", 2024-09-18T05:15:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1969e-05 2024-09-18T05:15:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.483 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100316 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.464160+0000", 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00012499399999999999, 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00054555700000000001, 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100316 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464160+0000", 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464160+0000", 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464160+0000", 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464164+0000", 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9760000000000003e-06 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464178+0000", 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3113e-05 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464188+0000", 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9320000000000008e-06 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.486 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100317 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.464196+0000", 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9015000000000001e-05, 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061862400000000002, 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100317 2024-09-18T05:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464196+0000", 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464196+0000", 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464196+0000", 2024-09-18T05:15:07.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464200+0000", 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2930000000000002e-06 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464213+0000", 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3179e-05 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464223+0000", 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5759999999999995e-06 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100320 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.464412+0000", 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4294967295.9998732, 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048853500000000001, 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:15:07.490 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100320 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464412+0000", 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464412+0000", 2024-09-18T05:15:07.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464411+0000", 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464417+0000", 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7969999999999997e-06 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464435+0000", 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7711e-05 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464448+0000", 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3196999999999999e-05 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100321 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.464459+0000", 2024-09-18T05:15:07.493 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4294967295.9998264, 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000522406, 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100321 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464459+0000", 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464459+0000", 2024-09-18T05:15:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464458+0000", 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464463+0000", 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7670000000000003e-06 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464477+0000", 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4455e-05 2024-09-18T05:15:07.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464489+0000", 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1345999999999999e-05 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:100322 3.1a 3.be06d01a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.464498+0000", 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4294967295.9997873, 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00053914999999999996, 2024-09-18T05:15:07.497 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "queued for pg", 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100322 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464498+0000", 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464498+0000", 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464497+0000", 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464502+0000", 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2639999999999999e-06 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464523+0000", 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.084e-05 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.464534+0000", 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0421999999999999e-05 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 10 2024-09-18T05:15:07.500 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:07.501 INFO:teuthology.orchestra.run.smithi017.stdout:4581 write 0x954ca7c thru 0x955baff (0xf084 bytes) 2024-09-18T05:15:07.501 INFO:teuthology.orchestra.run.smithi017.stdout:4583 write 0xa10a854 thru 0xa10d9d6 (0x3183 bytes) 2024-09-18T05:15:07.502 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:07.503 INFO:teuthology.orchestra.run.smithi017.stdout:4584 punch from 0x7f99585 to 0x7f9fb01, (0x657c bytes) 2024-09-18T05:15:07.519 INFO:teuthology.orchestra.run.smithi017.stdout:4585 trunc from 0xb58310c to 0x4b83f12 2024-09-18T05:15:07.539 INFO:teuthology.orchestra.run.smithi017.stdout:4586 punch from 0x40c5eba to 0x40c70e1, (0x1227 bytes) 2024-09-18T05:15:07.544 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:07.540+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:07.571 INFO:teuthology.orchestra.run.smithi017.stdout:4591 writesame 0xcbc4eae thru 0xcbd1d08 data_size 0x1(0xce5b bytes) 2024-09-18T05:15:07.587 INFO:teuthology.orchestra.run.smithi017.stdout:4592 write 0xeb35410 thru 0xeb3908a (0x3c7b bytes) 2024-09-18T05:15:07.592 INFO:teuthology.orchestra.run.smithi017.stdout:4593 read 0xe806ca3 thru 0xe80d635 (0x6993 bytes) 2024-09-18T05:15:07.592 INFO:teuthology.orchestra.run.smithi017.stdout:4594 punch from 0xa05626e to 0xa05c033, (0x5dc5 bytes) 2024-09-18T05:15:07.592 INFO:teuthology.orchestra.run.smithi017.stdout:4595 write 0x4a261b0 thru 0x4a2e7a0 (0x85f1 bytes) 2024-09-18T05:15:07.599 INFO:teuthology.orchestra.run.smithi017.stdout:4596 read 0x89b3747 thru 0x89bf8a6 (0xc160 bytes) 2024-09-18T05:15:07.599 INFO:teuthology.orchestra.run.smithi017.stdout:4597 write 0xe40988c thru 0xe40a771 (0xee6 bytes) 2024-09-18T05:15:07.604 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:07.604 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:07.604 INFO:teuthology.orchestra.run.smithi017.stdout:4600 writesame 0xee9e15 thru 0xef5790 data_size 0x12(0xb97c bytes) 2024-09-18T05:15:07.612 INFO:teuthology.orchestra.run.smithi017.stdout:4601 write 0x61fd500 thru 0x62013d5 (0x3ed6 bytes) 2024-09-18T05:15:07.616 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:07.610+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:07.620 INFO:teuthology.orchestra.run.smithi017.stdout:4602 write 0x9b1ef6b thru 0x9b205a3 (0x1639 bytes) 2024-09-18T05:15:07.626 INFO:teuthology.orchestra.run.smithi017.stdout:4603 write 0x6356246 thru 0x635c16f (0x5f2a bytes) 2024-09-18T05:15:07.633 INFO:teuthology.orchestra.run.smithi017.stdout:4604 writesame 0x6d983d9 thru 0x6d9f61a data_size 0x75(0x7242 bytes) 2024-09-18T05:15:07.638 INFO:teuthology.orchestra.run.smithi017.stdout:4605 read 0x8931f2f thru 0x893e4db (0xc5ad bytes) 2024-09-18T05:15:07.638 INFO:teuthology.orchestra.run.smithi017.stdout:4606 write 0x7f92f86 thru 0x7f9a54d (0x75c8 bytes) 2024-09-18T05:15:07.644 INFO:teuthology.orchestra.run.smithi017.stdout:4607 clone 36 order 22 su 524288 sc 3 2024-09-18T05:15:07.668 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:07.669 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:07.669 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:07.670 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:07.670 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:07.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:07.713 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-18T05:15:07.713 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:15:07.713 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-18T05:15:07.714 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T05:15:07.714 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T05:15:07.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-18T05:15:07.732 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:07.728+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:07.809 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:07.809 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:07.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:07.809 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:07.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.809 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.809 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0575296030000008, 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:07.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:15:07.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0575206129999994, 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.818 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.057511646, 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:15:07.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:15:07.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.823 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.823 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0575028629999998, 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:15:07.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.828 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0574940870000002, 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:15:07.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.833 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0574837949999996, 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:15:07.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:15:07.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0574699079999998, 2024-09-18T05:15:07.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:15:07.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0574607020000002, 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:15:07.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0574520039999999, 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:15:07.847 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.851 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.852 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:07.852 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0574429389999995, 2024-09-18T05:15:07.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:15:07.852 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.852 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.852 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0574195809999996, 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:15:07.856 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:15:07.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0574099159999992, 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:15:07.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.865 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0573835589999998, 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:07.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:15:07.870 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0573700269999993, 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.871 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:15:07.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.872 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:07.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:15:07.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:15:07.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0573585760000004, 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.876 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.880 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0573490949999993, 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:15:07.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.057339013, 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.885 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:07.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:15:07.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0573299249999994, 2024-09-18T05:15:07.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:15:07.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0573203679999992, 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:15:07.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:15:07.898 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.898 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.898 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.898 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:07.898 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:07.898 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.0573115469999994, 2024-09-18T05:15:07.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:15:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:15:07.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:07.903 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:07.903 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:07.904 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T05:15:07.905 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:07.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:07.905 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:07.898+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:08.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:08.002+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:08.076 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:08.077 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:08.077 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:08.077 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:08.090 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:08.106 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:08.102+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:08.207 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:08.202+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:08.214 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:08.214 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:08.214 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:08.214 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:08.214 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:08.228 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:08.310 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:15:08.311 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:08.304+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:08.358 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:08.358 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:08.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.694053275000002, 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.359 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:08.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:08.363 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693986357, 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:08.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:08.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693897847000002, 2024-09-18T05:15:08.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.372 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693847290999997, 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:08.376 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693784176000001, 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.377 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:08.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693737255999999, 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.381 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693683376999999, 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:08.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693636243999997, 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:08.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:08.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693588622, 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:08.394 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.398 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693465801000002, 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.399 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:08.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:08.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:08.403 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.403 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.403 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693384471000002, 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.404 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:08.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693313228000001, 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.408 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:08.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:08.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:08.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:08.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:08.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:08.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:08.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:08.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:08.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:08.416 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.416 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.416 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.416 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.416 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:08.416 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693263017, 2024-09-18T05:15:08.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:08.417 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.417 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.417 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.417 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.417 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.417 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:08.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.417 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:08.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:08.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:08.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:08.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:08.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:08.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:08.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:08.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:08.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:08.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:08.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:08.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.422 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.423 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.423 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:08.423 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693185823, 2024-09-18T05:15:08.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:08.423 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.423 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.423 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:08.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:08.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:08.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:08.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:08.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:08.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:08.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:08.429 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.429 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.429 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.429 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.430 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:08.430 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693135953000002, 2024-09-18T05:15:08.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:08.430 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.430 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.430 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.430 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.430 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.430 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:08.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.431 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:08.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:08.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:08.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:08.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:08.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:08.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:08.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:08.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:08.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:08.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:08.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:08.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.436 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.436 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.436 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:08.436 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.693061382000003, 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:08.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:08.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:08.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:08.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:08.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:08.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.442 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.692995604000004, 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:08.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:08.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:08.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:08.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:08.448 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.692948567999998, 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:08.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.453 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.692886475000002, 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:08.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:08.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:08.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.692840095999998, 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:08.459 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:08.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:08.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.464 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:08.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:08.467 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:08.460+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:08.566 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:08.562+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:08.643 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:08.644 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:08.646 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-18T05:15:08.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:08.704 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:08.700+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:08.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:08.780 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:08.780 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:08.780 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:08.780 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:08.780 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:08.794 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:08.795 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:08.790+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:08.872 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:08.866+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:08.881 INFO:teuthology.orchestra.run.smithi017.stdout:4608 punch from 0xd6f8a22 to 0xd701945, (0x8f23 bytes) 2024-09-18T05:15:08.886 INFO:teuthology.orchestra.run.smithi017.stdout:4609 read 0xd14caea thru 0xd14ebbc (0x20d3 bytes) 2024-09-18T05:15:08.886 INFO:teuthology.orchestra.run.smithi017.stdout:4610 read 0x2a72b94 thru 0x2a80e14 (0xe281 bytes) 2024-09-18T05:15:08.886 INFO:teuthology.orchestra.run.smithi017.stdout:4612 read 0xb130d7c thru 0xb13fc42 (0xeec7 bytes) 2024-09-18T05:15:08.901 INFO:teuthology.orchestra.run.smithi017.stdout:4613 trunc from 0xeb3908b to 0x45957bc 2024-09-18T05:15:08.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:08.903 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:08.917 INFO:teuthology.orchestra.run.smithi017.stdout:4614 clone 37 order 23 su 262144 sc 10 2024-09-18T05:15:08.922 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:08.940 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:08.940 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:08.957 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:27144 3.e 3:72e631ab:::rbd_data.118b9f2c0487.000000000000003c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.499741864000001, 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053442387000000001, 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.966 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 27144 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462530+0000", 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999957 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462560+0000", 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9933e-05 2024-09-18T05:15:08.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462596+0000", 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5936000000000003e-05 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462621+0000", 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4644e-05 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462748+0000", 2024-09-18T05:15:08.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126892 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.463025+0000", 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027756100000000001 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.471585+0000", 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085600780000000005 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:08.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515712+0000", 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.044127 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515824+0000", 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112002 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515915+0000", 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0105999999999994e-05 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515977+0000", 2024-09-18T05:15:08.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2521999999999995e-05 2024-09-18T05:15:08.972 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.972 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.972 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.972 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36312 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.973 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:08.973 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.153716287999998, 2024-09-18T05:15:08.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050924795000000002, 2024-09-18T05:15:08.973 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.973 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:08.973 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.973 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.973 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36312 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808562+0000", 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.522e-06 2024-09-18T05:15:08.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808566+0000", 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0459999999999999e-06 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808569+0000", 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1580000000000001e-06 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859475+0000", 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050906734000000002 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859485+0000", 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6029999999999994e-06 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.978 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36313 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.978 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:08.978 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.153705129000002, 2024-09-18T05:15:08.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050958802999999997, 2024-09-18T05:15:08.978 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.978 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:08.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36313 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:08.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808573+0000", 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4720000000000001e-06 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808577+0000", 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9899999999999999e-06 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808581+0000", 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.301e-06 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859521+0000", 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939971000000001 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859530+0000", 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3309999999999993e-06 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36314 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.153692947000003, 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050974481000000002, 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.982 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36314 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808583+0000", 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808585+0000", 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839999999999999e-06 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808589+0000", 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0149999999999997e-06 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808592+0000", 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2100000000000002e-06 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859552+0000", 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050959971999999999 2024-09-18T05:15:08.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859558+0000", 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0809999999999999e-06 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37032 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 366592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015176615999998, 2024-09-18T05:15:08.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050948475, 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37032 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947099+0000", 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947102+0000", 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3140000000000002e-06 2024-09-18T05:15:08.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947107+0000", 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947112+0000", 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6500000000000004e-06 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997959+0000", 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050847106000000003 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997999+0000", 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0049000000000002e-05 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998048+0000", 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9211e-05 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37033 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 376832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015149827999998, 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051119236999999998, 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37033 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947126+0000", 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:08.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947129+0000", 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5469999999999999e-06 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947135+0000", 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5069999999999997e-06 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947140+0000", 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7350000000000004e-06 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998080+0000", 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939401000000002 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998158+0000", 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8753999999999998e-05 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998246+0000", 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7682999999999994e-05 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37034 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 387072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015132606000002, 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05121883, 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:08.995 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37034 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:08.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947146+0000", 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.12e-06 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:08.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947152+0000", 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8560000000000003e-06 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947156+0000", 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5970000000000002e-06 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998271+0000", 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051114764 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:08.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998312+0000", 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1258999999999999e-05 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998363+0000", 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0581999999999998e-05 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37035 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:08.999 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015116235999997, 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051399043999999998, 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37035 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947162+0000", 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1619999999999998e-06 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947168+0000", 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7640000000000002e-06 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947172+0000", 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4750000000000004e-06 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998394+0000", 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051222202000000001 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998472+0000", 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7228e-05 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998559+0000", 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7699000000000002e-05 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37036 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 407552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015100668999999, 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051565297000000003, 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37036 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947178+0000", 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0169999999999999e-06 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947183+0000", 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:15:09.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947188+0000", 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998583+0000", 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051394678999999999 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998661+0000", 2024-09-18T05:15:09.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8631e-05 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998741+0000", 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0054000000000003e-05 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37037 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 417792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015084471999998, 2024-09-18T05:15:09.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051746031999999997, 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37037 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947194+0000", 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1100000000000001e-06 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947200+0000", 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2530000000000001e-06 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947205+0000", 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8319999999999996e-06 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998775+0000", 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051569934999999997 2024-09-18T05:15:09.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998850+0000", 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4783999999999994e-05 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998938+0000", 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8442999999999993e-05 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37038 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015066908000001, 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851468999999997, 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37038 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947209+0000", 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947212+0000", 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947218+0000", 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2319999999999998e-06 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947223+0000", 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8590000000000004e-06 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998966+0000", 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051743193999999999 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999009+0000", 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999997e-05 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999061+0000", 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2216999999999998e-05 2024-09-18T05:15:09.016 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37039 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015049763999997, 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052037513000000001, 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.017 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37039 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947226+0000", 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947229+0000", 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.198e-06 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947235+0000", 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.319e-06 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947240+0000", 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7260000000000002e-06 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999092+0000", 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851928999999998 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999162+0000", 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0115000000000002e-05 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999264+0000", 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010256599999999999 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37040 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 448512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.021 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015030994, 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052135867000000002, 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37040 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:09.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947245+0000", 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947248+0000", 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4439999999999998e-06 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947256+0000", 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9410000000000007e-06 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947260+0000", 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999286+0000", 2024-09-18T05:15:09.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052025350999999997 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999330+0000", 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4226e-05 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999381+0000", 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1529000000000001e-05 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.027 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37041 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 458752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.015011698999999, 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052321965999999998, 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37041 2024-09-18T05:15:09.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947275+0000", 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0175e-05 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947283+0000", 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8660000000000006e-06 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947287+0000", 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6369999999999998e-06 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999414+0000", 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052126541999999998 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999494+0000", 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999587+0000", 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2795999999999997e-05 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37042 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.014984869999999, 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052411412999999997, 2024-09-18T05:15:09.032 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37042 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947291+0000", 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947294+0000", 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4559999999999999e-06 2024-09-18T05:15:09.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947300+0000", 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5189999999999998e-06 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947305+0000", 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9049999999999996e-06 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999614+0000", 2024-09-18T05:15:09.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052308353000000002 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999653+0000", 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9879000000000002e-05 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999703+0000", 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9710999999999999e-05 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37043 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 479232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.014962920000002, 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052588113999999998, 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37043 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947313+0000", 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947316+0000", 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4059999999999999e-06 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947322+0000", 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2999999999999998e-06 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947327+0000", 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7119999999999999e-06 2024-09-18T05:15:09.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999735+0000", 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052408145000000003 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999812+0000", 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7540999999999995e-05 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999902+0000", 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9413000000000006e-05 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37044 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 489472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.014945732000001, 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052688817999999998, 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.041 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37044 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947333+0000", 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.396e-06 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947339+0000", 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947344+0000", 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9359999999999998e-06 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999929+0000", 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052584371999999997 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999969+0000", 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0315000000000003e-05 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000020+0000", 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0807000000000003e-05 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.045 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37045 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 499712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.014927923000002, 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052875286000000001, 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.046 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37045 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947348+0000", 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947351+0000", 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3130000000000001e-06 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947357+0000", 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2040000000000002e-06 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947362+0000", 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9269999999999996e-06 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000054+0000", 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052691799999999997 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000133+0000", 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9134999999999994e-05 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000224+0000", 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1315000000000002e-05 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37046 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.014910569000001, 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052973012999999999, 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.050 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37046 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:09.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947368+0000", 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3190000000000002e-06 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947374+0000", 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1569999999999997e-06 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947379+0000", 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6949999999999999e-06 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000250+0000", 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052870752999999999 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000291+0000", 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0975e-05 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000339+0000", 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8511999999999999e-05 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37047 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:09.054 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.014893577999999, 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053159397999999997, 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37047 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:09.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947385+0000", 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3070000000000001e-06 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947391+0000", 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947396+0000", 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.921e-06 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000373+0000", 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052976957999999998 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000451+0000", 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8250000000000005e-05 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000542+0000", 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1242999999999994e-05 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.058 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.059 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.059 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:09.059 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:09.059 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:09.060 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:09.060 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:09.061 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:09.061 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:09.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:09.062 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:09.056+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:09.062 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:09.062 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:09.063 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:09.161 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:09.154+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:09.232 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:09.232 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:09.246 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:09.296 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:09.292+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:09.317 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:15:09.363 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:09.356+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:09.365 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:09.365 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:09.380 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:09.419 INFO:teuthology.orchestra.run.smithi017.stdout:leaving image image_client.0-clone36 intact 2024-09-18T05:15:09.472 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:09.468+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:09.547 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:09.547 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:09.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:09.585 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-18T05:15:09.604 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:09.600+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:09.665 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:09.658+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:09.701 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:09.702 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:09.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:09.766 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:09.764+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:09.867 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:09.864+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:09.892 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:09.893 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:09.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:09.968 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:09.962+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:10.032 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:10.032 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:10.037 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.037 INFO:teuthology.orchestra.run.smithi017.stdout:4618 read 0x91d97e thru 0x92c59f (0xec22 bytes) 2024-09-18T05:15:10.045 INFO:teuthology.orchestra.run.smithi017.stdout:4619 trunc from 0x45957bc to 0x5c8869 2024-09-18T05:15:10.050 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:10.069 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:10.064+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:10.128 INFO:teuthology.orchestra.run.smithi017.stdout:4620 write 0xcbe883f thru 0xcbed95d (0x511f bytes) 2024-09-18T05:15:10.133 INFO:teuthology.orchestra.run.smithi017.stdout:4621 punch from 0xc6042c5 to 0xc61109d, (0xcdd8 bytes) 2024-09-18T05:15:10.144 INFO:teuthology.orchestra.run.smithi017.stdout:4623 write 0xd120f0d thru 0xd12b8e9 (0xa9dd bytes) 2024-09-18T05:15:10.151 INFO:teuthology.orchestra.run.smithi017.stdout:4624 punch from 0x5bc5e55 to 0x5bd1bec, (0xbd97 bytes) 2024-09-18T05:15:10.151 INFO:teuthology.orchestra.run.smithi017.stdout:4625 punch from 0xa9235a to 0xa9a73e, (0x83e4 bytes) 2024-09-18T05:15:10.157 INFO:teuthology.orchestra.run.smithi017.stdout:4626 trunc from 0xd12b8ea to 0x995f1e5 2024-09-18T05:15:10.170 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:10.164+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:10.179 INFO:teuthology.orchestra.run.smithi017.stdout:4627 read 0x286ff46 thru 0x287eb63 (0xec1e bytes) 2024-09-18T05:15:10.180 INFO:teuthology.orchestra.run.smithi017.stdout:4628 read 0x7ce5b5d thru 0x7ce70b1 (0x1555 bytes) 2024-09-18T05:15:10.180 INFO:teuthology.orchestra.run.smithi017.stdout:4629 write 0x14017bf thru 0x1407592 (0x5dd4 bytes) 2024-09-18T05:15:10.183 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.183 INFO:teuthology.orchestra.run.smithi017.stdout:4631 write 0x978f607 thru 0x979c6ba (0xd0b4 bytes) 2024-09-18T05:15:10.205 INFO:teuthology.orchestra.run.smithi017.stdout:4632 trunc from 0x995f1e5 to 0x13e3b38 2024-09-18T05:15:10.226 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:10.226 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:10.234 INFO:teuthology.orchestra.run.smithi017.stdout:4634 punch from 0xdfabaa to 0xe08346, (0xd79c bytes) 2024-09-18T05:15:10.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:10.263 INFO:teuthology.orchestra.run.smithi017.stdout:4635 write 0x7c79d52 thru 0x7c848c4 (0xab73 bytes) 2024-09-18T05:15:10.271 INFO:teuthology.orchestra.run.smithi017.stdout:4636 punch from 0x64d4333 to 0x64dd61a, (0x92e7 bytes) 2024-09-18T05:15:10.272 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:10.266+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:10.274 INFO:teuthology.orchestra.run.smithi017.stdout:4640 trunc from 0x7c848c5 to 0x8d15e1a 2024-09-18T05:15:10.309 INFO:teuthology.orchestra.run.smithi017.stdout:4641 writesame 0xd81d4df thru 0xd829cb9 data_size 0x1(0xc7db bytes) 2024-09-18T05:15:10.310 INFO:teuthology.orchestra.run.smithi017.stdout:4642 read 0xde4c07 thru 0xde8eb2 (0x42ac bytes) 2024-09-18T05:15:10.310 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.310 INFO:teuthology.orchestra.run.smithi017.stdout:4644 write 0x48fd49a thru 0x4908504 (0xb06b bytes) 2024-09-18T05:15:10.313 INFO:teuthology.orchestra.run.smithi017.stdout:4645 writesame 0xb7e026b thru 0xb7e561b data_size 0x5(0x53b1 bytes) 2024-09-18T05:15:10.320 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.321 INFO:teuthology.orchestra.run.smithi017.stdout:4647 writesame 0x4d0808 thru 0x4d4584 data_size 0x35(0x3d7d bytes) 2024-09-18T05:15:10.325 INFO:teuthology.orchestra.run.smithi017.stdout:4648 trunc from 0xd829cba to 0xdc88555 2024-09-18T05:15:10.337 INFO:teuthology.orchestra.run.smithi017.stdout:4649 read 0xcfedb28 thru 0xcff8233 (0xa70c bytes) 2024-09-18T05:15:10.337 INFO:teuthology.orchestra.run.smithi017.stdout:4650 punch from 0xc6e96a3 to 0xc6f605b, (0xc9b8 bytes) 2024-09-18T05:15:10.337 INFO:teuthology.orchestra.run.smithi017.stdout:4651 punch from 0x5ed93ad to 0x5edd352, (0x3fa5 bytes) 2024-09-18T05:15:10.338 INFO:teuthology.orchestra.run.smithi017.stdout:4653 writesame 0x1ae29e2 thru 0x1aeba8c data_size 0xf(0x90ab bytes) 2024-09-18T05:15:10.341 INFO:teuthology.orchestra.run.smithi017.stdout:4654 write 0xb405330 thru 0xb409f19 (0x4bea bytes) 2024-09-18T05:15:10.347 INFO:teuthology.orchestra.run.smithi017.stdout:4658 write 0x633f70f thru 0x6343851 (0x4143 bytes) 2024-09-18T05:15:10.354 INFO:teuthology.orchestra.run.smithi017.stdout:4659 read 0x4b6bf98 thru 0x4b76600 (0xa669 bytes) 2024-09-18T05:15:10.354 INFO:teuthology.orchestra.run.smithi017.stdout:4660 read 0x858e6e1 thru 0x85950c3 (0x69e3 bytes) 2024-09-18T05:15:10.355 INFO:teuthology.orchestra.run.smithi017.stdout:4662 read 0x344bda6 thru 0x344f894 (0x3aef bytes) 2024-09-18T05:15:10.355 INFO:teuthology.orchestra.run.smithi017.stdout:4663 read 0xc76db99 thru 0xc77104a (0x34b2 bytes) 2024-09-18T05:15:10.356 INFO:teuthology.orchestra.run.smithi017.stdout:4664 writesame 0xd018b2b thru 0xd024df0 data_size 0x6b(0xc2c6 bytes) 2024-09-18T05:15:10.362 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.362 INFO:teuthology.orchestra.run.smithi017.stdout:4667 read 0x503d02a thru 0x504bc51 (0xec28 bytes) 2024-09-18T05:15:10.362 INFO:teuthology.orchestra.run.smithi017.stdout:4668 read 0x95786e0 thru 0x958810f (0xfa30 bytes) 2024-09-18T05:15:10.363 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.363 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.364 INFO:teuthology.orchestra.run.smithi017.stdout:4671 read 0x5b5236d thru 0x5b58be4 (0x6878 bytes) 2024-09-18T05:15:10.364 INFO:teuthology.orchestra.run.smithi017.stdout:4673 read 0x90623a4 thru 0x90679e5 (0x5642 bytes) 2024-09-18T05:15:10.364 INFO:teuthology.orchestra.run.smithi017.stdout:4674 read 0x8c3561b thru 0x8c42089 (0xca6f bytes) 2024-09-18T05:15:10.365 INFO:teuthology.orchestra.run.smithi017.stdout:4675 writesame 0x6b309c7 thru 0x6b3bd28 data_size 0x1(0xb362 bytes) 2024-09-18T05:15:10.371 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:10.364+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:10.389 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:10.390 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:10.404 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:10.416 INFO:teuthology.orchestra.run.smithi017.stdout:4676 read 0x3664709 thru 0x366fa56 (0xb34e bytes) 2024-09-18T05:15:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:4677 trunc from 0xdc88555 to 0x913aa29 2024-09-18T05:15:10.460 INFO:teuthology.orchestra.run.smithi017.stdout:4678 trunc from 0x913aa29 to 0x5ecc9d5 2024-09-18T05:15:10.472 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:10.468+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:10.476 INFO:teuthology.orchestra.run.smithi017.stdout:4679 read 0x182895a thru 0x1835f5e (0xd605 bytes) 2024-09-18T05:15:10.477 INFO:teuthology.orchestra.run.smithi017.stdout:4682 punch from 0x3aae6c6 to 0x3ab53b6, (0x6cf0 bytes) 2024-09-18T05:15:10.477 INFO:teuthology.orchestra.run.smithi017.stdout:4683 read 0x3e6680b thru 0x3e723e2 (0xbbd8 bytes) 2024-09-18T05:15:10.478 INFO:teuthology.orchestra.run.smithi017.stdout:4685 writesame 0x5293363 thru 0x529ac9c data_size 0x2(0x793a bytes) 2024-09-18T05:15:10.497 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.497 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.520 INFO:teuthology.orchestra.run.smithi017.stdout:4688 writesame 0x9eb2766 thru 0x9ec1572 data_size 0x1(0xee0d bytes) 2024-09-18T05:15:10.539 INFO:teuthology.orchestra.run.smithi017.stdout:4689 write 0xb96623c thru 0xb96dece (0x7c93 bytes) 2024-09-18T05:15:10.546 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.546 INFO:teuthology.orchestra.run.smithi017.stdout:4691 read 0x2df663e thru 0x2dfdfad (0x7970 bytes) 2024-09-18T05:15:10.547 INFO:teuthology.orchestra.run.smithi017.stdout:4692 read 0x8af2444 thru 0x8af639e (0x3f5b bytes) 2024-09-18T05:15:10.548 INFO:teuthology.orchestra.run.smithi017.stdout:4693 read 0x2f366ae thru 0x2f3b3b8 (0x4d0b bytes) 2024-09-18T05:15:10.548 INFO:teuthology.orchestra.run.smithi017.stdout:4694 write 0x4a2140b thru 0x4a22282 (0xe78 bytes) 2024-09-18T05:15:10.549 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:10.549 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:10.552 INFO:teuthology.orchestra.run.smithi017.stdout:4696 writesame 0x6e703ba thru 0x6e79132 data_size 0x1(0x8d79 bytes) 2024-09-18T05:15:10.565 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:10.572 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:10.568+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:10.604 INFO:teuthology.orchestra.run.smithi017.stdout:4698 write 0x788bce1 thru 0x788dcf6 (0x2016 bytes) 2024-09-18T05:15:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:4699 write 0x65a17a8 thru 0x65a646d (0x4cc6 bytes) 2024-09-18T05:15:10.618 INFO:teuthology.orchestra.run.smithi017.stdout:4700 trunc from 0xb96decf to 0xa364ed3 2024-09-18T05:15:10.651 INFO:teuthology.orchestra.run.smithi017.stdout:4702 writesame 0xbd86164 thru 0xbd92e51 data_size 0x2(0xccee bytes) 2024-09-18T05:15:10.653 INFO:teuthology.orchestra.run.smithi017.stdout:4703 trunc from 0xbd92e52 to 0xb144228 2024-09-18T05:15:10.670 INFO:teuthology.orchestra.run.smithi017.stdout:4704 punch from 0x3e80f27 to 0x3e83f66, (0x303f bytes) 2024-09-18T05:15:10.670 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:10.670 INFO:teuthology.orchestra.run.smithi017.stdout:4706 clone 38 order 23 su 524288 sc 4 2024-09-18T05:15:10.673 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:10.666+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:10.743 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:10.743 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:10.758 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:15:10.774 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:10.768+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:10.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:10.870+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:10.934 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:10.934 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:10.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:15:10.976 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:10.968+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:11.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:11.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:15:11.379 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:11.379 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:11.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:11.380 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:11.374+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:11.472 INFO:teuthology.orchestra.run.smithi017.stdout:leaving image image_client.0-clone37 intact 2024-09-18T05:15:11.480 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:11.476+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:11.547 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:11.547 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:11.563 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:11.563 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:11.566 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:11.566 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:11.582 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:11.576+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:11.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:11.583 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:11.600 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:11.600 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:11.622 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:11.643 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:11.644 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:11.664 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:11.665 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:11.682 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-18T05:15:11.684 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:11.678+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:11.689 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:11.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:11.800 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:11.794+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:11.825 INFO:teuthology.orchestra.run.smithi017.stdout:4709 writesame 0x4317711 thru 0x431e439 data_size 0x73(0x6d29 bytes) 2024-09-18T05:15:11.841 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:11.851 INFO:teuthology.orchestra.run.smithi017.stdout:4713 write 0xca617c3 thru 0xca66101 (0x493f bytes) 2024-09-18T05:15:11.858 INFO:teuthology.orchestra.run.smithi017.stdout:4714 read 0x921e63b thru 0x9224282 (0x5c48 bytes) 2024-09-18T05:15:11.858 INFO:teuthology.orchestra.run.smithi017.stdout:4716 read 0x5b91bd6 thru 0x5b9ea97 (0xcec2 bytes) 2024-09-18T05:15:11.859 INFO:teuthology.orchestra.run.smithi017.stdout:4717 writesame 0x9535fdb thru 0x954135c data_size 0x25(0xb382 bytes) 2024-09-18T05:15:11.885 INFO:teuthology.orchestra.run.smithi017.stdout:4718 trunc from 0xca66102 to 0x22966fc 2024-09-18T05:15:11.885 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:11.880+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:4719 read 0x1e74047 thru 0x1e7e111 (0xa0cb bytes) 2024-09-18T05:15:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:4720 read 0xd2c6f2 thru 0xd36dda (0xa6e9 bytes) 2024-09-18T05:15:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:4721 read 0xf88711 thru 0xf94cfb (0xc5eb bytes) 2024-09-18T05:15:11.932 INFO:teuthology.orchestra.run.smithi017.stdout:4722 trunc from 0x22966fc to 0x58551e 2024-09-18T05:15:11.936 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:11.937 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:11.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:11.937 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:11.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.937 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.938 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:11.938 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.022209985999993, 2024-09-18T05:15:11.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:15:11.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.939 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.939 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.939 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:15:11.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.940 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:11.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:11.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:15:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:15:11.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:15:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:15:11.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.022179042999994, 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:15:11.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:15:11.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.022153478999996, 2024-09-18T05:15:11.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:15:11.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.022128762999998, 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:15:11.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:15:11.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.022102528999994, 2024-09-18T05:15:11.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:15:11.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.02207362, 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:15:11.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.022049789999997, 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:15:11.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:11.973 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.022025314000004, 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:15:11.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.021907514999995, 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:15:11.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:15:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:15:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.018915559999996, 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.983 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:15:11.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.018837497999996, 2024-09-18T05:15:11.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:15:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:15:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:11.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.018806210999998, 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:15:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:11.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.018780198000002, 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.997 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:11.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:11.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:15:12.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:12.001 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.018752425000002, 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:15:12.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:15:12.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.018727362000007, 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:12.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:15:12.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:12.010 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.018702332000004, 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:15:12.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:15:12.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.014578004000001, 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:12.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:15:12.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:12.019 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.014557459000002, 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:12.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:15:12.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.014537777000001, 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:12.024 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:15:12.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:12.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:15:12.028 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.746466330000001, 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:12.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:15:12.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:12.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:12.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:15:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:15:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:12.035 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:12.035 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:12.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:12.039 INFO:teuthology.orchestra.run.smithi017.stdout:4724 read 0x257383 thru 0x2649b7 (0xd635 bytes) 2024-09-18T05:15:12.039 INFO:teuthology.orchestra.run.smithi017.stdout:4725 read 0x35ee0a thru 0x3664b4 (0x76ab bytes) 2024-09-18T05:15:12.039 INFO:teuthology.orchestra.run.smithi017.stdout:4726 read 0x2b4e0 thru 0x399dc (0xe4fd bytes) 2024-09-18T05:15:12.039 INFO:teuthology.orchestra.run.smithi017.stdout:4727 writesame 0x3fcddf2 thru 0x3fd8510 data_size 0xd(0xa71f bytes) 2024-09-18T05:15:12.039 INFO:teuthology.orchestra.run.smithi017.stdout:4728 write 0xda94c8e thru 0xda9eb07 (0x9e7a bytes) 2024-09-18T05:15:12.040 INFO:teuthology.orchestra.run.smithi017.stdout:4729 read 0x925d5e7 thru 0x9268f5b (0xb975 bytes) 2024-09-18T05:15:12.040 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.040 INFO:teuthology.orchestra.run.smithi017.stdout:4731 writesame 0xad9fca3 thru 0xada8f5a data_size 0x3c(0x92b8 bytes) 2024-09-18T05:15:12.040 INFO:teuthology.orchestra.run.smithi017.stdout:4733 write 0x98c6873 thru 0x98cef21 (0x86af bytes) 2024-09-18T05:15:12.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:12.030+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:12.042 INFO:teuthology.orchestra.run.smithi017.stdout:4734 punch from 0xa7629b8 to 0xa76ae79, (0x84c1 bytes) 2024-09-18T05:15:12.042 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.043 INFO:teuthology.orchestra.run.smithi017.stdout:4736 punch from 0x6d0687f to 0x6d084dc, (0x1c5d bytes) 2024-09-18T05:15:12.043 INFO:teuthology.orchestra.run.smithi017.stdout:4737 read 0x9065d44 thru 0x9072057 (0xc314 bytes) 2024-09-18T05:15:12.049 INFO:teuthology.orchestra.run.smithi017.stdout:4738 trunc from 0xda9eb08 to 0xa95fe4b 2024-09-18T05:15:12.069 INFO:teuthology.orchestra.run.smithi017.stdout:4739 write 0x5c26413 thru 0x5c353f6 (0xefe4 bytes) 2024-09-18T05:15:12.075 INFO:teuthology.orchestra.run.smithi017.stdout:4740 read 0x23cf345 thru 0x23d6a98 (0x7754 bytes) 2024-09-18T05:15:12.075 INFO:teuthology.orchestra.run.smithi017.stdout:4741 read 0x7bc753f thru 0x7bc7d73 (0x835 bytes) 2024-09-18T05:15:12.075 INFO:teuthology.orchestra.run.smithi017.stdout:4742 punch from 0x730dfcd to 0x731cda3, (0xedd6 bytes) 2024-09-18T05:15:12.075 INFO:teuthology.orchestra.run.smithi017.stdout:4743 read 0x17953d8 thru 0x17a2f5f (0xdb88 bytes) 2024-09-18T05:15:12.075 INFO:teuthology.orchestra.run.smithi017.stdout:4746 writesame 0xa71fcbb thru 0xa72c3cd data_size 0x29(0xc713 bytes) 2024-09-18T05:15:12.081 INFO:teuthology.orchestra.run.smithi017.stdout:4748 write 0x3ff5b0 thru 0x40f1e8 (0xfc39 bytes) 2024-09-18T05:15:12.108 INFO:teuthology.orchestra.run.smithi017.stdout:4749 write 0xe8234b9 thru 0xe82fb10 (0xc658 bytes) 2024-09-18T05:15:12.116 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.116 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.116 INFO:teuthology.orchestra.run.smithi017.stdout:4752 read 0x75d171a thru 0x75dd5bc (0xbea3 bytes) 2024-09-18T05:15:12.116 INFO:teuthology.orchestra.run.smithi017.stdout:4754 read 0x50d3683 thru 0x50e2046 (0xe9c4 bytes) 2024-09-18T05:15:12.116 INFO:teuthology.orchestra.run.smithi017.stdout:4755 write 0x2590418 thru 0x259909e (0x8c87 bytes) 2024-09-18T05:15:12.122 INFO:teuthology.orchestra.run.smithi017.stdout:4756 writesame 0xdaff582 thru 0xdb0e1d4 data_size 0x1(0xec53 bytes) 2024-09-18T05:15:12.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:12.134+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:12.171 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:12.172 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:12.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:12.194 INFO:teuthology.orchestra.run.smithi017.stdout:4757 write 0x50aa067 thru 0x50b8015 (0xdfaf bytes) 2024-09-18T05:15:12.200 INFO:teuthology.orchestra.run.smithi017.stdout:4758 read 0x406f16e thru 0x407550c (0x639f bytes) 2024-09-18T05:15:12.202 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.202 INFO:teuthology.orchestra.run.smithi017.stdout:4763 writesame 0xe0a68e6 thru 0xe0aa6eb data_size 0x11(0x3e06 bytes) 2024-09-18T05:15:12.206 INFO:teuthology.orchestra.run.smithi017.stdout:4765 punch from 0x8bb268d to 0x8bb62ae, (0x3c21 bytes) 2024-09-18T05:15:12.206 INFO:teuthology.orchestra.run.smithi017.stdout:4766 write 0x6fa708d thru 0x6fb6bdf (0xfb53 bytes) 2024-09-18T05:15:12.210 INFO:teuthology.orchestra.run.smithi017.stdout:4767 read 0xa504d3f thru 0xa50d253 (0x8515 bytes) 2024-09-18T05:15:12.211 INFO:teuthology.orchestra.run.smithi017.stdout:4768 write 0x6eb883a thru 0x6ebb016 (0x27dd bytes) 2024-09-18T05:15:12.216 INFO:teuthology.orchestra.run.smithi017.stdout:4769 writesame 0x4009e79 thru 0x40191e8 data_size 0xbe(0xf370 bytes) 2024-09-18T05:15:12.219 INFO:teuthology.orchestra.run.smithi017.stdout:4770 punch from 0x84d2246 to 0x84d7b6d, (0x5927 bytes) 2024-09-18T05:15:12.230 INFO:teuthology.orchestra.run.smithi017.stdout:4772 trunc from 0xe82fb11 to 0xa5664fe 2024-09-18T05:15:12.239 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:12.234+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:12.253 INFO:teuthology.orchestra.run.smithi017.stdout:4774 writesame 0x7dd705c thru 0x7de2ecc data_size 0x3(0xbe71 bytes) 2024-09-18T05:15:12.265 INFO:teuthology.orchestra.run.smithi017.stdout:4776 punch from 0x8ef1d6 to 0x8fd83f, (0xe669 bytes) 2024-09-18T05:15:12.265 INFO:teuthology.orchestra.run.smithi017.stdout:4778 read 0x30ab4fa thru 0x30b9ba4 (0xe6ab bytes) 2024-09-18T05:15:12.265 INFO:teuthology.orchestra.run.smithi017.stdout:4780 punch from 0x3d6164d to 0x3d6fef5, (0xe8a8 bytes) 2024-09-18T05:15:12.265 INFO:teuthology.orchestra.run.smithi017.stdout:4781 punch from 0x2636cb4 to 0x263f7eb, (0x8b37 bytes) 2024-09-18T05:15:12.265 INFO:teuthology.orchestra.run.smithi017.stdout:4782 write 0x96fd1bd thru 0x96ff914 (0x2758 bytes) 2024-09-18T05:15:12.282 INFO:teuthology.orchestra.run.smithi017.stdout:4783 write 0xab6abac thru 0xab73486 (0x88db bytes) 2024-09-18T05:15:12.286 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.286 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.303 INFO:teuthology.orchestra.run.smithi017.stdout:4790 trunc from 0xab73487 to 0x453d682 2024-09-18T05:15:12.317 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:12.318 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:12.318 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:12.318 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:12.318 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:12.333 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:12.335 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:15:12.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:12.334+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:12.343 INFO:teuthology.orchestra.run.smithi017.stdout:4791 trunc from 0x453d682 to 0x441e402 2024-09-18T05:15:12.357 INFO:teuthology.orchestra.run.smithi017.stdout:4792 writesame 0x21ce83 thru 0x2228f0 data_size 0x19(0x5a6e bytes) 2024-09-18T05:15:12.360 INFO:teuthology.orchestra.run.smithi017.stdout:4793 punch from 0x435ab6d to 0x43631bf, (0x8652 bytes) 2024-09-18T05:15:12.386 INFO:teuthology.orchestra.run.smithi017.stdout:4794 write 0xeaac065 thru 0xeaacddb (0xd77 bytes) 2024-09-18T05:15:12.389 INFO:teuthology.orchestra.run.smithi017.stdout:4795 write 0x36c2b14 thru 0x36cc25e (0x974b bytes) 2024-09-18T05:15:12.394 INFO:teuthology.orchestra.run.smithi017.stdout:4796 read 0x60a9b23 thru 0x60af823 (0x5d01 bytes) 2024-09-18T05:15:12.394 INFO:teuthology.orchestra.run.smithi017.stdout:4797 read 0xab78736 thru 0xab86e42 (0xe70d bytes) 2024-09-18T05:15:12.394 INFO:teuthology.orchestra.run.smithi017.stdout:4798 punch from 0x9d9f396 to 0x9dae43d, (0xf0a7 bytes) 2024-09-18T05:15:12.394 INFO:teuthology.orchestra.run.smithi017.stdout:4799 read 0x1a58cd7 thru 0x1a5dcd2 (0x4ffc bytes) 2024-09-18T05:15:12.394 INFO:teuthology.orchestra.run.smithi017.stdout:4800 write 0x61c3057 thru 0x61d1851 (0xe7fb bytes) 2024-09-18T05:15:12.398 INFO:teuthology.orchestra.run.smithi017.stdout:4802 write 0x55d8632 thru 0x55e5cfa (0xd6c9 bytes) 2024-09-18T05:15:12.402 INFO:teuthology.orchestra.run.smithi017.stdout:4804 writesame 0x17304e5 thru 0x1733687 data_size 0x1(0x31a3 bytes) 2024-09-18T05:15:12.412 INFO:teuthology.orchestra.run.smithi017.stdout:4806 write 0x781e26c thru 0x782366f (0x5404 bytes) 2024-09-18T05:15:12.417 INFO:teuthology.orchestra.run.smithi017.stdout:4807 read 0x26c80f0 thru 0x26ca8db (0x27ec bytes) 2024-09-18T05:15:12.417 INFO:teuthology.orchestra.run.smithi017.stdout:4809 write 0x7fefb37 thru 0x7ff5351 (0x581b bytes) 2024-09-18T05:15:12.420 INFO:teuthology.orchestra.run.smithi017.stdout:4810 punch from 0x9e6f619 to 0x9e7b8b9, (0xc2a0 bytes) 2024-09-18T05:15:12.420 INFO:teuthology.orchestra.run.smithi017.stdout:4811 write 0x2a2df57 thru 0x2a342cb (0x6375 bytes) 2024-09-18T05:15:12.426 INFO:teuthology.orchestra.run.smithi017.stdout:4812 writesame 0x6b99fb9 thru 0x6ba50a5 data_size 0x1(0xb0ed bytes) 2024-09-18T05:15:12.441 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:12.436+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:12.464 INFO:teuthology.orchestra.run.smithi017.stdout:4813 punch from 0x869b6c9 to 0x86a04f4, (0x4e2b bytes) 2024-09-18T05:15:12.465 INFO:teuthology.orchestra.run.smithi017.stdout:4814 write 0x6e2b419 thru 0x6e3744e (0xc036 bytes) 2024-09-18T05:15:12.468 INFO:teuthology.orchestra.run.smithi017.stdout:4815 read 0xb556be1 thru 0xb558c19 (0x2039 bytes) 2024-09-18T05:15:12.469 INFO:teuthology.orchestra.run.smithi017.stdout:4819 read 0xa7f641b thru 0xa7fa0d1 (0x3cb7 bytes) 2024-09-18T05:15:12.469 INFO:teuthology.orchestra.run.smithi017.stdout:4820 writesame 0xc85856f thru 0xc85b8e1 data_size 0x1(0x3373 bytes) 2024-09-18T05:15:12.478 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:12.478 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:12.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:12.478 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:12.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726394421, 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726385431000001, 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:15:12.483 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:15:12.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:15:12.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:15:12.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:15:12.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:15:12.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.488 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.488 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726376463999999, 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:15:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:15:12.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:15:12.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:15:12.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:15:12.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726367680999999, 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:15:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:15:12.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:15:12.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:15:12.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:15:12.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.499 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726358905, 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.503 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726348613000001, 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.504 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:15:12.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:15:12.508 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.508 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726334725999999, 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.509 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:12.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:12.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:15:12.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.72632552, 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.514 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:15:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726316821999999, 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.519 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:12.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.523 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726307757000001, 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:15:12.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726284399000001, 2024-09-18T05:15:12.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726274734, 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.533 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:15:12.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.537 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726248376999999, 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:15:12.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:15:12.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726234845, 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.543 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:15:12.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.547 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726223394, 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:15:12.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:15:12.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726213913, 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:15:12.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726203830999999, 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:15:12.557 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:12.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:15:12.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726194743000001, 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.562 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:12.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:15:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726185186, 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:15:12.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:15:12.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.726176365000001, 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:15:12.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:15:12.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:12.576 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:12.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:12.579 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:12.572+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:12.579 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.580 INFO:teuthology.orchestra.run.smithi017.stdout:4822 trunc from 0xeaacddc to 0x86857da 2024-09-18T05:15:12.580 INFO:teuthology.orchestra.run.smithi017.stdout:4823 punch from 0x4a232a6 to 0x4a30dcd, (0xdb27 bytes) 2024-09-18T05:15:12.580 INFO:teuthology.orchestra.run.smithi017.stdout:4824 punch from 0x5bd5cb8 to 0x5be3220, (0xd568 bytes) 2024-09-18T05:15:12.580 INFO:teuthology.orchestra.run.smithi017.stdout:4826 punch from 0x8355971 to 0x835fb9d, (0xa22c bytes) 2024-09-18T05:15:12.580 INFO:teuthology.orchestra.run.smithi017.stdout:4827 read 0x2b1c545 thru 0x2b21ce6 (0x57a2 bytes) 2024-09-18T05:15:12.580 INFO:teuthology.orchestra.run.smithi017.stdout:4828 write 0x3d63dfe thru 0x3d70316 (0xc519 bytes) 2024-09-18T05:15:12.580 INFO:teuthology.orchestra.run.smithi017.stdout:4829 write 0xc43f969 thru 0xc43fdf9 (0x491 bytes) 2024-09-18T05:15:12.580 INFO:teuthology.orchestra.run.smithi017.stdout:4830 trunc from 0xc43fdfa to 0x6d5076d 2024-09-18T05:15:12.619 INFO:teuthology.orchestra.run.smithi017.stdout:4831 trunc from 0x6d5076d to 0x416937 2024-09-18T05:15:12.649 INFO:teuthology.orchestra.run.smithi017.stdout:4832 read 0x670cd thru 0x758b6 (0xe7ea bytes) 2024-09-18T05:15:12.651 INFO:teuthology.orchestra.run.smithi017.stdout:4833 read 0x28b3ca thru 0x28f10a (0x3d41 bytes) 2024-09-18T05:15:12.677 INFO:teuthology.orchestra.run.smithi017.stdout:4835 write 0x5148388 thru 0x5152047 (0x9cc0 bytes) 2024-09-18T05:15:12.678 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:12.672+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:12.682 INFO:teuthology.orchestra.run.smithi017.stdout:4836 read 0x1d7d30f thru 0x1d80171 (0x2e63 bytes) 2024-09-18T05:15:12.683 INFO:teuthology.orchestra.run.smithi017.stdout:4837 read 0x513cb7f thru 0x51422a6 (0x5728 bytes) 2024-09-18T05:15:12.702 INFO:teuthology.orchestra.run.smithi017.stdout:4838 write 0x60f81a2 thru 0x61044fa (0xc359 bytes) 2024-09-18T05:15:12.708 INFO:teuthology.orchestra.run.smithi017.stdout:4839 read 0xca405f thru 0xca5fbb (0x1f5d bytes) 2024-09-18T05:15:12.709 INFO:teuthology.orchestra.run.smithi017.stdout:4840 write 0x59dccb9 thru 0x59e5635 (0x897d bytes) 2024-09-18T05:15:12.715 INFO:teuthology.orchestra.run.smithi017.stdout:4841 read 0xa382a9 thru 0xa44c94 (0xc9ec bytes) 2024-09-18T05:15:12.716 INFO:teuthology.orchestra.run.smithi017.stdout:4842 read 0x5e02405 thru 0x5e02966 (0x562 bytes) 2024-09-18T05:15:12.716 INFO:teuthology.orchestra.run.smithi017.stdout:4844 write 0xcc39a1 thru 0xcd070a (0xcd6a bytes) 2024-09-18T05:15:12.730 INFO:teuthology.orchestra.run.smithi017.stdout:4845 trunc from 0x61044fb to 0x9ec93a9 2024-09-18T05:15:12.744 INFO:teuthology.orchestra.run.smithi017.stdout:4847 punch from 0x4910e61 to 0x4911007, (0x1a6 bytes) 2024-09-18T05:15:12.744 INFO:teuthology.orchestra.run.smithi017.stdout:4848 read 0x7a64f7e thru 0x7a6b6b5 (0x6738 bytes) 2024-09-18T05:15:12.745 INFO:teuthology.orchestra.run.smithi017.stdout:4849 punch from 0x89e2119 to 0x89e8790, (0x6677 bytes) 2024-09-18T05:15:12.745 INFO:teuthology.orchestra.run.smithi017.stdout:4850 punch from 0x119e816 to 0x11a69d1, (0x81bb bytes) 2024-09-18T05:15:12.745 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.754 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:12.755 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:12.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:12.772 INFO:teuthology.orchestra.run.smithi017.stdout:4852 writesame 0xe844ba5 thru 0xe854852 data_size 0x3(0xfcae bytes) 2024-09-18T05:15:12.772 INFO:teuthology.orchestra.run.smithi017.stdout:4853 read 0x4531511 thru 0x453f0c4 (0xdbb4 bytes) 2024-09-18T05:15:12.773 INFO:teuthology.orchestra.run.smithi017.stdout:4854 writesame 0x7454fa9 thru 0x7458348 data_size 0x20(0x33a0 bytes) 2024-09-18T05:15:12.777 INFO:teuthology.orchestra.run.smithi017.stdout:4856 read 0x4119e51 thru 0x412312e (0x92de bytes) 2024-09-18T05:15:12.778 INFO:teuthology.orchestra.run.smithi017.stdout:4858 writesame 0xdab055f thru 0xdab07a6 data_size 0x4(0x248 bytes) 2024-09-18T05:15:12.779 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:12.774+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:12.783 INFO:teuthology.orchestra.run.smithi017.stdout:4859 writesame 0xb81e58d thru 0xb81fe45 data_size 0x1(0x18b9 bytes) 2024-09-18T05:15:12.792 INFO:teuthology.orchestra.run.smithi017.stdout:4860 punch from 0xe0cb4e to 0xe155f8, (0x8aaa bytes) 2024-09-18T05:15:12.792 INFO:teuthology.orchestra.run.smithi017.stdout:4861 write 0x28ed207 thru 0x28ef241 (0x203b bytes) 2024-09-18T05:15:12.797 INFO:teuthology.orchestra.run.smithi017.stdout:4862 read 0x5fcc1d0 thru 0x5fd2893 (0x66c4 bytes) 2024-09-18T05:15:12.798 INFO:teuthology.orchestra.run.smithi017.stdout:4863 write 0xc432c8c thru 0xc440330 (0xd6a5 bytes) 2024-09-18T05:15:12.802 INFO:teuthology.orchestra.run.smithi017.stdout:4864 write 0x8909331 thru 0x8917d7e (0xea4e bytes) 2024-09-18T05:15:12.831 INFO:teuthology.orchestra.run.smithi017.stdout:4866 trunc from 0xe854853 to 0x66bacdc 2024-09-18T05:15:12.855 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.863 INFO:teuthology.orchestra.run.smithi017.stdout:4869 trunc from 0x66bacdc to 0x96d2cc1 2024-09-18T05:15:12.874 INFO:teuthology.orchestra.run.smithi017.stdout:4870 read 0x5ff49d5 thru 0x5ff9196 (0x47c2 bytes) 2024-09-18T05:15:12.875 INFO:teuthology.orchestra.run.smithi017.stdout:4871 writesame 0x697997e thru 0x6984a56 data_size 0x1(0xb0d9 bytes) 2024-09-18T05:15:12.880 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:12.874+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:12.906 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-18T05:15:12.907 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:15:12.907 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-18T05:15:12.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T05:15:12.921 INFO:teuthology.orchestra.run.smithi017.stdout:4872 trunc from 0x96d2cc1 to 0x3e87f3e 2024-09-18T05:15:12.942 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:12.943 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:12.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:12.964 INFO:teuthology.orchestra.run.smithi017.stdout:4873 trunc from 0x3e87f3e to 0xd09c4b3 2024-09-18T05:15:12.972 INFO:teuthology.orchestra.run.smithi017.stdout:4874 writesame 0xa098007 thru 0xa099580 data_size 0x1(0x157a bytes) 2024-09-18T05:15:12.978 INFO:teuthology.orchestra.run.smithi017.stdout:4877 read 0x3c944dc thru 0x3c9da4c (0x9571 bytes) 2024-09-18T05:15:12.979 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:12.979 INFO:teuthology.orchestra.run.smithi017.stdout:4879 write 0x969b286 thru 0x96a3c2c (0x89a7 bytes) 2024-09-18T05:15:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:4880 write 0x3ab0dba thru 0x3ab8fd5 (0x821c bytes) 2024-09-18T05:15:12.985 INFO:teuthology.orchestra.run.smithi017.stdout:4883 write 0x5490cc4 thru 0x54931a7 (0x24e4 bytes) 2024-09-18T05:15:13.002 INFO:teuthology.orchestra.run.smithi017.stdout:4885 write 0xe79ce54 thru 0xe7a236c (0x5519 bytes) 2024-09-18T05:15:13.007 INFO:teuthology.orchestra.run.smithi017.stdout:4886 punch from 0xa16ed01 to 0xa174dde, (0x60dd bytes) 2024-09-18T05:15:13.007 INFO:teuthology.orchestra.run.smithi017.stdout:4888 read 0x2d2b176 thru 0x2d2dac4 (0x294f bytes) 2024-09-18T05:15:13.007 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.008 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:13.004+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:13.018 INFO:teuthology.orchestra.run.smithi017.stdout:4890 writesame 0xed7d9c1 thru 0xed83fa1 data_size 0x1(0x65e1 bytes) 2024-09-18T05:15:13.019 INFO:teuthology.orchestra.run.smithi017.stdout:4891 writesame 0x8210fe thru 0x821f39 data_size 0x2(0xe3c bytes) 2024-09-18T05:15:13.043 INFO:teuthology.orchestra.run.smithi017.stdout:4892 trunc from 0xed83fa2 to 0x5c7132b 2024-09-18T05:15:13.073 INFO:teuthology.orchestra.run.smithi017.stdout:4894 write 0x75377a4 thru 0x753f3b6 (0x7c13 bytes) 2024-09-18T05:15:13.082 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:13.076+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:13.088 INFO:teuthology.orchestra.run.smithi017.stdout:4895 trunc from 0x753f3b7 to 0x2c8e70 2024-09-18T05:15:13.089 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:13.090 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:13.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:13.090 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:13.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.090 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.090 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:13.091 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424934995000001, 2024-09-18T05:15:13.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:13.091 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.091 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.091 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:13.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:13.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.095 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424868076999999, 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:13.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424779567000002, 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:13.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:13.104 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424729010999997, 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:13.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:13.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:13.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:13.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.112 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.112 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424665896, 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.113 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:13.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.117 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:13.118 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424618975999998, 2024-09-18T05:15:13.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:13.118 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.118 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.118 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:13.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:13.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:13.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:13.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:13.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424565096999999, 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.124 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:13.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424517964000003, 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.129 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:13.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424470341999999, 2024-09-18T05:15:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:13.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:13.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424347521000001, 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.138 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:13.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.142 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424266191000001, 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:13.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:13.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424194948, 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.149 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:13.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:13.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:13.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:13.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:13.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:13.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:13.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424144736999999, 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:13.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:13.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:13.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:13.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:13.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:13.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:13.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424067543, 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:13.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.164 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.424017673000002, 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:13.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.423943102000003, 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:13.169 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:13.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.423877324000003, 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:13.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:13.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.423830287999998, 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.179 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:13.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:13.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:13.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:13.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:13.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:13.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:13.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.423768195000001, 2024-09-18T05:15:13.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.423721815999997, 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:13.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:13.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.193 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:13.195 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.195 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.195 INFO:teuthology.orchestra.run.smithi017.stdout:4899 write 0xd1c1a2a thru 0xd1c2aea (0x10c1 bytes) 2024-09-18T05:15:13.195 INFO:teuthology.orchestra.run.smithi017.stdout:4900 trunc from 0xd1c2aeb to 0x77a3f2 2024-09-18T05:15:13.195 INFO:teuthology.orchestra.run.smithi017.stdout:4901 punch from 0x5ce349 to 0x5ddbea, (0xf8a1 bytes) 2024-09-18T05:15:13.195 INFO:teuthology.orchestra.run.smithi017.stdout:4902 read 0x63f786 thru 0x6445ab (0x4e26 bytes) 2024-09-18T05:15:13.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:13.196 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:13.188+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:13.197 INFO:teuthology.orchestra.run.smithi017.stdout:4905 write 0x245345b thru 0x245a620 (0x71c6 bytes) 2024-09-18T05:15:13.204 INFO:teuthology.orchestra.run.smithi017.stdout:4906 punch from 0xd4c57a to 0xd5a8da, (0xe360 bytes) 2024-09-18T05:15:13.204 INFO:teuthology.orchestra.run.smithi017.stdout:4908 write 0x1cc8015 thru 0x1cc90f4 (0x10e0 bytes) 2024-09-18T05:15:13.206 INFO:teuthology.orchestra.run.smithi017.stdout:4909 punch from 0xd78cf0 to 0xd7a54a, (0x185a bytes) 2024-09-18T05:15:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:4910 write 0x5b7cb4b thru 0x5b7f03e (0x24f4 bytes) 2024-09-18T05:15:13.230 INFO:teuthology.orchestra.run.smithi017.stdout:4912 write 0x1bfd876 thru 0x1c0cfc3 (0xf74e bytes) 2024-09-18T05:15:13.233 INFO:teuthology.orchestra.run.smithi017.stdout:4913 read 0x2cc4249 thru 0x2cd3e57 (0xfc0f bytes) 2024-09-18T05:15:13.259 INFO:teuthology.orchestra.run.smithi017.stdout:4914 write 0xde7110a thru 0xde78bad (0x7aa4 bytes) 2024-09-18T05:15:13.264 INFO:teuthology.orchestra.run.smithi017.stdout:4915 write 0x7f058fb thru 0x7f0f334 (0x9a3a bytes) 2024-09-18T05:15:13.270 INFO:teuthology.orchestra.run.smithi017.stdout:4916 read 0x3e8c240 thru 0x3e997eb (0xd5ac bytes) 2024-09-18T05:15:13.270 INFO:teuthology.orchestra.run.smithi017.stdout:4917 writesame 0xc56bb5c thru 0xc578e80 data_size 0x1(0xd325 bytes) 2024-09-18T05:15:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:15:13.276 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 88, 2024-09-18T05:15:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "04ac0d2c-34bd-46ad-a307-a4eb23236eb4", 2024-09-18T05:15:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-18T05:13:15.193498+0000", 2024-09-18T05:15:13.276 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-18T05:15:12.317644+0000", 2024-09-18T05:15:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-18T05:14:40.084281+0000", 2024-09-18T05:15:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-18T05:13:18.221936+0000", 2024-09-18T05:15:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T05:15:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5806080, 2024-09-18T05:15:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-18T05:15:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "nodeep-scrub", 2024-09-18T05:15:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "noscrub", 2024-09-18T05:15:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-18T05:15:13.277 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-18T05:15:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-18T05:15:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-18T05:15:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:15:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 5, 2024-09-18T05:15:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T05:15:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T05:15:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T05:15:13.278 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "luminous", 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-18T05:15:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-18T05:15:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:28.629114+0000", 2024-09-18T05:15:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-18T05:15:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-18T05:15:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:15:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:15:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:15:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:15:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:15:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:15:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:15:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:15:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:15:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:15:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-18T05:15:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-18T05:15:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-18T05:15:13.281 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "17", 2024-09-18T05:15:13.282 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:15:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:15:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:15:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:15:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:15:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-18T05:15:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-18T05:15:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:15:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:15:13.283 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:15:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:15:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:15:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:15:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:15:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:15:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:15:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:15:13.284 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:15:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:15:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:15:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:15:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:15:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:15:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:15:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:15:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:15:13.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:15:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:15:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:15:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:15:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:15:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:15:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:15:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:15:13.286 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:15:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:15:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:15:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-18T05:15:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-18T05:15:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-18T05:15:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:15:13.287 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-18T05:15:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:15:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2024-09-18T05:15:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2024-09-18T05:15:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2024-09-18T05:15:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-18T05:15:13.288 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.904327392578125, 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:34.103981+0000", 2024-09-18T05:15:13.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:15:13.290 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:15:13.291 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "21", 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 3, 2024-09-18T05:15:13.292 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 21, 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:15:13.293 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:15:13.294 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2.9900000095367432, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2.9900000095367432, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T05:15:13.295 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2.630000114440918, 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2.630000114440918, 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.904327392578125, 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:44.114945+0000", 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:15:13.296 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-18T05:15:13.297 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "87", 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:15:13.298 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 41, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 87, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:15:13.299 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:15:13.300 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2024-09-18T05:15:13.301 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.904327392578125, 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:15:13.302 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "a2a580f7-2bbc-46c3-b6b5-5a9e93539d27", 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 82, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:15:13.303 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.304 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.305 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.307 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1558450642", 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1558450642", 2024-09-18T05:15:13.308 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1558450642", 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1558450642", 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "260da429-e6eb-446b-95a0-dcf4581bb584", 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:15:13.309 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 82, 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:15:13.311 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.312 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:15:13.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-18T05:15:13.314 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3444575073", 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3444575073", 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3444575073", 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3444575073", 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.315 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "0cf5d53a-552d-4775-8437-86af3465b1bc", 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 74, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:15:13.316 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.317 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:15:13.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-18T05:15:13.320 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 467806624 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/467806624", 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/467806624", 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/467806624", 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/467806624", 2024-09-18T05:15:13.321 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "73bc18b6-4972-4164-a294-b6372bcf9f9d", 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 0.7706451416015625, 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:15:13.322 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 74, 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:15:13.323 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:15:13.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:15:13.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:15:13.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/3763834627", 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/3763834627", 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/3763834627", 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/3763834627", 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.327 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "536c8ef2-eca6-44b4-a70c-06f191eb5ff1", 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 0.838714599609375, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 74, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6800", 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6802", 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:15:13.329 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6804", 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6806", 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:15:13.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6815", 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6819", 2024-09-18T05:15:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:15:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:15:13.332 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6809", 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6812", 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6802/1703780253", 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6806/1703780253", 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6819/1703780253", 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6812/1703780253", 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.334 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "4341bba4-2913-4352-89d4-36fa18ee39cb", 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 0.234619140625, 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 22, 2024-09-18T05:15:13.335 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6808", 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.336 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6811", 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6813", 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6816", 2024-09-18T05:15:13.337 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6822", 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.338 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6823", 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6817", 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6820", 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6811/3348904742", 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6816/3348904742", 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6823/3348904742", 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6820/3348904742", 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:15:13.340 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "e47d4aad-9c4b-43a9-9b32-2db463ec2a20", 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 13, 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 47, 2024-09-18T05:15:13.341 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 61, 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 79, 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 48, 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6801", 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6803", 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6805", 2024-09-18T05:15:13.343 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6807", 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.344 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.345 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6818", 2024-09-18T05:15:13.345 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:15:13.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.345 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6821", 2024-09-18T05:15:13.345 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:15:13.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.346 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.346 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:15:13.346 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.346 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6810", 2024-09-18T05:15:13.347 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:15:13.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.347 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6814", 2024-09-18T05:15:13.347 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:15:13.347 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.348 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.348 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6803/3446120186", 2024-09-18T05:15:13.348 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6807/3446120186", 2024-09-18T05:15:13.348 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6821/3446120186", 2024-09-18T05:15:13.348 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6814/3446120186", 2024-09-18T05:15:13.348 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:15:13.348 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "686d275c-e592-44c1-87f9-ac9718f3a112", 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 0.8923187255859375, 2024-09-18T05:15:13.349 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 48, 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6824", 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6825", 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.351 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:15:13.352 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.352 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6826", 2024-09-18T05:15:13.352 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:15:13.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.353 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6827", 2024-09-18T05:15:13.353 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:15:13.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.353 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.353 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:15:13.353 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6830", 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6831", 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:15:13.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.355 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.355 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:15:13.355 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:15:13.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:15:13.355 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6828", 2024-09-18T05:15:13.355 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6829", 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6825/1345159853", 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6827/1345159853", 2024-09-18T05:15:13.356 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6831/1345159853", 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6829/1345159853", 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.357 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.758535+0000", 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.358 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.800715+0000", 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.783374+0000", 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.360 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.779519+0000", 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:15:13.361 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.893837+0000", 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:15:13.362 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.776852+0000", 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.919808+0000", 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 48 2024-09-18T05:15:13.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.883599+0000", 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:15:13.364 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [ 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "3.f", 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 7, 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 3 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.365 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-18T05:15:13.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-18T05:15:13.367 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-18T05:15:13.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:13.368 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:13.370 INFO:tasks.thrashosds.thrasher:j is {'epoch': 88, 'fsid': '04ac0d2c-34bd-46ad-a307-a4eb23236eb4', 'created': '2024-09-18T05:13:15.193498+0000', 'modified': '2024-09-18T05:15:12.317644+0000', 'last_up_change': '2024-09-18T05:14:40.084281+0000', 'last_in_change': '2024-09-18T05:13:18.221936+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T05:13:28.629114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.904327392578125, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T05:13:34.103981+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.904327392578125, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T05:13:44.114945+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 41, 'snap_epoch': 87, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.904327392578125, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': 'a2a580f7-2bbc-46c3-b6b5-5a9e93539d27', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 82, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1558450642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1558450642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1558450642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1558450642}]}, 'public_addr': '172.21.15.17:6801/1558450642', 'cluster_addr': '172.21.15.17:6803/1558450642', 'heartbeat_back_addr': '172.21.15.17:6807/1558450642', 'heartbeat_front_addr': '172.21.15.17:6805/1558450642', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '260da429-e6eb-446b-95a0-dcf4581bb584', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 82, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3444575073}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3444575073}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3444575073}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3444575073}]}, 'public_addr': '172.21.15.17:6809/3444575073', 'cluster_addr': '172.21.15.17:6811/3444575073', 'heartbeat_back_addr': '172.21.15.17:6815/3444575073', 'heartbeat_front_addr': '172.21.15.17:6813/3444575073', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0cf5d53a-552d-4775-8437-86af3465b1bc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 467806624}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 467806624}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 467806624}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 467806624}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 467806624}]}, 'public_addr': '172.21.15.17:6817/467806624', 'cluster_addr': '172.21.15.17:6819/467806624', 'heartbeat_back_addr': '172.21.15.17:6823/467806624', 'heartbeat_front_addr': '172.21.15.17:6821/467806624', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '73bc18b6-4972-4164-a294-b6372bcf9f9d', 'up': 1, 'in': 1, 'weight': 0.7706451416015625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6824', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6825', 'nonce': 3763834627}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6826', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6827', 'nonce': 3763834627}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6830', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6831', 'nonce': 3763834627}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6828', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6829', 'nonce': 3763834627}]}, 'public_addr': '172.21.15.17:6825/3763834627', 'cluster_addr': '172.21.15.17:6827/3763834627', 'heartbeat_back_addr': '172.21.15.17:6831/3763834627', 'heartbeat_front_addr': '172.21.15.17:6829/3763834627', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '536c8ef2-eca6-44b4-a70c-06f191eb5ff1', 'up': 1, 'in': 1, 'weight': 0.838714599609375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6802', 'nonce': 1703780253}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6806', 'nonce': 1703780253}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6815', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 1703780253}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6809', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6812', 'nonce': 1703780253}]}, 'public_addr': '172.21.15.86:6802/1703780253', 'cluster_addr': '172.21.15.86:6806/1703780253', 'heartbeat_back_addr': '172.21.15.86:6819/1703780253', 'heartbeat_front_addr': '172.21.15.86:6812/1703780253', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4341bba4-2913-4352-89d4-36fa18ee39cb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.234619140625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 3348904742}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6813', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6816', 'nonce': 3348904742}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6823', 'nonce': 3348904742}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6817', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6820', 'nonce': 3348904742}]}, 'public_addr': '172.21.15.86:6811/3348904742', 'cluster_addr': '172.21.15.86:6816/3348904742', 'heartbeat_back_addr': '172.21.15.86:6823/3348904742', 'heartbeat_front_addr': '172.21.15.86:6820/3348904742', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e47d4aad-9c4b-43a9-9b32-2db463ec2a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 47, 'up_from': 61, 'up_thru': 79, 'down_at': 48, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6801', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 3446120186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6805', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 3446120186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 3446120186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6814', 'nonce': 3446120186}]}, 'public_addr': '172.21.15.86:6803/3446120186', 'cluster_addr': '172.21.15.86:6807/3446120186', 'heartbeat_back_addr': '172.21.15.86:6821/3446120186', 'heartbeat_front_addr': '172.21.15.86:6814/3446120186', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '686d275c-e592-44c1-87f9-ac9718f3a112', 'up': 1, 'in': 1, 'weight': 0.8923187255859375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 1345159853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6826', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 1345159853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6830', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 1345159853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6829', 'nonce': 1345159853}]}, 'public_addr': '172.21.15.86:6825/1345159853', 'cluster_addr': '172.21.15.86:6827/1345159853', 'heartbeat_back_addr': '172.21.15.86:6831/1345159853', 'heartbeat_front_addr': '172.21.15.86:6829/1345159853', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.758535+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.800715+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.783374+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.779519+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.893837+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.776852+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.919808+0000', 'dead_epoch': 48}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.883599+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.f', 'mappings': [{'from': 7, 'to': 3}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T05:15:13.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:15:13.371 INFO:teuthology.orchestra.run.smithi017.stdout:4918 trunc from 0xde78bae to 0x3ed3e6a 2024-09-18T05:15:13.371 INFO:teuthology.orchestra.run.smithi017.stdout:4920 read 0x3d4a20e thru 0x3d50328 (0x611b bytes) 2024-09-18T05:15:13.371 INFO:teuthology.orchestra.run.smithi017.stdout:4921 writesame 0x9f56521 thru 0x9f57205 data_size 0x1(0xce5 bytes) 2024-09-18T05:15:13.371 INFO:teuthology.orchestra.run.smithi017.stdout:4922 trunc from 0x9f57206 to 0x230cc2d 2024-09-18T05:15:13.372 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:13.362+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:13.372 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:13.372 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:13.372 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:13.373 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:13.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:13.413 INFO:teuthology.orchestra.run.smithi017.stdout:4923 writesame 0xaeb230f thru 0xaeba42f data_size 0x3(0x8121 bytes) 2024-09-18T05:15:13.413 INFO:teuthology.orchestra.run.smithi017.stdout:4924 read 0x6d2a9ab thru 0x6d30d7f (0x63d5 bytes) 2024-09-18T05:15:13.413 INFO:teuthology.orchestra.run.smithi017.stdout:4927 read 0xa8e37d6 thru 0xa8ee9c8 (0xb1f3 bytes) 2024-09-18T05:15:13.425 INFO:teuthology.orchestra.run.smithi017.stdout:4928 writesame 0xb2daa3c thru 0xb2e7168 data_size 0x1(0xc72d bytes) 2024-09-18T05:15:13.426 INFO:teuthology.orchestra.run.smithi017.stdout:4929 read 0x93343ca thru 0x9343506 (0xf13d bytes) 2024-09-18T05:15:13.426 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.426 INFO:teuthology.orchestra.run.smithi017.stdout:4933 write 0x83847f thru 0x8465fd (0xe17f bytes) 2024-09-18T05:15:13.428 INFO:teuthology.orchestra.run.smithi017.stdout:4934 write 0xa27ba39 thru 0xa2826d1 (0x6c99 bytes) 2024-09-18T05:15:13.434 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.437 INFO:teuthology.orchestra.run.smithi017.stdout:4938 trunc from 0xb2e7169 to 0x93a6286 2024-09-18T05:15:13.470 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:13.464+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:13.471 INFO:teuthology.orchestra.run.smithi017.stdout:4939 write 0xe135122 thru 0xe13920a (0x40e9 bytes) 2024-09-18T05:15:13.477 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.477 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.477 INFO:teuthology.orchestra.run.smithi017.stdout:4943 read 0x47e402f thru 0x47e997d (0x594f bytes) 2024-09-18T05:15:13.477 INFO:teuthology.orchestra.run.smithi017.stdout:4946 write 0x4de3768 thru 0x4de82cd (0x4b66 bytes) 2024-09-18T05:15:13.481 INFO:teuthology.orchestra.run.smithi017.stdout:4948 read 0xf5103f thru 0xf5a3b2 (0x9374 bytes) 2024-09-18T05:15:13.482 INFO:teuthology.orchestra.run.smithi017.stdout:4949 punch from 0x1dc8d52 to 0x1dd7176, (0xe424 bytes) 2024-09-18T05:15:13.482 INFO:teuthology.orchestra.run.smithi017.stdout:4952 write 0x3d48480 thru 0x3d4e9e7 (0x6568 bytes) 2024-09-18T05:15:13.487 INFO:teuthology.orchestra.run.smithi017.stdout:4954 read 0x5328289 thru 0x532e366 (0x60de bytes) 2024-09-18T05:15:13.487 INFO:teuthology.orchestra.run.smithi017.stdout:4956 write 0x5cf503e thru 0x5cf510e (0xd1 bytes) 2024-09-18T05:15:13.492 INFO:teuthology.orchestra.run.smithi017.stdout:4957 writesame 0x8f3c09d thru 0x8f453ad data_size 0x1(0x9311 bytes) 2024-09-18T05:15:13.518 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:13.518 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:13.518 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:13.518 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:13.518 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:13.523 INFO:teuthology.orchestra.run.smithi017.stdout:4959 punch from 0x9a055c4 to 0x9a0730a, (0x1d46 bytes) 2024-09-18T05:15:13.523 INFO:teuthology.orchestra.run.smithi017.stdout:4962 write 0xfcd168 thru 0xfdc7fc (0xf695 bytes) 2024-09-18T05:15:13.526 INFO:teuthology.orchestra.run.smithi017.stdout:4965 punch from 0xbaf71d1 to 0xbafe637, (0x7466 bytes) 2024-09-18T05:15:13.526 INFO:teuthology.orchestra.run.smithi017.stdout:4966 write 0x8166493 thru 0x8174a3b (0xe5a9 bytes) 2024-09-18T05:15:13.529 INFO:teuthology.orchestra.run.smithi017.stdout:4968 writesame 0x67ac58a thru 0x67b6e99 data_size 0x28(0xa910 bytes) 2024-09-18T05:15:13.531 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:13.536 INFO:teuthology.orchestra.run.smithi017.stdout:4970 write 0x7ff70db thru 0x7ffedc3 (0x7ce9 bytes) 2024-09-18T05:15:13.538 INFO:teuthology.orchestra.run.smithi017.stdout:4971 punch from 0x51cc723 to 0x51d6e72, (0xa74f bytes) 2024-09-18T05:15:13.538 INFO:teuthology.orchestra.run.smithi017.stdout:4972 read 0x4a402d5 thru 0x4a4a7f4 (0xa520 bytes) 2024-09-18T05:15:13.539 INFO:teuthology.orchestra.run.smithi017.stdout:4973 write 0xd1553c0 thru 0xd1617c7 (0xc408 bytes) 2024-09-18T05:15:13.542 INFO:teuthology.orchestra.run.smithi017.stdout:4974 write 0x11c6d4b thru 0x11c81ba (0x1470 bytes) 2024-09-18T05:15:13.544 INFO:teuthology.orchestra.run.smithi017.stdout:4976 read 0x8a80c58 thru 0x8a8d3b9 (0xc762 bytes) 2024-09-18T05:15:13.545 INFO:teuthology.orchestra.run.smithi017.stdout:4979 punch from 0x67c0943 to 0x67cfaa9, (0xf166 bytes) 2024-09-18T05:15:13.545 INFO:teuthology.orchestra.run.smithi017.stdout:4980 write 0xc7a4142 thru 0xc7ae3ae (0xa26d bytes) 2024-09-18T05:15:13.550 INFO:teuthology.orchestra.run.smithi017.stdout:4982 read 0x394508c thru 0x3951de6 (0xcd5b bytes) 2024-09-18T05:15:13.550 INFO:teuthology.orchestra.run.smithi017.stdout:4983 writesame 0xc26700e thru 0xc26b1b1 data_size 0x2(0x41a4 bytes) 2024-09-18T05:15:13.560 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.570 INFO:teuthology.orchestra.run.smithi017.stdout:4986 trunc from 0xe13920b to 0x66114f1 2024-09-18T05:15:13.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:13.566+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:13.586 INFO:teuthology.orchestra.run.smithi017.stdout:4987 read 0x140da2e thru 0x141b603 (0xdbd6 bytes) 2024-09-18T05:15:13.587 INFO:teuthology.orchestra.run.smithi017.stdout:4989 write 0x2ce51fd thru 0x2cf1830 (0xc634 bytes) 2024-09-18T05:15:13.591 INFO:teuthology.orchestra.run.smithi017.stdout:4990 write 0x47b0d58 thru 0x47b840c (0x76b5 bytes) 2024-09-18T05:15:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:4991 write 0xb6757b7 thru 0xb67ad3b (0x5585 bytes) 2024-09-18T05:15:13.613 INFO:teuthology.orchestra.run.smithi017.stdout:4992 write 0x4960d8d thru 0x49697c4 (0x8a38 bytes) 2024-09-18T05:15:13.617 INFO:teuthology.orchestra.run.smithi017.stdout:4993 write 0x7149762 thru 0x715330a (0x9ba9 bytes) 2024-09-18T05:15:13.621 INFO:teuthology.orchestra.run.smithi017.stdout:4994 read 0x58d22b5 thru 0x58dc5d8 (0xa324 bytes) 2024-09-18T05:15:13.622 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.622 INFO:teuthology.orchestra.run.smithi017.stdout:4996 read 0x16d32e0 thru 0x16da66e (0x738f bytes) 2024-09-18T05:15:13.622 INFO:teuthology.orchestra.run.smithi017.stdout:4997 writesame 0x354408d thru 0x354e36d data_size 0x9(0xa2e1 bytes) 2024-09-18T05:15:13.626 INFO:teuthology.orchestra.run.smithi017.stdout:4998 read 0xa86b49d thru 0xa86f4a8 (0x400c bytes) 2024-09-18T05:15:13.627 INFO:teuthology.orchestra.run.smithi017.stdout:5000 write 0x495d886 thru 0x4969adb (0xc256 bytes) 2024-09-18T05:15:13.630 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.630 INFO:teuthology.orchestra.run.smithi017.stdout:5003 writesame 0x9193db2 thru 0x91961d2 data_size 0x1(0x2421 bytes) 2024-09-18T05:15:13.639 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.639 INFO:teuthology.orchestra.run.smithi017.stdout:5005 read 0xa2003de thru 0xa200e56 (0xa79 bytes) 2024-09-18T05:15:13.640 INFO:teuthology.orchestra.run.smithi017.stdout:5006 writesame 0x6b7baa1 thru 0x6b8244a data_size 0x19(0x69aa bytes) 2024-09-18T05:15:13.642 INFO:teuthology.orchestra.run.smithi017.stdout:5007 punch from 0x11c4a49 to 0x11d35a9, (0xeb60 bytes) 2024-09-18T05:15:13.642 INFO:teuthology.orchestra.run.smithi017.stdout:5008 read 0x5f76420 thru 0x5f78c24 (0x2805 bytes) 2024-09-18T05:15:13.653 INFO:teuthology.orchestra.run.smithi017.stdout:5009 writesame 0xcb21b52 thru 0xcb243a0 data_size 0x1(0x284f bytes) 2024-09-18T05:15:13.654 INFO:teuthology.orchestra.run.smithi017.stdout:5010 writesame 0xa457207 thru 0xa4653b2 data_size 0x4(0xe1ac bytes) 2024-09-18T05:15:13.672 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:13.668+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:13.673 INFO:teuthology.orchestra.run.smithi017.stdout:5012 read 0x80786e5 thru 0x80883c6 (0xfce2 bytes) 2024-09-18T05:15:13.673 INFO:teuthology.orchestra.run.smithi017.stdout:5013 read 0x8117678 thru 0x811c0bf (0x4a48 bytes) 2024-09-18T05:15:13.684 INFO:teuthology.orchestra.run.smithi017.stdout:5014 trunc from 0xcb243a1 to 0x62ced45 2024-09-18T05:15:13.699 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:13.699 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:13.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:13.699 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:13.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:27144 3.e 3:72e631ab:::rbd_data.118b9f2c0487.000000000000003c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.234357381999999, 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053442387000000001, 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 27144 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462530+0000", 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999957 2024-09-18T05:15:13.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462560+0000", 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9933e-05 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462596+0000", 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5936000000000003e-05 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462621+0000", 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4644e-05 2024-09-18T05:15:13.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462748+0000", 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126892 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.463025+0000", 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027756100000000001 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.471585+0000", 2024-09-18T05:15:13.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085600780000000005 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515712+0000", 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.044127 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515824+0000", 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112002 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515915+0000", 2024-09-18T05:15:13.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0105999999999994e-05 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515977+0000", 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2521999999999995e-05 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36312 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.888331805999997, 2024-09-18T05:15:13.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050924795000000002, 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36312 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:13.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808562+0000", 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.522e-06 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808566+0000", 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0459999999999999e-06 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808569+0000", 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1580000000000001e-06 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859475+0000", 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050906734000000002 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859485+0000", 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6029999999999994e-06 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36313 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.888320647, 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050958802999999997, 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36313 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808573+0000", 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4720000000000001e-06 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808577+0000", 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9899999999999999e-06 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808581+0000", 2024-09-18T05:15:13.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.301e-06 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859521+0000", 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939971000000001 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859530+0000", 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3309999999999993e-06 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36314 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.888308465000001, 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050974481000000002, 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36314 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.714 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808583+0000", 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808585+0000", 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839999999999999e-06 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808589+0000", 2024-09-18T05:15:13.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0149999999999997e-06 2024-09-18T05:15:13.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808592+0000", 2024-09-18T05:15:13.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2100000000000002e-06 2024-09-18T05:15:13.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859552+0000", 2024-09-18T05:15:13.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050959971999999999 2024-09-18T05:15:13.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859558+0000", 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0809999999999999e-06 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37032 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 366592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.719 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749792134000003, 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050948475, 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37032 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:13.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:13.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947099+0000", 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947102+0000", 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3140000000000002e-06 2024-09-18T05:15:13.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947107+0000", 2024-09-18T05:15:13.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947112+0000", 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6500000000000004e-06 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997959+0000", 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050847106000000003 2024-09-18T05:15:13.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997999+0000", 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0049000000000002e-05 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998048+0000", 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9211e-05 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.730 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37033 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 376832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749765345999997, 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051119236999999998, 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37033 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947126+0000", 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947129+0000", 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5469999999999999e-06 2024-09-18T05:15:13.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947135+0000", 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5069999999999997e-06 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947140+0000", 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7350000000000004e-06 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998080+0000", 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939401000000002 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998158+0000", 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8753999999999998e-05 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998246+0000", 2024-09-18T05:15:13.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7682999999999994e-05 2024-09-18T05:15:13.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.736 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.737 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37034 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 387072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.737 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:13.737 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749748124, 2024-09-18T05:15:13.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05121883, 2024-09-18T05:15:13.737 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.737 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.738 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37034 2024-09-18T05:15:13.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:13.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947146+0000", 2024-09-18T05:15:13.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.12e-06 2024-09-18T05:15:13.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947152+0000", 2024-09-18T05:15:13.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8560000000000003e-06 2024-09-18T05:15:13.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947156+0000", 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5970000000000002e-06 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998271+0000", 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051114764 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998312+0000", 2024-09-18T05:15:13.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1258999999999999e-05 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998363+0000", 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0581999999999998e-05 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37035 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.743 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749731754000003, 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051399043999999998, 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37035 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:13.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:13.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:13.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947162+0000", 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1619999999999998e-06 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947168+0000", 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7640000000000002e-06 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947172+0000", 2024-09-18T05:15:13.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4750000000000004e-06 2024-09-18T05:15:13.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998394+0000", 2024-09-18T05:15:13.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051222202000000001 2024-09-18T05:15:13.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998472+0000", 2024-09-18T05:15:13.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7228e-05 2024-09-18T05:15:13.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998559+0000", 2024-09-18T05:15:13.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7699000000000002e-05 2024-09-18T05:15:13.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37036 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 407552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749716186999997, 2024-09-18T05:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051565297000000003, 2024-09-18T05:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.751 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.751 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.751 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.751 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.751 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37036 2024-09-18T05:15:13.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.751 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947178+0000", 2024-09-18T05:15:13.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0169999999999999e-06 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947183+0000", 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947188+0000", 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998583+0000", 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051394678999999999 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998661+0000", 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8631e-05 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998741+0000", 2024-09-18T05:15:13.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0054000000000003e-05 2024-09-18T05:15:13.756 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.756 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.756 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.756 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37037 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 417792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.756 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:13.756 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749699990000003, 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051746031999999997, 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37037 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:13.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947194+0000", 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1100000000000001e-06 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947200+0000", 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2530000000000001e-06 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947205+0000", 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8319999999999996e-06 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998775+0000", 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051569934999999997 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998850+0000", 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4783999999999994e-05 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998938+0000", 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8442999999999993e-05 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.762 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37038 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749682426, 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851468999999997, 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37038 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947209+0000", 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947212+0000", 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947218+0000", 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2319999999999998e-06 2024-09-18T05:15:13.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947223+0000", 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8590000000000004e-06 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998966+0000", 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051743193999999999 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999009+0000", 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999997e-05 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999061+0000", 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2216999999999998e-05 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37039 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749665282000002, 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052037513000000001, 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37039 2024-09-18T05:15:13.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.769 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:13.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947226+0000", 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947229+0000", 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.198e-06 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947235+0000", 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.319e-06 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947240+0000", 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7260000000000002e-06 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999092+0000", 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851928999999998 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999162+0000", 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0115000000000002e-05 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999264+0000", 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010256599999999999 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37040 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 448512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749646511999998, 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052135867000000002, 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.773 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37040 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:13.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947245+0000", 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947248+0000", 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4439999999999998e-06 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947256+0000", 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9410000000000007e-06 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947260+0000", 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999286+0000", 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052025350999999997 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999330+0000", 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4226e-05 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999381+0000", 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1529000000000001e-05 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.777 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37041 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 458752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749627216999997, 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052321965999999998, 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37041 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:13.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947275+0000", 2024-09-18T05:15:13.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0175e-05 2024-09-18T05:15:13.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947283+0000", 2024-09-18T05:15:13.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8660000000000006e-06 2024-09-18T05:15:13.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947287+0000", 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6369999999999998e-06 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999414+0000", 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052126541999999998 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999494+0000", 2024-09-18T05:15:13.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999587+0000", 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2795999999999997e-05 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37042 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.782 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749600387999998, 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052411412999999997, 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37042 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947291+0000", 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947294+0000", 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4559999999999999e-06 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947300+0000", 2024-09-18T05:15:13.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5189999999999998e-06 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947305+0000", 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9049999999999996e-06 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999614+0000", 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052308353000000002 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999653+0000", 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9879000000000002e-05 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999703+0000", 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9710999999999999e-05 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37043 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 479232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.787 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749578438, 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052588113999999998, 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37043 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947313+0000", 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947316+0000", 2024-09-18T05:15:13.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4059999999999999e-06 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947322+0000", 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2999999999999998e-06 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947327+0000", 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7119999999999999e-06 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999735+0000", 2024-09-18T05:15:13.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052408145000000003 2024-09-18T05:15:13.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999812+0000", 2024-09-18T05:15:13.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7540999999999995e-05 2024-09-18T05:15:13.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999902+0000", 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9413000000000006e-05 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37044 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 489472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:13.792 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749561249999999, 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052688817999999998, 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37044 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:13.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947333+0000", 2024-09-18T05:15:13.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.396e-06 2024-09-18T05:15:13.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947339+0000", 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947344+0000", 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9359999999999998e-06 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999929+0000", 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052584371999999997 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999969+0000", 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0315000000000003e-05 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000020+0000", 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0807000000000003e-05 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37045 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 499712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749543441, 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052875286000000001, 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.798 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37045 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947348+0000", 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947351+0000", 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3130000000000001e-06 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947357+0000", 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2040000000000002e-06 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947362+0000", 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9269999999999996e-06 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000054+0000", 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052691799999999997 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000133+0000", 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9134999999999994e-05 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000224+0000", 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1315000000000002e-05 2024-09-18T05:15:13.802 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37046 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749526087, 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052973012999999999, 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.803 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37046 2024-09-18T05:15:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947368+0000", 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3190000000000002e-06 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947374+0000", 2024-09-18T05:15:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1569999999999997e-06 2024-09-18T05:15:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947379+0000", 2024-09-18T05:15:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6949999999999999e-06 2024-09-18T05:15:13.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000250+0000", 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052870752999999999 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000291+0000", 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0975e-05 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000339+0000", 2024-09-18T05:15:13.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8511999999999999e-05 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37047 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.749509095999997, 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053159397999999997, 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:13.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37047 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947385+0000", 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3070000000000001e-06 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947391+0000", 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947396+0000", 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.921e-06 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000373+0000", 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052976957999999998 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000451+0000", 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8250000000000005e-05 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000542+0000", 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1242999999999994e-05 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:13.812 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:13.813 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:13.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:13.816 INFO:teuthology.orchestra.run.smithi017.stdout:5016 trunc from 0x62ced45 to 0x14541c1 2024-09-18T05:15:13.816 INFO:teuthology.orchestra.run.smithi017.stdout:5017 read 0x10b3635 thru 0x10b380a (0x1d6 bytes) 2024-09-18T05:15:13.816 INFO:teuthology.orchestra.run.smithi017.stdout:5018 read 0x819ee3 thru 0x82911e (0xf23c bytes) 2024-09-18T05:15:13.816 INFO:teuthology.orchestra.run.smithi017.stdout:5019 trunc from 0x14541c1 to 0xa4d1cc6 2024-09-18T05:15:13.816 INFO:teuthology.orchestra.run.smithi017.stdout:5020 punch from 0x824b4d2 to 0x824bee7, (0xa15 bytes) 2024-09-18T05:15:13.816 INFO:teuthology.orchestra.run.smithi017.stdout:5021 trunc from 0xa4d1cc6 to 0x6e91f00 2024-09-18T05:15:13.817 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:13.817 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:13.808+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:13.818 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:15:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:15:13.820 INFO:teuthology.orchestra.run.smithi017.stdout:5022 writesame 0x163c676 thru 0x164484c data_size 0x1(0x81d7 bytes) 2024-09-18T05:15:13.821 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-18T05:15:12.577919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1352040834,"num_objects":1604,"num_object_clones":426,"num_object_copies":3208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":646,"num_read":137160,"num_read_kb":812944,"num_write":15433,"num_write_kb":313264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":12034044,"num_keys_recovered":74,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12496,"ondisk_log_size":12496,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":354900,"kb_used_data":52276,"kb_used_omap":18,"kb_used_meta":302509,"kb_avail":754619820,"statfs":{"total":773094113280,"available":772730695680,"internally_reserved":0,"allocated":53530624,"data_stored":439847128,"data_compressed":26432128,"data_compressed_allocated":29147136,"data_compressed_original":422171544,"omap_allocated":19416,"internal_metadata":309769256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5341547,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":410,"num_read_kb":397,"num_write":151,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.275423"},"pg_stats":[{"pgid":"3.1f","version":"84'488","reported_seq":2003,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.403262+0000","last_change":"2024-09-18T05:13:47.874353+0000","last_active":"2024-09-18T05:15:07.403262+0000","last_peered":"2024-09-18T05:15:07.403262+0000","last_clean":"2024-09-18T05:15:07.403262+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:15:07.403262+0000","last_undegraded":"2024-09-18T05:15:07.403262+0000","last_fullsized":"2024-09-18T05:15:07.403262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002377985,"stat_sum":{"num_bytes":37554311,"num_objects":53,"num_object_clones":16,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":21,"num_read":2922,"num_read_kb":18568,"num_write":690,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"84'1142","reported_seq":5363,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.351288+0000","last_change":"2024-09-18T05:14:44.123599+0000","last_active":"2024-09-18T05:15:07.351288+0000","last_peered":"2024-09-18T05:15:07.351288+0000","last_clean":"2024-09-18T05:15:07.351288+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:15:07.351288+0000","last_undegraded":"2024-09-18T05:15:07.351288+0000","last_fullsized":"2024-09-18T05:15:07.351288+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1142,"log_dups_size":0,"ondisk_log_size":1142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001660138,"stat_sum":{"num_bytes":37442901,"num_objects":42,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":19,"num_read":9451,"num_read_kb":26560,"num_write":1833,"num_write_kb":10078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"84'289","reported_seq":1474,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.586201+0000","last_change":"2024-09-18T05:14:56.217541+0000","last_active":"2024-09-18T05:15:07.586201+0000","last_peered":"2024-09-18T05:15:07.586201+0000","last_clean":"2024-09-18T05:15:07.586201+0000","last_became_active":"2024-09-18T05:14:56.215359+0000","last_became_peered":"2024-09-18T05:14:56.215359+0000","last_unstale":"2024-09-18T05:15:07.586201+0000","last_undegraded":"2024-09-18T05:15:07.586201+0000","last_fullsized":"2024-09-18T05:15:07.586201+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:17:42.290269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080162099999999997,"stat_sum":{"num_bytes":19194124,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":23,"num_read":1590,"num_read_kb":17338,"num_write":327,"num_write_kb":8851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"84'681","reported_seq":3324,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.479135+0000","last_change":"2024-09-18T05:14:56.214792+0000","last_active":"2024-09-18T05:15:07.479135+0000","last_peered":"2024-09-18T05:15:07.479135+0000","last_clean":"2024-09-18T05:15:07.479135+0000","last_became_active":"2024-09-18T05:14:56.212214+0000","last_became_peered":"2024-09-18T05:14:56.212214+0000","last_unstale":"2024-09-18T05:15:07.479135+0000","last_undegraded":"2024-09-18T05:15:07.479135+0000","last_fullsized":"2024-09-18T05:15:07.479135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:41.658356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001443443,"stat_sum":{"num_bytes":66350732,"num_objects":68,"num_object_clones":17,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":27,"num_read":5750,"num_read_kb":27363,"num_write":949,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"84'280","reported_seq":1923,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.269698+0000","last_change":"2024-09-18T05:13:47.872985+0000","last_active":"2024-09-18T05:15:07.269698+0000","last_peered":"2024-09-18T05:15:07.269698+0000","last_clean":"2024-09-18T05:15:07.269698+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:15:07.269698+0000","last_undegraded":"2024-09-18T05:15:07.269698+0000","last_fullsized":"2024-09-18T05:15:07.269698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016154539999999999,"stat_sum":{"num_bytes":59338102,"num_objects":56,"num_object_clones":18,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":25,"num_read":2412,"num_read_kb":15616,"num_write":285,"num_write_kb":10689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"84'305","reported_seq":5140,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.569441+0000","last_change":"2024-09-18T05:13:47.881254+0000","last_active":"2024-09-18T05:15:07.569441+0000","last_peered":"2024-09-18T05:15:07.569441+0000","last_clean":"2024-09-18T05:15:07.569441+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:15:07.569441+0000","last_undegraded":"2024-09-18T05:15:07.569441+0000","last_fullsized":"2024-09-18T05:15:07.569441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091901600000000004,"stat_sum":{"num_bytes":51057927,"num_objects":58,"num_object_clones":16,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":18,"num_read":5045,"num_read_kb":39383,"num_write":321,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"78'301","reported_seq":4449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.381643+0000","last_change":"2024-09-18T05:13:47.880516+0000","last_active":"2024-09-18T05:15:05.381643+0000","last_peered":"2024-09-18T05:15:05.381643+0000","last_clean":"2024-09-18T05:15:05.381643+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:15:05.381643+0000","last_undegraded":"2024-09-18T05:15:05.381643+0000","last_fullsized":"2024-09-18T05:15:05.381643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042422500000000003,"stat_sum":{"num_bytes":44035132,"num_objects":47,"num_object_clones":14,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":16,"num_read":6102,"num_read_kb":17832,"num_write":283,"num_write_kb":14032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"83'450","reported_seq":1831,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.756880+0000","last_change":"2024-09-18T05:13:47.895130+0000","last_active":"2024-09-18T05:15:05.756880+0000","last_peered":"2024-09-18T05:15:05.756880+0000","last_clean":"2024-09-18T05:15:05.756880+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:15:05.756880+0000","last_undegraded":"2024-09-18T05:15:05.756880+0000","last_fullsized":"2024-09-18T05:15:05.756880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000585963,"stat_sum":{"num_bytes":41981430,"num_objects":51,"num_object_clones":17,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":25,"num_read":2391,"num_read_kb":18965,"num_write":564,"num_write_kb":7035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"84'429","reported_seq":6522,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.300953+0000","last_change":"2024-09-18T05:13:47.874514+0000","last_active":"2024-09-18T05:15:07.300953+0000","last_peered":"2024-09-18T05:15:07.300953+0000","last_clean":"2024-09-18T05:15:07.300953+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:15:07.300953+0000","last_undegraded":"2024-09-18T05:15:07.300953+0000","last_fullsized":"2024-09-18T05:15:07.300953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021885429999999998,"stat_sum":{"num_bytes":61455480,"num_objects":53,"num_object_clones":17,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":22,"num_read":7660,"num_read_kb":32347,"num_write":363,"num_write_kb":10003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"84'459","reported_seq":5501,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:06.634753+0000","last_change":"2024-09-18T05:13:47.888939+0000","last_active":"2024-09-18T05:15:06.634753+0000","last_peered":"2024-09-18T05:15:06.634753+0000","last_clean":"2024-09-18T05:15:06.634753+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:15:06.634753+0000","last_undegraded":"2024-09-18T05:15:06.634753+0000","last_fullsized":"2024-09-18T05:15:06.634753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081828800000000002,"stat_sum":{"num_bytes":60091490,"num_objects":55,"num_object_clones":14,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":21,"num_read":6773,"num_read_kb":40468,"num_write":507,"num_write_kb":11335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"75'336","reported_seq":6119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.334385+0000","last_change":"2024-09-18T05:13:47.875490+0000","last_active":"2024-09-18T05:15:05.334385+0000","last_peered":"2024-09-18T05:15:05.334385+0000","last_clean":"2024-09-18T05:15:05.334385+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:15:05.334385+0000","last_undegraded":"2024-09-18T05:15:05.334385+0000","last_fullsized":"2024-09-18T05:15:05.334385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068601800000000004,"stat_sum":{"num_bytes":65064613,"num_objects":55,"num_object_clones":15,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":19,"num_read":6233,"num_read_kb":44461,"num_write":417,"num_write_kb":18012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"77'310","reported_seq":1771,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:06.290028+0000","last_change":"2024-09-18T05:13:47.881467+0000","last_active":"2024-09-18T05:15:06.290028+0000","last_peered":"2024-09-18T05:15:06.290028+0000","last_clean":"2024-09-18T05:15:06.290028+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:15:06.290028+0000","last_undegraded":"2024-09-18T05:15:06.290028+0000","last_fullsized":"2024-09-18T05:15:06.290028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147750000000001,"stat_sum":{"num_bytes":40801982,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":24,"num_read":1852,"num_read_kb":14939,"num_write":343,"num_write_kb":6027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:06.351692+0000","last_change":"2024-09-18T05:15:02.605082+0000","last_active":"2024-09-18T05:15:06.351692+0000","last_peered":"2024-09-18T05:15:06.351692+0000","last_clean":"2024-09-18T05:15:06.351692+0000","last_became_active":"2024-09-18T05:15:02.604484+0000","last_became_peered":"2024-09-18T05:15:02.604484+0000","last_unstale":"2024-09-18T05:15:06.351692+0000","last_undegraded":"2024-09-18T05:15:06.351692+0000","last_fullsized":"2024-09-18T05:15:06.351692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:33:54.621609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"84'399","reported_seq":3080,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.483869+0000","last_change":"2024-09-18T05:13:47.873517+0000","last_active":"2024-09-18T05:15:07.483869+0000","last_peered":"2024-09-18T05:15:07.483869+0000","last_clean":"2024-09-18T05:15:07.483869+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:15:07.483869+0000","last_undegraded":"2024-09-18T05:15:07.483869+0000","last_fullsized":"2024-09-18T05:15:07.483869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019230849999999999,"stat_sum":{"num_bytes":35521906,"num_objects":48,"num_object_clones":10,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":19,"num_read":4205,"num_read_kb":27530,"num_write":571,"num_write_kb":11923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.286693+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:15:05.286693+0000","last_peered":"2024-09-18T05:15:05.286693+0000","last_clean":"2024-09-18T05:15:05.286693+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:15:05.286693+0000","last_undegraded":"2024-09-18T05:15:05.286693+0000","last_fullsized":"2024-09-18T05:15:05.286693+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"84'310","reported_seq":2321,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.410823+0000","last_change":"2024-09-18T05:13:47.897304+0000","last_active":"2024-09-18T05:15:07.410823+0000","last_peered":"2024-09-18T05:15:07.410823+0000","last_clean":"2024-09-18T05:15:07.410823+0000","last_became_active":"2024-09-18T05:13:45.882587+0000","last_became_peered":"2024-09-18T05:13:45.882587+0000","last_unstale":"2024-09-18T05:15:07.410823+0000","last_undegraded":"2024-09-18T05:15:07.410823+0000","last_fullsized":"2024-09-18T05:15:07.410823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:27:19.084581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021450010000000001,"stat_sum":{"num_bytes":43715762,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":16,"num_read":2889,"num_read_kb":31758,"num_write":368,"num_write_kb":9171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.291889+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:15:05.291889+0000","last_peered":"2024-09-18T05:15:05.291889+0000","last_clean":"2024-09-18T05:15:05.291889+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:15:05.291889+0000","last_undegraded":"2024-09-18T05:15:05.291889+0000","last_fullsized":"2024-09-18T05:15:05.291889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"84'221","reported_seq":3777,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.092101+0000","last_change":"2024-09-18T05:13:47.880769+0000","last_active":"2024-09-18T05:15:07.092101+0000","last_peered":"2024-09-18T05:15:07.092101+0000","last_clean":"2024-09-18T05:15:07.092101+0000","last_became_active":"2024-09-18T05:13:46.174136+0000","last_became_peered":"2024-09-18T05:13:46.174136+0000","last_unstale":"2024-09-18T05:15:07.092101+0000","last_undegraded":"2024-09-18T05:15:07.092101+0000","last_fullsized":"2024-09-18T05:15:07.092101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:52.243601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058757199999999996,"stat_sum":{"num_bytes":56472195,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":18,"num_read":3745,"num_read_kb":22686,"num_write":266,"num_write_kb":7077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.286543+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:15:05.286543+0000","last_peered":"2024-09-18T05:15:05.286543+0000","last_clean":"2024-09-18T05:15:05.286543+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:15:05.286543+0000","last_undegraded":"2024-09-18T05:15:05.286543+0000","last_fullsized":"2024-09-18T05:15:05.286543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"84'283","reported_seq":5274,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.460567+0000","last_change":"2024-09-18T05:14:56.207076+0000","last_active":"2024-09-18T05:15:07.460567+0000","last_peered":"2024-09-18T05:15:07.460567+0000","last_clean":"2024-09-18T05:15:07.460567+0000","last_became_active":"2024-09-18T05:14:56.206206+0000","last_became_peered":"2024-09-18T05:14:56.206206+0000","last_unstale":"2024-09-18T05:15:07.460567+0000","last_undegraded":"2024-09-18T05:15:07.460567+0000","last_fullsized":"2024-09-18T05:15:07.460567+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:21.659467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013457199999999999,"stat_sum":{"num_bytes":60269979,"num_objects":59,"num_object_clones":16,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":19,"num_read":5059,"num_read_kb":36818,"num_write":288,"num_write_kb":17681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"84'694","reported_seq":3354,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.482216+0000","last_change":"2024-09-18T05:13:47.881241+0000","last_active":"2024-09-18T05:15:07.482216+0000","last_peered":"2024-09-18T05:15:07.482216+0000","last_clean":"2024-09-18T05:15:07.482216+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:15:07.482216+0000","last_undegraded":"2024-09-18T05:15:07.482216+0000","last_fullsized":"2024-09-18T05:15:07.482216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087944100000000001,"stat_sum":{"num_bytes":78312323,"num_objects":62,"num_object_clones":19,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":23,"num_read":4898,"num_read_kb":36962,"num_write":1035,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.286641+0000","last_change":"2024-09-18T05:14:56.205729+0000","last_active":"2024-09-18T05:15:05.286641+0000","last_peered":"2024-09-18T05:15:05.286641+0000","last_clean":"2024-09-18T05:15:05.286641+0000","last_became_active":"2024-09-18T05:14:56.205340+0000","last_became_peered":"2024-09-18T05:14:56.205340+0000","last_unstale":"2024-09-18T05:15:05.286641+0000","last_undegraded":"2024-09-18T05:15:05.286641+0000","last_fullsized":"2024-09-18T05:15:05.286641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:02:33.068329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"84'307","reported_seq":3065,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.400543+0000","last_change":"2024-09-18T05:13:47.880771+0000","last_active":"2024-09-18T05:15:07.400543+0000","last_peered":"2024-09-18T05:15:07.400543+0000","last_clean":"2024-09-18T05:15:07.400543+0000","last_became_active":"2024-09-18T05:13:46.174696+0000","last_became_peered":"2024-09-18T05:13:46.174696+0000","last_unstale":"2024-09-18T05:15:07.400543+0000","last_undegraded":"2024-09-18T05:15:07.400543+0000","last_fullsized":"2024-09-18T05:15:07.400543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:04:21.805854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058553999999999995,"stat_sum":{"num_bytes":38996028,"num_objects":52,"num_object_clones":15,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":20,"num_read":3499,"num_read_kb":19116,"num_write":293,"num_write_kb":12167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.847076+0000","last_change":"2024-09-18T05:13:37.887642+0000","last_active":"2024-09-18T05:15:05.847076+0000","last_peered":"2024-09-18T05:15:05.847076+0000","last_clean":"2024-09-18T05:15:05.847076+0000","last_became_active":"2024-09-18T05:13:36.135298+0000","last_became_peered":"2024-09-18T05:13:36.135298+0000","last_unstale":"2024-09-18T05:15:05.847076+0000","last_undegraded":"2024-09-18T05:15:05.847076+0000","last_fullsized":"2024-09-18T05:15:05.847076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.310834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088184600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"84'216","reported_seq":1602,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:06.507473+0000","last_change":"2024-09-18T05:15:05.293810+0000","last_active":"2024-09-18T05:15:06.507473+0000","last_peered":"2024-09-18T05:15:06.507473+0000","last_clean":"2024-09-18T05:15:06.507473+0000","last_became_active":"2024-09-18T05:15:05.291649+0000","last_became_peered":"2024-09-18T05:15:05.291649+0000","last_unstale":"2024-09-18T05:15:06.507473+0000","last_undegraded":"2024-09-18T05:15:06.507473+0000","last_fullsized":"2024-09-18T05:15:06.507473+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:59.933767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014534350000000001,"stat_sum":{"num_bytes":7221791,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":19,"num_read":1448,"num_read_kb":3889,"num_write":246,"num_write_kb":3964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1107330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.292301+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:15:05.292301+0000","last_peered":"2024-09-18T05:15:05.292301+0000","last_clean":"2024-09-18T05:15:05.292301+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:15:05.292301+0000","last_undegraded":"2024-09-18T05:15:05.292301+0000","last_fullsized":"2024-09-18T05:15:05.292301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"84'353","reported_seq":3571,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.369459+0000","last_change":"2024-09-18T05:13:47.897422+0000","last_active":"2024-09-18T05:15:07.369459+0000","last_peered":"2024-09-18T05:15:07.369459+0000","last_clean":"2024-09-18T05:15:07.369459+0000","last_became_active":"2024-09-18T05:13:45.878063+0000","last_became_peered":"2024-09-18T05:13:45.878063+0000","last_unstale":"2024-09-18T05:15:07.369459+0000","last_undegraded":"2024-09-18T05:15:07.369459+0000","last_fullsized":"2024-09-18T05:15:07.369459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:53.493537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023719930000000002,"stat_sum":{"num_bytes":43677577,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":16,"num_read":5579,"num_read_kb":35056,"num_write":381,"num_write_kb":9299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.847010+0000","last_change":"2024-09-18T05:14:56.206107+0000","last_active":"2024-09-18T05:15:05.847010+0000","last_peered":"2024-09-18T05:15:05.847010+0000","last_clean":"2024-09-18T05:15:05.847010+0000","last_became_active":"2024-09-18T05:14:56.205631+0000","last_became_peered":"2024-09-18T05:14:56.205631+0000","last_unstale":"2024-09-18T05:15:05.847010+0000","last_undegraded":"2024-09-18T05:15:05.847010+0000","last_fullsized":"2024-09-18T05:15:05.847010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:17.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.292333+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:15:05.292333+0000","last_peered":"2024-09-18T05:15:05.292333+0000","last_clean":"2024-09-18T05:15:05.292333+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:15:05.292333+0000","last_undegraded":"2024-09-18T05:15:05.292333+0000","last_fullsized":"2024-09-18T05:15:05.292333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"84'254","reported_seq":4508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:06.494190+0000","last_change":"2024-09-18T05:15:05.295753+0000","last_active":"2024-09-18T05:15:06.494190+0000","last_peered":"2024-09-18T05:15:06.494190+0000","last_clean":"2024-09-18T05:15:06.494190+0000","last_became_active":"2024-09-18T05:15:05.292062+0000","last_became_peered":"2024-09-18T05:15:05.292062+0000","last_unstale":"2024-09-18T05:15:06.494190+0000","last_undegraded":"2024-09-18T05:15:06.494190+0000","last_fullsized":"2024-09-18T05:15:06.494190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:41:13.640268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001525368,"stat_sum":{"num_bytes":30921899,"num_objects":41,"num_object_clones":9,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":17,"num_read":5707,"num_read_kb":40756,"num_write":238,"num_write_kb":14246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":8331478,"num_keys_recovered":21,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'189","reported_seq":2528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.069455+0000","last_change":"2024-09-18T05:13:47.880748+0000","last_active":"2024-09-18T05:15:07.069455+0000","last_peered":"2024-09-18T05:15:07.069455+0000","last_clean":"2024-09-18T05:15:07.069455+0000","last_became_active":"2024-09-18T05:13:46.177331+0000","last_became_peered":"2024-09-18T05:13:46.177331+0000","last_unstale":"2024-09-18T05:15:07.069455+0000","last_undegraded":"2024-09-18T05:15:07.069455+0000","last_fullsized":"2024-09-18T05:15:07.069455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:38:10.519505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044114000000000002,"stat_sum":{"num_bytes":41061148,"num_objects":49,"num_object_clones":16,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":18,"num_read":2432,"num_read_kb":26142,"num_write":206,"num_write_kb":4603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'278","reported_seq":1916,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-18T05:15:08.391699+0000","last_change":"2024-09-18T05:14:44.126112+0000","last_active":"2024-09-18T05:15:08.391699+0000","last_peered":"2024-09-18T05:15:08.391699+0000","last_clean":"2024-09-18T05:15:08.391699+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:15:08.391699+0000","last_undegraded":"2024-09-18T05:15:08.391699+0000","last_fullsized":"2024-09-18T05:15:08.391699+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070131499999999999,"stat_sum":{"num_bytes":26075063,"num_objects":38,"num_object_clones":10,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":15,"num_read":2251,"num_read_kb":16508,"num_write":286,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"78'211","reported_seq":1943,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-18T05:15:05.284917+0000","last_change":"2024-09-18T05:13:47.896719+0000","last_active":"2024-09-18T05:15:05.284917+0000","last_peered":"2024-09-18T05:15:05.284917+0000","last_clean":"2024-09-18T05:15:05.284917+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:15:05.284917+0000","last_undegraded":"2024-09-18T05:15:05.284917+0000","last_fullsized":"2024-09-18T05:15:05.284917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001766786,"stat_sum":{"num_bytes":28270747,"num_objects":46,"num_object_clones":14,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":16,"num_read":1740,"num_read_kb":19095,"num_write":194,"num_write_kb":3664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"84'353","reported_seq":3698,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.446487+0000","last_change":"2024-09-18T05:14:56.208556+0000","last_active":"2024-09-18T05:15:07.446487+0000","last_peered":"2024-09-18T05:15:07.446487+0000","last_clean":"2024-09-18T05:15:07.446487+0000","last_became_active":"2024-09-18T05:14:56.206142+0000","last_became_peered":"2024-09-18T05:14:56.206142+0000","last_unstale":"2024-09-18T05:15:07.446487+0000","last_undegraded":"2024-09-18T05:15:07.446487+0000","last_fullsized":"2024-09-18T05:15:07.446487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:17:28.830425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011236919999999999,"stat_sum":{"num_bytes":36824363,"num_objects":50,"num_object_clones":15,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":21,"num_read":4014,"num_read_kb":27231,"num_write":438,"num_write_kb":7263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"84'241","reported_seq":964,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.525106+0000","last_change":"2024-09-18T05:13:47.875657+0000","last_active":"2024-09-18T05:15:07.525106+0000","last_peered":"2024-09-18T05:15:07.525106+0000","last_clean":"2024-09-18T05:15:07.525106+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:15:07.525106+0000","last_undegraded":"2024-09-18T05:15:07.525106+0000","last_fullsized":"2024-09-18T05:15:07.525106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070575100000000001,"stat_sum":{"num_bytes":24915447,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":14,"num_read":1489,"num_read_kb":13502,"num_write":248,"num_write_kb":11285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"84'427","reported_seq":3991,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.485171+0000","last_change":"2024-09-18T05:13:47.875757+0000","last_active":"2024-09-18T05:15:07.485171+0000","last_peered":"2024-09-18T05:15:07.485171+0000","last_clean":"2024-09-18T05:15:07.485171+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:15:07.485171+0000","last_undegraded":"2024-09-18T05:15:07.485171+0000","last_fullsized":"2024-09-18T05:15:07.485171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066626200000000004,"stat_sum":{"num_bytes":57230139,"num_objects":68,"num_object_clones":16,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":33,"num_read":5123,"num_read_kb":31589,"num_write":459,"num_write_kb":2902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"84'390","reported_seq":7400,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:06.634191+0000","last_change":"2024-09-18T05:14:15.877993+0000","last_active":"2024-09-18T05:15:06.634191+0000","last_peered":"2024-09-18T05:15:06.634191+0000","last_clean":"2024-09-18T05:15:06.634191+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:15:06.634191+0000","last_undegraded":"2024-09-18T05:15:06.634191+0000","last_fullsized":"2024-09-18T05:15:06.634191+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072282800000000001,"stat_sum":{"num_bytes":34846276,"num_objects":52,"num_object_clones":11,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":20,"num_read":8168,"num_read_kb":33926,"num_write":394,"num_write_kb":15021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"85'372","reported_seq":1490,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-18T05:15:08.903497+0000","last_change":"2024-09-18T05:14:41.123716+0000","last_active":"2024-09-18T05:15:08.903497+0000","last_peered":"2024-09-18T05:15:08.903497+0000","last_clean":"2024-09-18T05:15:08.903497+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:15:08.903497+0000","last_undegraded":"2024-09-18T05:15:08.903497+0000","last_fullsized":"2024-09-18T05:15:08.903497+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060322900000000005,"stat_sum":{"num_bytes":37806783,"num_objects":48,"num_object_clones":11,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":21,"num_read":3798,"num_read_kb":25804,"num_write":511,"num_write_kb":7233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"84'249","reported_seq":3155,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.482177+0000","last_change":"2024-09-18T05:13:47.875315+0000","last_active":"2024-09-18T05:15:07.482177+0000","last_peered":"2024-09-18T05:15:07.482177+0000","last_clean":"2024-09-18T05:15:07.482177+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:15:07.482177+0000","last_undegraded":"2024-09-18T05:15:07.482177+0000","last_fullsized":"2024-09-18T05:15:07.482177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000619883,"stat_sum":{"num_bytes":31376910,"num_objects":36,"num_object_clones":9,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":14,"num_read":3879,"num_read_kb":15641,"num_write":267,"num_write_kb":5995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"83'494","reported_seq":2233,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:07.479746+0000","last_change":"2024-09-18T05:13:47.873548+0000","last_active":"2024-09-18T05:15:07.479746+0000","last_peered":"2024-09-18T05:15:07.479746+0000","last_clean":"2024-09-18T05:15:07.479746+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:15:07.479746+0000","last_undegraded":"2024-09-18T05:15:07.479746+0000","last_fullsized":"2024-09-18T05:15:07.479746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025716760000000002,"stat_sum":{"num_bytes":34336745,"num_objects":53,"num_object_clones":15,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":24,"num_read":4230,"num_read_kb":13848,"num_write":624,"num_write_kb":6699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"78'665","reported_seq":2294,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-18T05:15:06.630464+0000","last_change":"2024-09-18T05:13:47.875357+0000","last_active":"2024-09-18T05:15:06.630464+0000","last_peered":"2024-09-18T05:15:06.630464+0000","last_clean":"2024-09-18T05:15:06.630464+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:15:06.630464+0000","last_undegraded":"2024-09-18T05:15:06.630464+0000","last_fullsized":"2024-09-18T05:15:06.630464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063229599999999996,"stat_sum":{"num_bytes":19229142,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":23,"num_read":4710,"num_read_kb":21147,"num_write":1077,"num_write_kb":8216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1351450447,"num_objects":1600,"num_object_clones":426,"num_object_copies":3200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1600,"num_whiteouts":646,"num_read":137044,"num_read_kb":812844,"num_write":15272,"num_write_kb":310846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":12034044,"num_keys_recovered":74,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46821376,"data_stored":438713383,"data_compressed":26653975,"data_compressed_allocated":29421568,"data_compressed_original":423822232,"omap_allocated":2648,"internal_metadata":0},"log_size":12376,"ondisk_log_size":12376,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35340,"kb_used_data":8320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336500,"statfs":{"total":96636764160,"available":96600576000,"internally_reserved":0,"allocated":8519680,"data_stored":73308246,"data_compressed":4520573,"data_compressed_allocated":5054464,"data_compressed_original":70682739,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.755},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.626}]},{"osd":2,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.64700000000000002}]},{"osd":3,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.9980000000000002,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.68600000000000005}]},{"osd":4,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":0.38500000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":6,"up_from":61,"seq":261993005063,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30572,"kb_used_data":2340,"kb_used_omap":8,"kb_used_meta":28215,"kb_avail":94341268,"statfs":{"total":96636764160,"available":96605458432,"internally_reserved":0,"allocated":2396160,"data_stored":14177854,"data_compressed":758134,"data_compressed_allocated":847872,"data_compressed_original":13297621,"omap_allocated":8265,"internal_metadata":28893111},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51480,"kb_used_data":8072,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94320360,"statfs":{"total":96636764160,"available":96584048640,"internally_reserved":0,"allocated":8265728,"data_stored":69233840,"data_compressed":4339145,"data_compressed_allocated":4726784,"data_compressed_original":66650913,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.78200000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":1.026}]},{"osd":3,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.2549999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.876},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":7,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1639999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58652,"kb_used_data":9492,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94313188,"statfs":{"total":96636764160,"available":96576704512,"internally_reserved":0,"allocated":9719808,"data_stored":79594450,"data_compressed":5012027,"data_compressed_allocated":5500928,"data_compressed_original":76482720,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.0669999999999999}]},{"osd":2,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.96299999999999997}]},{"osd":3,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.64300000000000002}]},{"osd":5,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":7,"last update":"Wed Sep 18 05:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.03}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57708,"kb_used_data":8544,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94314132,"statfs":{"total":96636764160,"available":96577671168,"internally_reserved":0,"allocated":8749056,"data_stored":73981351,"data_compressed":4443255,"data_compressed_allocated":4947968,"data_compressed_original":71032851,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.98199999999999998}]},{"osd":1,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":1.379}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":1.246},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.2150000000000001}]},{"osd":4,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.133},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":1.321}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37660,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334180,"statfs":{"total":96636764160,"available":96598200320,"internally_reserved":0,"allocated":2506752,"data_stored":15461170,"data_compressed":883386,"data_compressed_allocated":831488,"data_compressed_original":14410912,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.3979999999999997,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.58499999999999996}]},{"osd":1,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.57599999999999996}]},{"osd":3,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.83699999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.82399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44756,"kb_used_data":5452,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94327084,"statfs":{"total":96636764160,"available":96590934016,"internally_reserved":0,"allocated":5582848,"data_stored":49862761,"data_compressed":2875289,"data_compressed_allocated":3022848,"data_compressed_original":47992128,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.246},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.372}]},{"osd":3,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.501}]},{"osd":5,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Sep 18 05:14:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.60899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38732,"kb_used_data":7608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94333108,"statfs":{"total":96636764160,"available":96597102592,"internally_reserved":0,"allocated":7790592,"data_stored":64227456,"data_compressed":3600319,"data_compressed_allocated":4214784,"data_compressed_original":61621660,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.45900000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.26100000000000001}]},{"osd":3,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.30499999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.5990000000000002,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.877}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6983680,"data_stored":64069208,"data_compressed":3601650,"data_compressed_allocated":4231168,"data_compressed_original":61777308,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4960256,"data_stored":50277540,"data_compressed":2983478,"data_compressed_allocated":3145728,"data_compressed_original":48631104,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1732608,"data_stored":15224476,"data_compressed":884747,"data_compressed_allocated":835584,"data_compressed_original":14439584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7860224,"data_stored":74011463,"data_compressed":4462800,"data_compressed_allocated":4976640,"data_compressed_original":71446547,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8843264,"data_stored":79769625,"data_compressed":5119416,"data_compressed_allocated":5615616,"data_compressed_original":77105312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7479296,"data_stored":69291963,"data_compressed":4356583,"data_compressed_allocated":4759552,"data_compressed_original":67015457,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1454080,"data_stored":13766111,"data_compressed":758134,"data_compressed_allocated":847872,"data_compressed_original":13297621,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7507968,"data_stored":72302997,"data_compressed":4487167,"data_compressed_allocated":5009408,"data_compressed_original":70109299,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:15:13.825 INFO:tasks.thrashosds.thrasher:Setting 3.2 to [1, 5] 2024-09-18T05:15:13.825 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.2', '1', '5'] 2024-09-18T05:15:13.825 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.2 1 5 2024-09-18T05:15:13.826 INFO:teuthology.orchestra.run.smithi017.stdout:5023 read 0x4e3a303 thru 0x4e4a193 (0xfe91 bytes) 2024-09-18T05:15:13.826 INFO:teuthology.orchestra.run.smithi017.stdout:5024 write 0x4494fa0 thru 0x4496638 (0x1699 bytes) 2024-09-18T05:15:13.826 INFO:teuthology.orchestra.run.smithi017.stdout:5025 punch from 0x6392723 to 0x639c859, (0xa136 bytes) 2024-09-18T05:15:13.826 INFO:teuthology.orchestra.run.smithi017.stdout:5026 trunc from 0x6e91f00 to 0x8e5c899 2024-09-18T05:15:13.837 INFO:teuthology.orchestra.run.smithi017.stdout:5027 trunc from 0x8e5c899 to 0xec6ac01 2024-09-18T05:15:13.845 INFO:teuthology.orchestra.run.smithi017.stdout:5028 read 0xcbcb6f8 thru 0xcbcd65e (0x1f67 bytes) 2024-09-18T05:15:13.845 INFO:teuthology.orchestra.run.smithi017.stdout:5029 write 0xba70c21 thru 0xba76380 (0x5760 bytes) 2024-09-18T05:15:13.853 INFO:teuthology.orchestra.run.smithi017.stdout:5030 punch from 0x58eebe7 to 0x58f5705, (0x6b1e bytes) 2024-09-18T05:15:13.853 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.853 INFO:teuthology.orchestra.run.smithi017.stdout:5032 punch from 0x8e264c9 to 0x8e34db1, (0xe8e8 bytes) 2024-09-18T05:15:13.853 INFO:teuthology.orchestra.run.smithi017.stdout:5034 punch from 0x36a1621 to 0x36b0442, (0xee21 bytes) 2024-09-18T05:15:13.853 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.853 INFO:teuthology.orchestra.run.smithi017.stdout:5038 read 0xaf90eaa thru 0xaf9334f (0x24a6 bytes) 2024-09-18T05:15:13.854 INFO:teuthology.orchestra.run.smithi017.stdout:5039 write 0x493cbbb thru 0x4947a87 (0xaecd bytes) 2024-09-18T05:15:13.860 INFO:teuthology.orchestra.run.smithi017.stdout:5040 write 0xb95a7d5 thru 0xb95ef5c (0x4788 bytes) 2024-09-18T05:15:13.867 INFO:teuthology.orchestra.run.smithi017.stdout:5042 punch from 0x5c70d8a to 0x5c7e160, (0xd3d6 bytes) 2024-09-18T05:15:13.867 INFO:teuthology.orchestra.run.smithi017.stdout:5044 read 0x6eb23cc thru 0x6ebda3b (0xb670 bytes) 2024-09-18T05:15:13.867 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.869 INFO:teuthology.orchestra.run.smithi017.stdout:5047 trunc from 0xec6ac01 to 0xd9f6817 2024-09-18T05:15:13.877 INFO:teuthology.orchestra.run.smithi017.stdout:5050 writesame 0x3e9c09a thru 0x3ea58f3 data_size 0x1(0x985a bytes) 2024-09-18T05:15:13.900 INFO:teuthology.orchestra.run.smithi017.stdout:5051 read 0x650f2b4 thru 0x651c6b5 (0xd402 bytes) 2024-09-18T05:15:13.901 INFO:teuthology.orchestra.run.smithi017.stdout:5052 read 0x33a25ec thru 0x33a882e (0x6243 bytes) 2024-09-18T05:15:13.901 INFO:teuthology.orchestra.run.smithi017.stdout:5053 read 0xc06159a thru 0xc067ddf (0x6846 bytes) 2024-09-18T05:15:13.901 INFO:teuthology.orchestra.run.smithi017.stdout:5056 write 0x8b03697 thru 0x8b0b6dd (0x8047 bytes) 2024-09-18T05:15:13.905 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.905 INFO:teuthology.orchestra.run.smithi017.stdout:5059 punch from 0x8d3ab1c to 0x8d46181, (0xb665 bytes) 2024-09-18T05:15:13.905 INFO:teuthology.orchestra.run.smithi017.stdout:5061 write 0xbd98dbb thru 0xbda07cb (0x7a11 bytes) 2024-09-18T05:15:13.909 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.909 INFO:teuthology.orchestra.run.smithi017.stdout:5064 write 0x57283a4 thru 0x572f8c4 (0x7521 bytes) 2024-09-18T05:15:13.914 INFO:teuthology.orchestra.run.smithi017.stdout:5065 trunc from 0xd9f6817 to 0xed28112 2024-09-18T05:15:13.915 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:13.908+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:13.922 INFO:teuthology.orchestra.run.smithi017.stdout:5066 write 0x89b8d2f thru 0x89c4070 (0xb342 bytes) 2024-09-18T05:15:13.929 INFO:teuthology.orchestra.run.smithi017.stdout:5069 read 0xe5adeb2 thru 0xe5b4eee (0x703d bytes) 2024-09-18T05:15:13.929 INFO:teuthology.orchestra.run.smithi017.stdout:5070 write 0xd218749 thru 0xd221f0d (0x97c5 bytes) 2024-09-18T05:15:13.932 INFO:teuthology.orchestra.run.smithi017.stdout:5071 read 0x40deb20 thru 0x40e62fd (0x77de bytes) 2024-09-18T05:15:13.936 INFO:teuthology.orchestra.run.smithi017.stdout:5073 trunc from 0xed28112 to 0xce33a2c 2024-09-18T05:15:13.946 INFO:teuthology.orchestra.run.smithi017.stdout:5074 punch from 0x1b25797 to 0x1b2b762, (0x5fcb bytes) 2024-09-18T05:15:13.948 INFO:teuthology.orchestra.run.smithi017.stdout:5075 trunc from 0xce33a2c to 0xbfd9301 2024-09-18T05:15:13.962 INFO:teuthology.orchestra.run.smithi017.stdout:5076 write 0x49ffbb9 thru 0x4a0864f (0x8a97 bytes) 2024-09-18T05:15:13.969 INFO:teuthology.orchestra.run.smithi017.stdout:5077 read 0x33ca64e thru 0x33cc19c (0x1b4f bytes) 2024-09-18T05:15:13.969 INFO:teuthology.orchestra.run.smithi017.stdout:5078 write 0x3b92e5e thru 0x3b98e0b (0x5fae bytes) 2024-09-18T05:15:13.974 INFO:teuthology.orchestra.run.smithi017.stdout:5079 write 0x572803 thru 0x573d2c (0x152a bytes) 2024-09-18T05:15:13.976 INFO:teuthology.orchestra.run.smithi017.stdout:5081 write 0x99bcba0 thru 0x99bdd2d (0x118e bytes) 2024-09-18T05:15:13.978 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:13.985 INFO:teuthology.orchestra.run.smithi017.stdout:5084 trunc from 0xbfd9301 to 0x79b4d1a 2024-09-18T05:15:13.990 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:14.001 INFO:teuthology.orchestra.run.smithi017.stdout:5085 write 0x4e29db thru 0x4e831b (0x5941 bytes) 2024-09-18T05:15:14.002 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:14.002 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:14.003 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:14.003 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:14.003 INFO:teuthology.orchestra.run.smithi017.stdout:5086 clone 39 order 22 su 65536 sc 7 2024-09-18T05:15:14.009 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:14.010 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:14.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:14.017 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:14.010+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:14.025 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:14.026 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:14.042 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:14.042 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:14.061 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:14.062 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:14.081 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:14.081 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:14.101 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:14.101 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:14.117 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:14.118 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:14.118 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:14.112+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:14.178 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:14.179 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:14.192 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:14.236 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:14.232+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:14.320 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:14.314+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:set 3.2 pg_upmap mapping to [1,5] 2024-09-18T05:15:14.354 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:14.354 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:14.366 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:15:14.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:14.427 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:14.422+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:14.451 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone38 from 0x79b4d1a (overlap 0x2c8e70) to 0xd5dee 2024-09-18T05:15:14.521 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:14.514+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:14.548 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:14.548 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:14.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:14.646 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:14.642+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:14.724 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:14.720+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:14.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:14.824 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:14.820+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:14.884 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:15:14.906 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:14.906 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:14.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:14.962 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:14.958+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:15.026 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:15.020+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:15.085 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:15.085 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:15.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:15.127 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:15.120+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:15.218 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:15.218 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:15.228 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:15.222+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:15.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:15.329 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:15.322+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:15.402 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:15.403 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:15.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:15.430 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:15.428+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:15.531 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:15.526+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:15.581 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:15.582 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:15.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:15:15.638 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:15.634+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:15.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:15.726+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:15.764 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:15.764 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:15.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:15:15.834 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:15.832+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:15.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:15.930+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:15.964 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:15.964 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:15.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:16.036 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:16.032+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:16.071 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-18T05:15:16.134 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:16.136 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:16.132+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:16.163 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:16.163 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:16.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:16.270 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:16.266+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:16.290 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:16.291 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:16.324 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:16.324 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:16.338 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:16.332+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:16.342 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:16.342 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:16.360 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:16.361 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:16.361 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:16.361 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:16.361 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:16.361 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:16.361 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:16.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:16.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:16.385 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:16.386 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:16.386 INFO:teuthology.orchestra.run.smithi017.stdout:5088 read 0x21b839a thru 0x21b9d62 (0x19c9 bytes) 2024-09-18T05:15:16.388 INFO:teuthology.orchestra.run.smithi017.stdout:5091 write 0x1aa6708 thru 0x1aa9e94 (0x378d bytes) 2024-09-18T05:15:16.404 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:16.405 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:16.421 INFO:teuthology.orchestra.run.smithi017.stdout:5092 trunc from 0x79b4d1a to 0x1f91660 2024-09-18T05:15:16.428 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:16.428 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:16.439 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:16.432+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:16.465 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:16.481 INFO:teuthology.orchestra.run.smithi017.stdout:5093 trunc from 0x1f91660 to 0x1f74d6d 2024-09-18T05:15:16.492 INFO:teuthology.orchestra.run.smithi017.stdout:5094 read 0x266a3e thru 0x26815d (0x1720 bytes) 2024-09-18T05:15:16.493 INFO:teuthology.orchestra.run.smithi017.stdout:5096 read 0x2c21a8 thru 0x2c7ed7 (0x5d30 bytes) 2024-09-18T05:15:16.518 INFO:teuthology.orchestra.run.smithi017.stdout:5097 write 0xb357e0c thru 0xb367846 (0xfa3b bytes) 2024-09-18T05:15:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:5098 write 0x645ca9e thru 0x6460c04 (0x4167 bytes) 2024-09-18T05:15:16.533 INFO:teuthology.orchestra.run.smithi017.stdout:5102 writesame 0xb1f8fe thru 0xb20c94 data_size 0x11(0x1397 bytes) 2024-09-18T05:15:16.537 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.624157061000005, 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.538 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:16.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:15:16.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.542 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.624126118000007, 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.543 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.624100553999995, 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:15:16.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.551 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.624075837999996, 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:15:16.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.624049604000007, 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.556 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:15:16.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:15:16.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.624020694999999, 2024-09-18T05:15:16.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:15:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.623996864999995, 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:15:16.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:15:16.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.623972389000002, 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.569 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:15:16.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.623854589999993, 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.577 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.620862634999995, 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:15:16.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:15:16.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.620784572999995, 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:15:16.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:15:16.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.586 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.620753285999996, 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:15:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:15:16.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.620727273, 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:15:16.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:15:16.598 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.620699500000001, 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:15:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:15:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:15:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:15:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.603 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.620674437000005, 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:15:16.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.620649407000002, 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.612 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.616525078999999, 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:15:16.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.616504534000001, 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:16.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:15:16.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:16.621 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.616484851999999, 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:15:16.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:15:16.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.348413405000002, 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.626 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:15:16.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:16.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:15:16.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:15:16.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:16.632 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:16.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:16.635 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:16.635 INFO:teuthology.orchestra.run.smithi017.stdout:5104 write 0x47c7801 thru 0x47cae99 (0x3699 bytes) 2024-09-18T05:15:16.635 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:16.635 INFO:teuthology.orchestra.run.smithi017.stdout:5106 read 0x8395952 thru 0x8398428 (0x2ad7 bytes) 2024-09-18T05:15:16.635 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:16.635 INFO:teuthology.orchestra.run.smithi017.stdout:5110 punch from 0x194ca52 to 0x1955220, (0x87ce bytes) 2024-09-18T05:15:16.635 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:16.635 INFO:teuthology.orchestra.run.smithi017.stdout:5113 write 0xa18eda2 thru 0xa190714 (0x1973 bytes) 2024-09-18T05:15:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:5114 write 0x1598725 thru 0x159b7c5 (0x30a1 bytes) 2024-09-18T05:15:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:5115 trunc from 0xb367847 to 0xb80dbf5 2024-09-18T05:15:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:5116 write 0x19f13e0 thru 0x19f7ef9 (0x6b1a bytes) 2024-09-18T05:15:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:5117 write 0x8fed38e thru 0x8ff3c18 (0x688b bytes) 2024-09-18T05:15:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:5118 trunc from 0xb80dbf5 to 0x71febe6 2024-09-18T05:15:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:5120 writesame 0x2e882d thru 0x2f3a94 data_size 0x84(0xb268 bytes) 2024-09-18T05:15:16.636 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:16.626+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:16.653 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:16.672 INFO:teuthology.orchestra.run.smithi017.stdout:5124 write 0x90b1298 thru 0x90b3ce2 (0x2a4b bytes) 2024-09-18T05:15:16.683 INFO:teuthology.orchestra.run.smithi017.stdout:5126 clone 40 order 23 su 65536 sc 13 2024-09-18T05:15:16.735 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:16.728+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:16.766 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:16.767 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:16.767 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:16.767 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:16.780 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:16.868 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:16.864+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:16.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:15:16.936 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:16.932+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:16.949 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:16.949 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:16.949 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:16.949 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:16.950 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:16.966 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:17.037 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:17.030+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:17.038 INFO:teuthology.orchestra.run.smithi017.stdout:flattening image image_client.0-clone39 2024-09-18T05:15:17.135 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:17.135 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:17.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:17.135 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:17.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.135 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.135 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:17.135 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383636235000001, 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:17.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:15:17.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383627245, 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383618278, 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:15:17.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:17.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383609495000002, 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:17.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:15:17.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:15:17.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383600719, 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:17.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:15:17.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383590427000001, 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.38357654, 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.161 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:17.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:15:17.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383567333999999, 2024-09-18T05:15:17.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:15:17.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:15:17.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383558636, 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:15:17.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383549571, 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:17.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:15:17.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383526213, 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:15:17.178 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:15:17.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383516547999999, 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:15:17.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:15:17.186 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383490191, 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.187 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383476658999999, 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.191 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:15:17.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:15:17.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383465208000001, 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:15:17.195 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:15:17.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.199 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383455727000001, 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:15:17.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:15:17.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:15:17.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.204 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:17.205 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383445644999998, 2024-09-18T05:15:17.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:15:17.205 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.205 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.205 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:15:17.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.212 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383436557, 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.213 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:15:17.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383427000000001, 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.217 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:15:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:15:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.383418179, 2024-09-18T05:15:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.225 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:17.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:17.227 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:17.222+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:17.250 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-18T05:15:17.256 INFO:teuthology.orchestra.run.smithi017.stdout:5128 read 0xc63a1e thru 0xc63ff9 (0x5dc bytes) 2024-09-18T05:15:17.257 INFO:teuthology.orchestra.run.smithi017.stdout:5129 write 0x7d922bb thru 0x7d9661c (0x4362 bytes) 2024-09-18T05:15:17.268 INFO:teuthology.orchestra.run.smithi017.stdout:5130 write 0x44d28fd thru 0x44d75a9 (0x4cad bytes) 2024-09-18T05:15:17.328 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:17.322+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:17.355 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:17.355 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:17.355 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:17.355 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:17.369 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:17.428 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:17.424+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:17.491 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:17.491 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:17.491 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:17.491 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:17.491 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:17.505 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:17.529 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:17.522+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:17.630 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:17.624+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:17.675 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:17.675 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:17.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:17.675 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:17.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.675 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.675 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:17.675 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010820956000003, 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:17.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010754038000002, 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:17.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:17.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010665527999997, 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:17.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:17.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010614971999999, 2024-09-18T05:15:17.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:17.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010551857000003, 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:17.696 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010504937, 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010451058000001, 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010403924999999, 2024-09-18T05:15:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010356303000002, 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010233481999997, 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010152152000003, 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010080909000003, 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.010030698000001, 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.009953504000002, 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.009903633999997, 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.009829062999998, 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.009763284999998, 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.009716249, 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.009654156000003, 2024-09-18T05:15:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.009607776999999, 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:17.761 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:17.762 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:17.762 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:17.756+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:17.863 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:17.858+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:17.898 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:15:17.918 INFO:teuthology.orchestra.run.smithi017.stdout:5131 read 0x63bbb85 thru 0x63ca084 (0xe500 bytes) 2024-09-18T05:15:17.918 INFO:teuthology.orchestra.run.smithi017.stdout:5132 read 0x53209d3 thru 0x53238d7 (0x2f05 bytes) 2024-09-18T05:15:17.919 INFO:teuthology.orchestra.run.smithi017.stdout:5134 read 0x39d7bdd thru 0x39e3d18 (0xc13c bytes) 2024-09-18T05:15:17.919 INFO:teuthology.orchestra.run.smithi017.stdout:5135 read 0x13405fc thru 0x1344daa (0x47af bytes) 2024-09-18T05:15:17.920 INFO:teuthology.orchestra.run.smithi017.stdout:5136 read 0x56582b9 thru 0x565b607 (0x334f bytes) 2024-09-18T05:15:17.921 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:17.921 INFO:teuthology.orchestra.run.smithi017.stdout:5140 write 0x64f32d7 thru 0x64f9608 (0x6332 bytes) 2024-09-18T05:15:17.935 INFO:teuthology.orchestra.run.smithi017.stdout:5141 read 0x385686e thru 0x3861938 (0xb0cb bytes) 2024-09-18T05:15:17.935 INFO:teuthology.orchestra.run.smithi017.stdout:5143 read 0x67a7843 thru 0x67adb0b (0x62c9 bytes) 2024-09-18T05:15:17.935 INFO:teuthology.orchestra.run.smithi017.stdout:5144 writesame 0x8b46881 thru 0x8b49d93 data_size 0x7(0x3513 bytes) 2024-09-18T05:15:17.937 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:17.937 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:17.937 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:17.937 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:17.943 INFO:teuthology.orchestra.run.smithi017.stdout:5146 punch from 0x1a63dfd to 0x1a72e79, (0xf07c bytes) 2024-09-18T05:15:17.945 INFO:teuthology.orchestra.run.smithi017.stdout:5147 trunc from 0x90b3ce3 to 0x9d84927 2024-09-18T05:15:17.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:5148 clone 41 order 19 su 32768 sc 11 2024-09-18T05:15:17.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:17.958+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:18.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:18.058+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:18.074 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:18.074 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:18.074 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:18.075 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:18.075 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:18.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:18.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:18.162+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:18.215 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:27144 3.e 3:72e631ab:::rbd_data.118b9f2c0487.000000000000003c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 66.749219463000003, 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053442387000000001, 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 27144 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462530+0000", 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999957 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462560+0000", 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9933e-05 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462596+0000", 2024-09-18T05:15:18.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5936000000000003e-05 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462621+0000", 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4644e-05 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462748+0000", 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126892 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.463025+0000", 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027756100000000001 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.471585+0000", 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085600780000000005 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515712+0000", 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.044127 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515824+0000", 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112002 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515915+0000", 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0105999999999994e-05 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515977+0000", 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2521999999999995e-05 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.221 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36312 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.403193887, 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050924795000000002, 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36312 2024-09-18T05:15:18.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808562+0000", 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.522e-06 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808566+0000", 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0459999999999999e-06 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808569+0000", 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1580000000000001e-06 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859475+0000", 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050906734000000002 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859485+0000", 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6029999999999994e-06 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.225 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36313 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.403182727999997, 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050958802999999997, 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36313 2024-09-18T05:15:18.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808573+0000", 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4720000000000001e-06 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808577+0000", 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9899999999999999e-06 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808581+0000", 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.301e-06 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859521+0000", 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939971000000001 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859530+0000", 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3309999999999993e-06 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36314 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.403170545999998, 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050974481000000002, 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36314 2024-09-18T05:15:18.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808583+0000", 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808585+0000", 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839999999999999e-06 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808589+0000", 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0149999999999997e-06 2024-09-18T05:15:18.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808592+0000", 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2100000000000002e-06 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859552+0000", 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050959971999999999 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859558+0000", 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0809999999999999e-06 2024-09-18T05:15:18.233 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37032 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 366592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264654215, 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050948475, 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.234 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37032 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947099+0000", 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947102+0000", 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3140000000000002e-06 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947107+0000", 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947112+0000", 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6500000000000004e-06 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997959+0000", 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050847106000000003 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997999+0000", 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0049000000000002e-05 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998048+0000", 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9211e-05 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37033 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 376832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264627427000001, 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051119236999999998, 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.238 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37033 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:18.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947126+0000", 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947129+0000", 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5469999999999999e-06 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947135+0000", 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5069999999999997e-06 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947140+0000", 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7350000000000004e-06 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998080+0000", 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939401000000002 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998158+0000", 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8753999999999998e-05 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998246+0000", 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7682999999999994e-05 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37034 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 387072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.242 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264610204999997, 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05121883, 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37034 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:18.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947146+0000", 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.12e-06 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947152+0000", 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8560000000000003e-06 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947156+0000", 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5970000000000002e-06 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998271+0000", 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051114764 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998312+0000", 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1258999999999999e-05 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998363+0000", 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0581999999999998e-05 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.246 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37035 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264593834999999, 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051399043999999998, 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37035 2024-09-18T05:15:18.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947162+0000", 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1619999999999998e-06 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947168+0000", 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7640000000000002e-06 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947172+0000", 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4750000000000004e-06 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998394+0000", 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051222202000000001 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998472+0000", 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7228e-05 2024-09-18T05:15:18.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998559+0000", 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7699000000000002e-05 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37036 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 407552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264578268000001, 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051565297000000003, 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.251 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37036 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947178+0000", 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0169999999999999e-06 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947183+0000", 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947188+0000", 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998583+0000", 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051394678999999999 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998661+0000", 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8631e-05 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998741+0000", 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0054000000000003e-05 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.255 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37037 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 417792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264562071, 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051746031999999997, 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37037 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:18.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947194+0000", 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1100000000000001e-06 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947200+0000", 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2530000000000001e-06 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947205+0000", 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8319999999999996e-06 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998775+0000", 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051569934999999997 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998850+0000", 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4783999999999994e-05 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998938+0000", 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8442999999999993e-05 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.259 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37038 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264544506999997, 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851468999999997, 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37038 2024-09-18T05:15:18.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947209+0000", 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947212+0000", 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947218+0000", 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2319999999999998e-06 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947223+0000", 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8590000000000004e-06 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998966+0000", 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051743193999999999 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999009+0000", 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999997e-05 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999061+0000", 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2216999999999998e-05 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37039 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264527362999999, 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052037513000000001, 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37039 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:18.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947226+0000", 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947229+0000", 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.198e-06 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947235+0000", 2024-09-18T05:15:18.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.319e-06 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947240+0000", 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7260000000000002e-06 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999092+0000", 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851928999999998 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999162+0000", 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0115000000000002e-05 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999264+0000", 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010256599999999999 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37040 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 448512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:18.268 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264508593000002, 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052135867000000002, 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37040 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947245+0000", 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947248+0000", 2024-09-18T05:15:18.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4439999999999998e-06 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947256+0000", 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9410000000000007e-06 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947260+0000", 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999286+0000", 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052025350999999997 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999330+0000", 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4226e-05 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999381+0000", 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1529000000000001e-05 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.272 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37041 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 458752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264489298000001, 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052321965999999998, 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37041 2024-09-18T05:15:18.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947275+0000", 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0175e-05 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947283+0000", 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8660000000000006e-06 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947287+0000", 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6369999999999998e-06 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999414+0000", 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052126541999999998 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999494+0000", 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:18.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999587+0000", 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2795999999999997e-05 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37042 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264462469000001, 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052411412999999997, 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.277 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37042 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947291+0000", 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947294+0000", 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4559999999999999e-06 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947300+0000", 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5189999999999998e-06 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947305+0000", 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9049999999999996e-06 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999614+0000", 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052308353000000002 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999653+0000", 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9879000000000002e-05 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999703+0000", 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9710999999999999e-05 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.281 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37043 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 479232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264440518999997, 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052588113999999998, 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37043 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947313+0000", 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947316+0000", 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4059999999999999e-06 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947322+0000", 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2999999999999998e-06 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947327+0000", 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7119999999999999e-06 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999735+0000", 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052408145000000003 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999812+0000", 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7540999999999995e-05 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999902+0000", 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9413000000000006e-05 2024-09-18T05:15:18.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37044 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 489472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264423331000003, 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052688817999999998, 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37044 2024-09-18T05:15:18.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947333+0000", 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.396e-06 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947339+0000", 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947344+0000", 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9359999999999998e-06 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999929+0000", 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052584371999999997 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999969+0000", 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0315000000000003e-05 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000020+0000", 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0807000000000003e-05 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37045 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 499712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264405521999997, 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052875286000000001, 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.290 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37045 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:18.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947348+0000", 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947351+0000", 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3130000000000001e-06 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947357+0000", 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2040000000000002e-06 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947362+0000", 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9269999999999996e-06 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000054+0000", 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052691799999999997 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000133+0000", 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9134999999999994e-05 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000224+0000", 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1315000000000002e-05 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37046 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.294 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264388167999996, 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052973012999999999, 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37046 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:18.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947368+0000", 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3190000000000002e-06 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947374+0000", 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1569999999999997e-06 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947379+0000", 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6949999999999999e-06 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000250+0000", 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052870752999999999 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000291+0000", 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0975e-05 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000339+0000", 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8511999999999999e-05 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.298 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37047 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.264371177000001, 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053159397999999997, 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37047 2024-09-18T05:15:18.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:18.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947385+0000", 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3070000000000001e-06 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947391+0000", 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947396+0000", 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.921e-06 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000373+0000", 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052976957999999998 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000451+0000", 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8250000000000005e-05 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:18.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:18.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:18.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000542+0000", 2024-09-18T05:15:18.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1242999999999994e-05 2024-09-18T05:15:18.303 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.303 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.303 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.303 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:18.303 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:18.303 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:18.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:18.305 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:18.298+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:18.406 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:18.400+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:18.430 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:18.430 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:18.430 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:18.430 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:18.444 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:18.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:18.532 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:18.528+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:18.607 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:18.602+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:18.609 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:18.609 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:18.609 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:18.609 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:18.609 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:18.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:18.649 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:18.649 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:18.662 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:18.662 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:18.679 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:18.696 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:18.696 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:18.712 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:18.708+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:18.716 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:18.734 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:18.734 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:18.753 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:18.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:18.774 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:18.785 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:18.786 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:18.800 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:18.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:18.830+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:18.910 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:18.904+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:18.970 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:18.971 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:18.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:19.019 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone40 from 0x9d84927 (overlap 0x90b3ce3) to 0x4859e71 2024-09-18T05:15:19.019 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:19.014+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:19.111 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:19.106+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:19.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:19.228 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-18T05:15:19.228 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:19.222+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:19.313 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:19.308+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:19.343 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:19.380 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-18T05:15:19.380 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:15:19.380 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-18T05:15:19.380 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T05:15:19.380 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T05:15:19.381 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-18T05:15:19.428 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:19.424+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:19.509 INFO:teuthology.orchestra.run.smithi017.stdout:5149 write 0x40b381a thru 0x40ba8fe (0x70e5 bytes) 2024-09-18T05:15:19.510 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:19.510 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "" 2024-09-18T05:15:19.510 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:19.511 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:19.511 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:19.515 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:19.508+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:19.527 INFO:teuthology.orchestra.run.smithi017.stdout:5150 punch from 0x1b477ae to 0x1b55fdc, (0xe82e bytes) 2024-09-18T05:15:19.527 INFO:teuthology.orchestra.run.smithi017.stdout:5151 write 0x64caeb9 thru 0x64d257a (0x76c2 bytes) 2024-09-18T05:15:19.529 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:19.534 INFO:teuthology.orchestra.run.smithi017.stdout:5153 read 0xe4f062 thru 0xe5e8fa (0xf899 bytes) 2024-09-18T05:15:19.534 INFO:teuthology.orchestra.run.smithi017.stdout:5154 write 0x71fde09 thru 0x7206123 (0x831b bytes) 2024-09-18T05:15:19.542 INFO:teuthology.orchestra.run.smithi017.stdout:5155 read 0x9d78981 thru 0x9d7eba2 (0x6222 bytes) 2024-09-18T05:15:19.542 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:19.542 INFO:teuthology.orchestra.run.smithi017.stdout:5158 writesame 0x565daaf thru 0x5660d98 data_size 0x13(0x32ea bytes) 2024-09-18T05:15:19.549 INFO:teuthology.orchestra.run.smithi017.stdout:5159 read 0x2bbd8fd thru 0x2bc236d (0x4a71 bytes) 2024-09-18T05:15:19.549 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:19.564 INFO:teuthology.orchestra.run.smithi017.stdout:5161 write 0xeb78683 thru 0xeb864bc (0xde3a bytes) 2024-09-18T05:15:19.572 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:19.572 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:19.590 INFO:teuthology.orchestra.run.smithi017.stdout:5166 trunc from 0xeb864bd to 0x356dd9e 2024-09-18T05:15:19.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:19.610+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:19.643 INFO:teuthology.orchestra.run.smithi017.stdout:5167 read 0x15cba80 thru 0x15cf900 (0x3e81 bytes) 2024-09-18T05:15:19.643 INFO:teuthology.orchestra.run.smithi017.stdout:5168 punch from 0x21c9359 to 0x21d17ea, (0x8491 bytes) 2024-09-18T05:15:19.652 INFO:teuthology.orchestra.run.smithi017.stdout:5169 trunc from 0x356dd9e to 0x8929929 2024-09-18T05:15:19.666 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:19.666 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:19.667 INFO:teuthology.orchestra.run.smithi017.stdout:5170 trunc from 0x8929929 to 0xb925090 2024-09-18T05:15:19.680 INFO:teuthology.orchestra.run.smithi017.stdout:5171 write 0x36d3698 thru 0x36df805 (0xc16e bytes) 2024-09-18T05:15:19.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:19.683 INFO:teuthology.orchestra.run.smithi017.stdout:5172 read 0x757013b thru 0x757be89 (0xbd4f bytes) 2024-09-18T05:15:19.683 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:19.683 INFO:teuthology.orchestra.run.smithi017.stdout:5177 read 0x3cf999 thru 0x3d209d (0x2705 bytes) 2024-09-18T05:15:19.684 INFO:teuthology.orchestra.run.smithi017.stdout:5178 read 0x8b40db8 thru 0x8b4d709 (0xc952 bytes) 2024-09-18T05:15:19.684 INFO:teuthology.orchestra.run.smithi017.stdout:5179 write 0x5197253 thru 0x51a4248 (0xcff6 bytes) 2024-09-18T05:15:19.705 INFO:teuthology.orchestra.run.smithi017.stdout:5180 trunc from 0xb925090 to 0x60d21d3 2024-09-18T05:15:19.716 INFO:teuthology.orchestra.run.smithi017.stdout:5181 read 0xfcf00c thru 0xfda8c0 (0xb8b5 bytes) 2024-09-18T05:15:19.717 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:19.710+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:19.717 INFO:teuthology.orchestra.run.smithi017.stdout:5184 write 0x3926f1a thru 0x392c545 (0x562c bytes) 2024-09-18T05:15:19.726 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:19.733 INFO:teuthology.orchestra.run.smithi017.stdout:5186 trunc from 0x60d21d3 to 0xa1255de 2024-09-18T05:15:19.744 INFO:teuthology.orchestra.run.smithi017.stdout:5188 read 0x785330f thru 0x785fade (0xc7d0 bytes) 2024-09-18T05:15:19.765 INFO:teuthology.orchestra.run.smithi017.stdout:5189 write 0xe7a368a thru 0xe7a9345 (0x5cbc bytes) 2024-09-18T05:15:19.774 INFO:teuthology.orchestra.run.smithi017.stdout:5190 write 0x23a3d60 thru 0x23ad3e2 (0x9683 bytes) 2024-09-18T05:15:19.785 INFO:teuthology.orchestra.run.smithi017.stdout:5191 read 0xaa96c1f thru 0xaaa6a8d (0xfe6f bytes) 2024-09-18T05:15:19.786 INFO:teuthology.orchestra.run.smithi017.stdout:5192 writesame 0x9687aad thru 0x9695bbd data_size 0x1(0xe111 bytes) 2024-09-18T05:15:19.808 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:19.808 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:19.817 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:19.810+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:19.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:19.836 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:19.836 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:19.836 INFO:teuthology.orchestra.run.smithi017.stdout:5195 punch from 0x2b3975 to 0x2b9400, (0x5a8b bytes) 2024-09-18T05:15:19.836 INFO:teuthology.orchestra.run.smithi017.stdout:5197 read 0xd42216a thru 0xd42c511 (0xa3a8 bytes) 2024-09-18T05:15:19.836 INFO:teuthology.orchestra.run.smithi017.stdout:5198 punch from 0x9b8218d to 0x9b91321, (0xf194 bytes) 2024-09-18T05:15:19.836 INFO:teuthology.orchestra.run.smithi017.stdout:5200 read 0xe3f1d92 thru 0xe3fc53a (0xa7a9 bytes) 2024-09-18T05:15:19.853 INFO:teuthology.orchestra.run.smithi017.stdout:5201 trunc from 0xe7a9346 to 0x7152fe2 2024-09-18T05:15:19.878 INFO:teuthology.orchestra.run.smithi017.stdout:5205 read 0x2b49a89 thru 0x2b4ede8 (0x5360 bytes) 2024-09-18T05:15:19.879 INFO:teuthology.orchestra.run.smithi017.stdout:5207 writesame 0x4f8eb69 thru 0x4f9d0ad data_size 0x1(0xe545 bytes) 2024-09-18T05:15:19.918 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:19.914+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:19.920 INFO:teuthology.orchestra.run.smithi017.stdout:5210 writesame 0x751d575 thru 0x752bc32 data_size 0xb(0xe6be bytes) 2024-09-18T05:15:19.930 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:15:19.935 INFO:teuthology.orchestra.run.smithi017.stdout:5211 write 0x82a4f4e thru 0x82ad555 (0x8608 bytes) 2024-09-18T05:15:19.951 INFO:teuthology.orchestra.run.smithi017.stdout:5212 trunc from 0x82ad556 to 0x3d71600 2024-09-18T05:15:19.964 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:19.964 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:19.973 INFO:teuthology.orchestra.run.smithi017.stdout:5213 read 0x2f60fa2 thru 0x2f6c688 (0xb6e7 bytes) 2024-09-18T05:15:19.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:15:20.005 INFO:teuthology.orchestra.run.smithi017.stdout:5214 write 0xe136449 thru 0xe138f2b (0x2ae3 bytes) 2024-09-18T05:15:20.012 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.012 INFO:teuthology.orchestra.run.smithi017.stdout:5218 write 0x28872dc thru 0x28972c1 (0xffe6 bytes) 2024-09-18T05:15:20.019 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:20.012+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:20.029 INFO:teuthology.orchestra.run.smithi017.stdout:5219 read 0xb94aa42 thru 0xb9542b1 (0x9870 bytes) 2024-09-18T05:15:20.030 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.031 INFO:teuthology.orchestra.run.smithi017.stdout:5222 trunc from 0xe138f2c to 0xd3395ff 2024-09-18T05:15:20.051 INFO:teuthology.orchestra.run.smithi017.stdout:5223 punch from 0x10a39eb to 0x10ae525, (0xab3a bytes) 2024-09-18T05:15:20.051 INFO:teuthology.orchestra.run.smithi017.stdout:5224 write 0xa1e3bdd thru 0xa1e73ed (0x3811 bytes) 2024-09-18T05:15:20.057 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.057 INFO:teuthology.orchestra.run.smithi017.stdout:5226 writesame 0x14c2b7b thru 0x14cec5e data_size 0xa(0xc0e4 bytes) 2024-09-18T05:15:20.071 INFO:teuthology.orchestra.run.smithi017.stdout:5227 writesame 0x27a32b7 thru 0x27a3486 data_size 0x8(0x1d0 bytes) 2024-09-18T05:15:20.081 INFO:teuthology.orchestra.run.smithi017.stdout:5228 write 0x62972f6 thru 0x629dab3 (0x67be bytes) 2024-09-18T05:15:20.087 INFO:teuthology.orchestra.run.smithi017.stdout:5229 read 0x972d24 thru 0x9790d0 (0x63ad bytes) 2024-09-18T05:15:20.092 INFO:teuthology.orchestra.run.smithi017.stdout:5230 trunc from 0xd3395ff to 0xa522787 2024-09-18T05:15:20.104 INFO:teuthology.orchestra.run.smithi017.stdout:5232 write 0x786b166 thru 0x787198a (0x6825 bytes) 2024-09-18T05:15:20.113 INFO:teuthology.orchestra.run.smithi017.stdout:5235 write 0x90f18e7 thru 0x90f598f (0x40a9 bytes) 2024-09-18T05:15:20.119 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:20.116+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:20.125 INFO:teuthology.orchestra.run.smithi017.stdout:5238 trunc from 0xa522787 to 0xe328b24 2024-09-18T05:15:20.137 INFO:teuthology.orchestra.run.smithi017.stdout:5239 read 0x766edb1 thru 0x7678000 (0x9250 bytes) 2024-09-18T05:15:20.137 INFO:teuthology.orchestra.run.smithi017.stdout:5240 write 0x44bc020 thru 0x44be667 (0x2648 bytes) 2024-09-18T05:15:20.138 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:20.138 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:20.144 INFO:teuthology.orchestra.run.smithi017.stdout:5241 punch from 0x7237c3d to 0x723f0f4, (0x74b7 bytes) 2024-09-18T05:15:20.144 INFO:teuthology.orchestra.run.smithi017.stdout:5242 punch from 0xde31daf to 0xde3dacd, (0xbd1e bytes) 2024-09-18T05:15:20.144 INFO:teuthology.orchestra.run.smithi017.stdout:5243 punch from 0xd73f80f to 0xd746c38, (0x7429 bytes) 2024-09-18T05:15:20.144 INFO:teuthology.orchestra.run.smithi017.stdout:5245 read 0x3749e47 thru 0x37563be (0xc578 bytes) 2024-09-18T05:15:20.144 INFO:teuthology.orchestra.run.smithi017.stdout:5246 punch from 0x7ce5412 to 0x7cebb58, (0x6746 bytes) 2024-09-18T05:15:20.144 INFO:teuthology.orchestra.run.smithi017.stdout:5247 write 0xb044b77 thru 0xb04ba44 (0x6ece bytes) 2024-09-18T05:15:20.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:15:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:5248 trunc from 0xe328b24 to 0xaf344f 2024-09-18T05:15:20.218 INFO:teuthology.orchestra.run.smithi017.stdout:5249 read 0x86b0c6 thru 0x873b97 (0x8ad2 bytes) 2024-09-18T05:15:20.220 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:20.214+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:20.231 INFO:teuthology.orchestra.run.smithi017.stdout:5250 write 0x2193462 thru 0x21a20bd (0xec5c bytes) 2024-09-18T05:15:20.265 INFO:teuthology.orchestra.run.smithi017.stdout:5251 write 0x935ef0a thru 0x936a721 (0xb818 bytes) 2024-09-18T05:15:20.276 INFO:teuthology.orchestra.run.smithi017.stdout:5252 write 0x78f2af8 thru 0x78f345b (0x964 bytes) 2024-09-18T05:15:20.283 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.283 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.290 INFO:teuthology.orchestra.run.smithi017.stdout:5257 trunc from 0x936a722 to 0xdbfc4d4 2024-09-18T05:15:20.301 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:20.302 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:20.303 INFO:teuthology.orchestra.run.smithi017.stdout:5258 writesame 0xae27e49 thru 0xae298c4 data_size 0xf(0x1a7c bytes) 2024-09-18T05:15:20.313 INFO:teuthology.orchestra.run.smithi017.stdout:5262 writesame 0x2c3a5d8 thru 0x2c46bd6 data_size 0xd(0xc5ff bytes) 2024-09-18T05:15:20.318 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:20.323 INFO:teuthology.orchestra.run.smithi017.stdout:5263 writesame 0xbf6a8d6 thru 0xbf6fe8c data_size 0x1(0x55b7 bytes) 2024-09-18T05:15:20.323 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:20.318+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:20.353 INFO:teuthology.orchestra.run.smithi017.stdout:5264 writesame 0xa8642ae thru 0xa86f5a3 data_size 0x1(0xb2f6 bytes) 2024-09-18T05:15:20.399 INFO:teuthology.orchestra.run.smithi017.stdout:5266 punch from 0xa41cfb8 to 0xa42a457, (0xd49f bytes) 2024-09-18T05:15:20.399 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.416 INFO:teuthology.orchestra.run.smithi017.stdout:5269 trunc from 0xdbfc4d4 to 0x239e8ef 2024-09-18T05:15:20.422 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:20.416+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:20.447 INFO:teuthology.orchestra.run.smithi017.stdout:5273 read 0x2198ea2 thru 0x219925e (0x3bd bytes) 2024-09-18T05:15:20.448 INFO:teuthology.orchestra.run.smithi017.stdout:5274 punch from 0x150cf28 to 0x15168ac, (0x9984 bytes) 2024-09-18T05:15:20.448 INFO:teuthology.orchestra.run.smithi017.stdout:5276 writesame 0x1898a64 thru 0x189c160 data_size 0x1(0x36fd bytes) 2024-09-18T05:15:20.448 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:20.448 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:20.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:20.465 INFO:teuthology.orchestra.run.smithi017.stdout:5277 punch from 0x1d4aadf to 0x1d4ab35, (0x56 bytes) 2024-09-18T05:15:20.493 INFO:teuthology.orchestra.run.smithi017.stdout:5278 write 0xc790116 thru 0xc7913ac (0x1297 bytes) 2024-09-18T05:15:20.515 INFO:teuthology.orchestra.run.smithi017.stdout:5279 write 0xe383d4e thru 0xe3934a8 (0xf75b bytes) 2024-09-18T05:15:20.523 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:20.516+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:20.529 INFO:teuthology.orchestra.run.smithi017.stdout:5281 writesame 0x8aab8e8 thru 0x8ab6ae5 data_size 0x1(0xb1fe bytes) 2024-09-18T05:15:20.569 INFO:teuthology.orchestra.run.smithi017.stdout:5282 write 0x46e7163 thru 0x46eff50 (0x8dee bytes) 2024-09-18T05:15:20.578 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.599 INFO:teuthology.orchestra.run.smithi017.stdout:5284 trunc from 0xe3934a9 to 0x1625447 2024-09-18T05:15:20.617 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:20.617 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:20.623 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:20.620+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:20.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:20.663 INFO:teuthology.orchestra.run.smithi017.stdout:5285 write 0x8191325 thru 0x81a04ee (0xf1ca bytes) 2024-09-18T05:15:20.673 INFO:teuthology.orchestra.run.smithi017.stdout:5286 write 0x4f2d4d0 thru 0x4f3b4c3 (0xdff4 bytes) 2024-09-18T05:15:20.682 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.682 INFO:teuthology.orchestra.run.smithi017.stdout:5289 write 0x507e03 thru 0x5139d7 (0xbbd5 bytes) 2024-09-18T05:15:20.699 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.703 INFO:teuthology.orchestra.run.smithi017.stdout:5291 trunc from 0x81a04ef to 0xa842395 2024-09-18T05:15:20.715 INFO:teuthology.orchestra.run.smithi017.stdout:5292 writesame 0x6efedb9 thru 0x6f0ab0f data_size 0x6b(0xbd57 bytes) 2024-09-18T05:15:20.724 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:20.720+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:20.734 INFO:teuthology.orchestra.run.smithi017.stdout:5294 trunc from 0xa842395 to 0x5e5a256 2024-09-18T05:15:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:5296 trunc from 0x5e5a256 to 0x929ef5 2024-09-18T05:15:20.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:20.807 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:20.807 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:20.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:20.827 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:20.818+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:20.843 INFO:teuthology.orchestra.run.smithi017.stdout:5297 writesame 0x5158d57 thru 0x515ca3a data_size 0x12(0x3ce4 bytes) 2024-09-18T05:15:20.862 INFO:teuthology.orchestra.run.smithi017.stdout:5298 writesame 0xb25eb56 thru 0xb2651b2 data_size 0x5(0x665d bytes) 2024-09-18T05:15:20.862 INFO:teuthology.orchestra.run.smithi017.stdout:5299 read 0x4a3b097 thru 0x4a4939a (0xe304 bytes) 2024-09-18T05:15:20.862 INFO:teuthology.orchestra.run.smithi017.stdout:5300 punch from 0x9d5ad8a to 0x9d67d3c, (0xcfb2 bytes) 2024-09-18T05:15:20.862 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.862 INFO:teuthology.orchestra.run.smithi017.stdout:5303 read 0x7dcff35 thru 0x7ddd8df (0xd9ab bytes) 2024-09-18T05:15:20.862 INFO:teuthology.orchestra.run.smithi017.stdout:5304 read 0x263ecc8 thru 0x264dd59 (0xf092 bytes) 2024-09-18T05:15:20.867 INFO:teuthology.orchestra.run.smithi017.stdout:5305 trunc from 0xb2651b3 to 0x7d36dd7 2024-09-18T05:15:20.875 INFO:teuthology.orchestra.run.smithi017.stdout:5306 read 0x4c48968 thru 0x4c56efa (0xe593 bytes) 2024-09-18T05:15:20.876 INFO:teuthology.orchestra.run.smithi017.stdout:5308 punch from 0x7bdc8de to 0x7be61e2, (0x9904 bytes) 2024-09-18T05:15:20.876 INFO:teuthology.orchestra.run.smithi017.stdout:5309 read 0x3001622 thru 0x30100bc (0xea9b bytes) 2024-09-18T05:15:20.876 INFO:teuthology.orchestra.run.smithi017.stdout:5310 punch from 0x693522b to 0x693acdb, (0x5ab0 bytes) 2024-09-18T05:15:20.876 INFO:teuthology.orchestra.run.smithi017.stdout:5311 writesame 0x3c48c4 thru 0x3d0401 data_size 0x9(0xbb3e bytes) 2024-09-18T05:15:20.902 INFO:teuthology.orchestra.run.smithi017.stdout:5312 writesame 0xc4f18a6 thru 0xc4fab04 data_size 0x35(0x925f bytes) 2024-09-18T05:15:20.915 INFO:teuthology.orchestra.run.smithi017.stdout:5313 writesame 0xe3a61e0 thru 0xe3aeba0 data_size 0x5(0x89c1 bytes) 2024-09-18T05:15:20.916 INFO:teuthology.orchestra.run.smithi017.stdout:5314 read 0xc02266f thru 0xc02818b (0x5b1d bytes) 2024-09-18T05:15:20.916 INFO:teuthology.orchestra.run.smithi017.stdout:5315 read 0xb672c10 thru 0xb6750f5 (0x24e6 bytes) 2024-09-18T05:15:20.916 INFO:teuthology.orchestra.run.smithi017.stdout:5316 read 0x88e48a5 thru 0x88f4872 (0xffce bytes) 2024-09-18T05:15:20.916 INFO:teuthology.orchestra.run.smithi017.stdout:5317 read 0x9f6745b thru 0x9f709d6 (0x957c bytes) 2024-09-18T05:15:20.916 INFO:teuthology.orchestra.run.smithi017.stdout:5318 write 0xd14ef7f thru 0xd14fe46 (0xec8 bytes) 2024-09-18T05:15:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:15:20.923 INFO:teuthology.orchestra.run.smithi017.stdout:5319 punch from 0x4d7f7f2 to 0x4d8a802, (0xb010 bytes) 2024-09-18T05:15:20.923 INFO:teuthology.orchestra.run.smithi017.stdout:5320 writesame 0xc77528 thru 0xc81b19 data_size 0xb(0xa5f2 bytes) 2024-09-18T05:15:20.926 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:20.920+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:20.935 INFO:teuthology.orchestra.run.smithi017.stdout:5321 write 0xde4f8f0 thru 0xde57f1b (0x862c bytes) 2024-09-18T05:15:20.941 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:20.941 INFO:teuthology.orchestra.run.smithi017.stdout:5324 read 0x7ad1de7 thru 0x7ad59df (0x3bf9 bytes) 2024-09-18T05:15:20.941 INFO:teuthology.orchestra.run.smithi017.stdout:5325 read 0xde3c4f5 thru 0xde3f887 (0x3393 bytes) 2024-09-18T05:15:20.942 INFO:teuthology.orchestra.run.smithi017.stdout:5326 writesame 0xc4eabc9 thru 0xc4f7035 data_size 0x5(0xc46d bytes) 2024-09-18T05:15:20.950 INFO:teuthology.orchestra.run.smithi017.stdout:5327 write 0x10599f5 thru 0x105f935 (0x5f41 bytes) 2024-09-18T05:15:20.955 INFO:teuthology.orchestra.run.smithi017.stdout:5328 punch from 0x6fb1979 to 0x6fb8326, (0x69ad bytes) 2024-09-18T05:15:20.955 INFO:teuthology.orchestra.run.smithi017.stdout:5329 punch from 0xc207cd6 to 0xc20a094, (0x23be bytes) 2024-09-18T05:15:20.955 INFO:teuthology.orchestra.run.smithi017.stdout:5330 write 0xe03aea6 thru 0xe04a205 (0xf360 bytes) 2024-09-18T05:15:20.956 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:20.956 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:20.963 INFO:teuthology.orchestra.run.smithi017.stdout:5331 write 0xb419234 thru 0xb4290c3 (0xfe90 bytes) 2024-09-18T05:15:20.973 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:20.973 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:20.975 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:20.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:20.990 INFO:teuthology.orchestra.run.smithi017.stdout:5332 trunc from 0xe3aeba1 to 0x1603a2f 2024-09-18T05:15:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:20.993 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:21.004 INFO:teuthology.orchestra.run.smithi017.stdout:5333 read 0xc60566 thru 0xc61f90 (0x1a2b bytes) 2024-09-18T05:15:21.005 INFO:teuthology.orchestra.run.smithi017.stdout:5335 punch from 0x10e1adc to 0x10e5c02, (0x4126 bytes) 2024-09-18T05:15:21.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:21.015 INFO:teuthology.orchestra.run.smithi017.stdout:5337 write 0x453cca2 thru 0x454a2a8 (0xd607 bytes) 2024-09-18T05:15:21.022 INFO:teuthology.orchestra.run.smithi017.stdout:5338 read 0x3e7e3a1 thru 0x3e8d843 (0xf4a3 bytes) 2024-09-18T05:15:21.024 INFO:teuthology.orchestra.run.smithi017.stdout:5339 trunc from 0x454a2a9 to 0x6c2099d 2024-09-18T05:15:21.027 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:21.022+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:21.032 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:21.032 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:21.033 INFO:teuthology.orchestra.run.smithi017.stdout:5341 read 0x10042ea thru 0x10125c5 (0xe2dc bytes) 2024-09-18T05:15:21.052 INFO:teuthology.orchestra.run.smithi017.stdout:5342 writesame 0xe2d266d thru 0xe2d64ac data_size 0x53(0x3e40 bytes) 2024-09-18T05:15:21.052 INFO:teuthology.orchestra.run.smithi017.stdout:5343 read 0xe095bed thru 0xe0a3bf2 (0xe006 bytes) 2024-09-18T05:15:21.052 INFO:teuthology.orchestra.run.smithi017.stdout:5344 punch from 0xbf6e9e1 to 0xbf7d6e7, (0xed06 bytes) 2024-09-18T05:15:21.052 INFO:teuthology.orchestra.run.smithi017.stdout:5345 read 0x16fea67 thru 0x1704745 (0x5cdf bytes) 2024-09-18T05:15:21.052 INFO:teuthology.orchestra.run.smithi017.stdout:5346 punch from 0xa7df434 to 0xa7ef192, (0xfd5e bytes) 2024-09-18T05:15:21.053 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:21.053 INFO:teuthology.orchestra.run.smithi017.stdout:5347 writesame 0xb22c83a thru 0xb233eea data_size 0x3b(0x76b1 bytes) 2024-09-18T05:15:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:21.057 INFO:teuthology.orchestra.run.smithi017.stdout:5348 write 0x74e108b thru 0x74e9340 (0x82b6 bytes) 2024-09-18T05:15:21.063 INFO:teuthology.orchestra.run.smithi017.stdout:5349 read 0x241ca33 thru 0x2423608 (0x6bd6 bytes) 2024-09-18T05:15:21.063 INFO:teuthology.orchestra.run.smithi017.stdout:5350 read 0xc8eee19 thru 0xc8f33ea (0x45d2 bytes) 2024-09-18T05:15:21.063 INFO:teuthology.orchestra.run.smithi017.stdout:5351 read 0xf5975a thru 0xf639b6 (0xa25d bytes) 2024-09-18T05:15:21.063 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.067 INFO:teuthology.orchestra.run.smithi017.stdout:5354 trunc from 0xe2d64ad to 0xb2339c9 2024-09-18T05:15:21.072 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:21.075 INFO:teuthology.orchestra.run.smithi017.stdout:5355 writesame 0x7b1996e thru 0x7b1a348 data_size 0x3(0x9db bytes) 2024-09-18T05:15:21.079 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.079 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.090 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:21.091 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:21.096 INFO:teuthology.orchestra.run.smithi017.stdout:5358 trunc from 0xb2339c9 to 0x982c84 2024-09-18T05:15:21.117 INFO:teuthology.orchestra.run.smithi017.stdout:5359 read 0x589c49 thru 0x594f46 (0xb2fe bytes) 2024-09-18T05:15:21.127 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:21.122+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:21.140 INFO:teuthology.orchestra.run.smithi017.stdout:5360 write 0x9e501db thru 0x9e5155b (0x1381 bytes) 2024-09-18T05:15:21.144 INFO:teuthology.orchestra.run.smithi017.stdout:5361 write 0x78dc4aa thru 0x78e0f2f (0x4a86 bytes) 2024-09-18T05:15:21.149 INFO:teuthology.orchestra.run.smithi017.stdout:5362 read 0x1b71cc5 thru 0x1b7c039 (0xa375 bytes) 2024-09-18T05:15:21.150 INFO:teuthology.orchestra.run.smithi017.stdout:5363 read 0x3f6bf5 thru 0x3fccac (0x60b8 bytes) 2024-09-18T05:15:21.150 INFO:teuthology.orchestra.run.smithi017.stdout:5366 read 0x3150ef8 thru 0x31566b3 (0x57bc bytes) 2024-09-18T05:15:21.150 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.150 INFO:teuthology.orchestra.run.smithi017.stdout:5370 read 0x5f677da thru 0x5f6811f (0x946 bytes) 2024-09-18T05:15:21.150 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.150 INFO:teuthology.orchestra.run.smithi017.stdout:5372 read 0x764f6ae thru 0x765731e (0x7c71 bytes) 2024-09-18T05:15:21.150 INFO:teuthology.orchestra.run.smithi017.stdout:5374 write 0x26d813f thru 0x26de304 (0x61c6 bytes) 2024-09-18T05:15:21.154 INFO:teuthology.orchestra.run.smithi017.stdout:5376 writesame 0x67571d4 thru 0x675fef9 data_size 0xe(0x8d26 bytes) 2024-09-18T05:15:21.159 INFO:teuthology.orchestra.run.smithi017.stdout:5377 write 0x766f542 thru 0x7675b61 (0x6620 bytes) 2024-09-18T05:15:21.163 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:21.163 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:21.163 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:21.164 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:21.164 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:21.165 INFO:teuthology.orchestra.run.smithi017.stdout:5378 punch from 0x1af75c3 to 0x1afa377, (0x2db4 bytes) 2024-09-18T05:15:21.165 INFO:teuthology.orchestra.run.smithi017.stdout:5379 punch from 0x94f640d to 0x95038e3, (0xd4d6 bytes) 2024-09-18T05:15:21.165 INFO:teuthology.orchestra.run.smithi017.stdout:5382 read 0x9485624 thru 0x9488c26 (0x3603 bytes) 2024-09-18T05:15:21.165 INFO:teuthology.orchestra.run.smithi017.stdout:5383 read 0x409050b thru 0x40948ba (0x43b0 bytes) 2024-09-18T05:15:21.165 INFO:teuthology.orchestra.run.smithi017.stdout:5384 read 0x4da7d24 thru 0x4db62aa (0xe587 bytes) 2024-09-18T05:15:21.165 INFO:teuthology.orchestra.run.smithi017.stdout:5385 punch from 0x7a1fb96 to 0x7a26f11, (0x737b bytes) 2024-09-18T05:15:21.165 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.165 INFO:teuthology.orchestra.run.smithi017.stdout:5387 read 0x83718fb thru 0x837a40a (0x8b10 bytes) 2024-09-18T05:15:21.175 INFO:teuthology.orchestra.run.smithi017.stdout:5389 writesame 0xafa0b2a thru 0xafa56d8 data_size 0x1f(0x4baf bytes) 2024-09-18T05:15:21.175 INFO:teuthology.orchestra.run.smithi017.stdout:5390 read 0x5c25d3c thru 0x5c2bad4 (0x5d99 bytes) 2024-09-18T05:15:21.175 INFO:teuthology.orchestra.run.smithi017.stdout:5391 read 0x39c3ead thru 0x39c6d20 (0x2e74 bytes) 2024-09-18T05:15:21.175 INFO:teuthology.orchestra.run.smithi017.stdout:5392 punch from 0xa41c2a2 to 0xa420798, (0x44f6 bytes) 2024-09-18T05:15:21.175 INFO:teuthology.orchestra.run.smithi017.stdout:5394 read 0x5df9807 thru 0x5e015af (0x7da9 bytes) 2024-09-18T05:15:21.175 INFO:teuthology.orchestra.run.smithi017.stdout:5395 read 0x684d6c2 thru 0x685863e (0xaf7d bytes) 2024-09-18T05:15:21.175 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.176 INFO:teuthology.orchestra.run.smithi017.stdout:5398 write 0x5e1e7f0 thru 0x5e21659 (0x2e6a bytes) 2024-09-18T05:15:21.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:21.193 INFO:teuthology.orchestra.run.smithi017.stdout:5400 write 0xc74fb52 thru 0xc75c067 (0xc516 bytes) 2024-09-18T05:15:21.200 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.215 INFO:teuthology.orchestra.run.smithi017.stdout:5402 trunc from 0xc75c068 to 0x49d682a 2024-09-18T05:15:21.229 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:21.222+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:21.236 INFO:teuthology.orchestra.run.smithi017.stdout:5403 read 0x4065b03 thru 0x4067126 (0x1624 bytes) 2024-09-18T05:15:21.257 INFO:teuthology.orchestra.run.smithi017.stdout:5405 writesame 0x972b1db thru 0x97395dc data_size 0x1a(0xe402 bytes) 2024-09-18T05:15:21.266 INFO:teuthology.orchestra.run.smithi017.stdout:5406 trunc from 0x97395dd to 0xebf1828 2024-09-18T05:15:21.277 INFO:teuthology.orchestra.run.smithi017.stdout:5407 punch from 0x164e26 to 0x168b04, (0x3cde bytes) 2024-09-18T05:15:21.277 INFO:teuthology.orchestra.run.smithi017.stdout:5409 read 0x1f8215a thru 0x1f83fbd (0x1e64 bytes) 2024-09-18T05:15:21.277 INFO:teuthology.orchestra.run.smithi017.stdout:5411 write 0x495fcde thru 0x496dd24 (0xe047 bytes) 2024-09-18T05:15:21.287 INFO:teuthology.orchestra.run.smithi017.stdout:5413 writesame 0x6c9b321 thru 0x6c9ec10 data_size 0x8(0x38f0 bytes) 2024-09-18T05:15:21.304 INFO:teuthology.orchestra.run.smithi017.stdout:5414 trunc from 0xebf1828 to 0x9b2673c 2024-09-18T05:15:21.305 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:21.305 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:21.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:21.305 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:21.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.305 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.305 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:21.305 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553410060000001, 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:15:21.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.309 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.55340107, 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.310 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:21.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553392103, 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.314 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:15:21.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:21.318 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553383320000002, 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:15:21.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:15:21.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553374544, 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.323 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:15:21.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:15:21.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553364252000001, 2024-09-18T05:15:21.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:15:21.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:15:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553350365, 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:15:21.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:15:21.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553341158999999, 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.336 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:15:21.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:21.340 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553332461, 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:15:21.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:15:21.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553323396, 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:15:21.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:15:21.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553300038, 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.349 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553290372999999, 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.353 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:21.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.357 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553264016, 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:15:21.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.361 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553250483999999, 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.362 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553239033000001, 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.366 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:15:21.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:15:21.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553229552000001, 2024-09-18T05:15:21.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:21.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:15:21.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553219469999998, 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:15:21.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553210382, 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.383 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553200825000001, 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:21.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:15:21.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.387 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.553192004, 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:15:21.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:15:21.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:15:21.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.392 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.392 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.392 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:21.394 INFO:teuthology.orchestra.run.smithi017.stdout:5418 writesame 0x7a221b4 thru 0x7a2e600 data_size 0x7(0xc44d bytes) 2024-09-18T05:15:21.394 INFO:teuthology.orchestra.run.smithi017.stdout:5420 read 0x610a5a thru 0x611a35 (0xfdc bytes) 2024-09-18T05:15:21.394 INFO:teuthology.orchestra.run.smithi017.stdout:5421 read 0x305606e thru 0x305a684 (0x4617 bytes) 2024-09-18T05:15:21.394 INFO:teuthology.orchestra.run.smithi017.stdout:5423 write 0x11cff8d thru 0x11da13b (0xa1af bytes) 2024-09-18T05:15:21.394 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.394 INFO:teuthology.orchestra.run.smithi017.stdout:5425 trunc from 0x9b2673c to 0x25e838c 2024-09-18T05:15:21.395 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:21.395 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:21.386+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:21.401 INFO:teuthology.orchestra.run.smithi017.stdout:5426 write 0x6d955dc thru 0x6da4823 (0xf248 bytes) 2024-09-18T05:15:21.413 INFO:teuthology.orchestra.run.smithi017.stdout:5427 trunc from 0x6da4824 to 0x7d202e9 2024-09-18T05:15:21.426 INFO:teuthology.orchestra.run.smithi017.stdout:5429 write 0xed407a thru 0xed83ad (0x4334 bytes) 2024-09-18T05:15:21.456 INFO:teuthology.orchestra.run.smithi017.stdout:5430 writesame 0xad7c802 thru 0xad8b283 data_size 0xd(0xea82 bytes) 2024-09-18T05:15:21.478 INFO:teuthology.orchestra.run.smithi017.stdout:5431 writesame 0xdb6b6ba thru 0xdb6e9bd data_size 0xa(0x3304 bytes) 2024-09-18T05:15:21.478 INFO:teuthology.orchestra.run.smithi017.stdout:5432 write 0x1d737d thru 0x1e5037 (0xdcbb bytes) 2024-09-18T05:15:21.494 INFO:teuthology.orchestra.run.smithi017.stdout:5433 write 0x6c082e0 thru 0x6c107e2 (0x8503 bytes) 2024-09-18T05:15:21.494 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:21.488+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:21.503 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.503 INFO:teuthology.orchestra.run.smithi017.stdout:5435 write 0x8bbd08c thru 0x8bc60a0 (0x9015 bytes) 2024-09-18T05:15:21.513 INFO:teuthology.orchestra.run.smithi017.stdout:5436 writesame 0x6a4e441 thru 0x6a5d30b data_size 0x7b(0xeecb bytes) 2024-09-18T05:15:21.520 INFO:teuthology.orchestra.run.smithi017.stdout:5438 read 0xa6d3405 thru 0xa6d45e0 (0x11dc bytes) 2024-09-18T05:15:21.520 INFO:teuthology.orchestra.run.smithi017.stdout:5439 writesame 0x8817af5 thru 0x881a28d data_size 0x1f(0x2799 bytes) 2024-09-18T05:15:21.528 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.529 INFO:teuthology.orchestra.run.smithi017.stdout:5441 read 0x50efea1 thru 0x50fa582 (0xa6e2 bytes) 2024-09-18T05:15:21.529 INFO:teuthology.orchestra.run.smithi017.stdout:5445 write 0x49c11fc thru 0x49c931f (0x8124 bytes) 2024-09-18T05:15:21.531 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:21.531 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:21.531 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:21.532 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:21.536 INFO:teuthology.orchestra.run.smithi017.stdout:5446 read 0x7538d87 thru 0x753e139 (0x53b3 bytes) 2024-09-18T05:15:21.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:21.555 INFO:teuthology.orchestra.run.smithi017.stdout:5447 trunc from 0xdb6e9be to 0x6d8260b 2024-09-18T05:15:21.595 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:21.590+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:21.599 INFO:teuthology.orchestra.run.smithi017.stdout:5448 writesame 0x9f0e5bf thru 0x9f151c3 data_size 0x1(0x6c05 bytes) 2024-09-18T05:15:21.613 INFO:teuthology.orchestra.run.smithi017.stdout:5450 trunc from 0x9f151c4 to 0x4d46940 2024-09-18T05:15:21.635 INFO:teuthology.orchestra.run.smithi017.stdout:5451 read 0x43c1d17 thru 0x43c515e (0x3448 bytes) 2024-09-18T05:15:21.635 INFO:teuthology.orchestra.run.smithi017.stdout:5452 read 0x7ed6b7 thru 0x7f074a (0x3094 bytes) 2024-09-18T05:15:21.644 INFO:teuthology.orchestra.run.smithi017.stdout:5454 trunc from 0x4d46940 to 0x190a875 2024-09-18T05:15:21.662 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.690 INFO:teuthology.orchestra.run.smithi017.stdout:5457 write 0x7b4ecef thru 0x7b5d088 (0xe39a bytes) 2024-09-18T05:15:21.696 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:21.692+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:21.698 INFO:teuthology.orchestra.run.smithi017.stdout:5458 read 0x654341d thru 0x654a21c (0x6e00 bytes) 2024-09-18T05:15:21.714 INFO:teuthology.orchestra.run.smithi017.stdout:5459 write 0x85763dd thru 0x857c42a (0x604e bytes) 2024-09-18T05:15:21.716 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:21.716 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:21.716 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:21.717 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:21.717 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:21.718 INFO:teuthology.orchestra.run.smithi017.stdout:5461 read 0x78d0574 thru 0x78d8fb1 (0x8a3e bytes) 2024-09-18T05:15:21.718 INFO:teuthology.orchestra.run.smithi017.stdout:5462 write 0xd14a17 thru 0xd17717 (0x2d01 bytes) 2024-09-18T05:15:21.732 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:21.744 INFO:teuthology.orchestra.run.smithi017.stdout:5465 write 0xb73c438 thru 0xb74307d (0x6c46 bytes) 2024-09-18T05:15:21.752 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.752 INFO:teuthology.orchestra.run.smithi017.stdout:5470 write 0xad5f6c9 thru 0xad67ae4 (0x841c bytes) 2024-09-18T05:15:21.760 INFO:teuthology.orchestra.run.smithi017.stdout:5472 write 0x76ba1c4 thru 0x76c4919 (0xa756 bytes) 2024-09-18T05:15:21.768 INFO:teuthology.orchestra.run.smithi017.stdout:5473 punch from 0x9dfd79 to 0x9e0344, (0x5cb bytes) 2024-09-18T05:15:21.768 INFO:teuthology.orchestra.run.smithi017.stdout:5474 read 0x8668fdd thru 0x8669261 (0x285 bytes) 2024-09-18T05:15:21.768 INFO:teuthology.orchestra.run.smithi017.stdout:5475 punch from 0xa9ca2f1 to 0xa9d28ee, (0x85fd bytes) 2024-09-18T05:15:21.769 INFO:teuthology.orchestra.run.smithi017.stdout:5476 writesame 0x605824 thru 0x607af9 data_size 0x31(0x22d6 bytes) 2024-09-18T05:15:21.771 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:21.771 INFO:teuthology.orchestra.run.smithi017.stdout:5478 write 0x4318c70 thru 0x431efd7 (0x6368 bytes) 2024-09-18T05:15:21.779 INFO:teuthology.orchestra.run.smithi017.stdout:5479 writesame 0x24a2f20 thru 0x24af1fc data_size 0xb(0xc2dd bytes) 2024-09-18T05:15:21.790 INFO:teuthology.orchestra.run.smithi017.stdout:5480 write 0x3172491 thru 0x3179513 (0x7083 bytes) 2024-09-18T05:15:21.797 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:21.790+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:21.799 INFO:teuthology.orchestra.run.smithi017.stdout:5481 read 0x466fc81 thru 0x4675312 (0x5692 bytes) 2024-09-18T05:15:21.799 INFO:teuthology.orchestra.run.smithi017.stdout:5482 read 0x6c7931b thru 0x6c7bbf7 (0x28dd bytes) 2024-09-18T05:15:21.799 INFO:teuthology.orchestra.run.smithi017.stdout:5483 read 0x7b57d0b thru 0x7b644eb (0xc7e1 bytes) 2024-09-18T05:15:21.811 INFO:teuthology.orchestra.run.smithi017.stdout:5485 trunc from 0xb74307e to 0x7a7ec12 2024-09-18T05:15:21.836 INFO:teuthology.orchestra.run.smithi017.stdout:5486 clone 42 order 21 su 1048576 sc 2 2024-09-18T05:15:21.898 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:21.894+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:21.901 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.239082578999998, 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.239015661000003, 2024-09-18T05:15:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238927150999999, 2024-09-18T05:15:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:21.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:21.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:21.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:21.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.923 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.924 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.924 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:21.924 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238876595000001, 2024-09-18T05:15:21.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:21.925 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.925 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.925 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.925 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.925 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.925 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:21.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:21.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:21.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:21.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:21.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:21.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:21.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:21.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.930 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.930 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.930 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:21.931 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238813479999997, 2024-09-18T05:15:21.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:21.931 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.931 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.931 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.931 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.931 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.931 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:21.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.932 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:21.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:21.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:21.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:21.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:21.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:21.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:21.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:21.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:21.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:21.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:21.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:21.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238766560000002, 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.939 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:21.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.943 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238712681000003, 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:21.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:21.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:21.948 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238665548, 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:21.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:21.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:21.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:21.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:21.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.953 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238617926000003, 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:21.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.955 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:21.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:21.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:21.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:21.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:21.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:21.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:21.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:21.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:21.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:21.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:21.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:21.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:21.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:21.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:21.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:21.960 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.960 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.960 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.960 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.961 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:21.961 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238495104999998, 2024-09-18T05:15:21.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:21.961 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.961 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.961 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.961 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.961 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.962 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:21.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.962 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:21.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:21.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:21.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:21.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:21.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:21.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:21.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:21.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:21.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:21.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:21.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:21.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:21.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238413774999998, 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.968 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:21.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.969 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:21.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:21.972 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238342531999997, 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.973 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:21.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238292321000003, 2024-09-18T05:15:21.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:21.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:21.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:21.982 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238215126999997, 2024-09-18T05:15:21.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:21.983 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.983 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.983 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:21.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.983 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:21.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:21.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238165256999999, 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:21.988 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238090686, 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:21.993 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:21.994 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:21.994 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:21.994 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:21.994 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:21.994 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:21.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.994 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:21.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:21.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:21.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:21.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:21.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:21.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:21.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:21.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:21.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:21.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:21.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:21.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:21.999 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.238024908, 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.000 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:22.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.237977872000002, 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.005 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:22.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:22.010 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.010 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.010 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.010 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.010 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:22.011 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.237915778999998, 2024-09-18T05:15:22.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:22.011 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.011 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.011 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.011 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.012 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.012 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:22.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.012 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:22.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:22.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:22.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:22.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:22.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:22.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:22.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:22.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:22.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:22.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:22.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:22.018 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.018 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.018 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.018 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.237869400000001, 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:22.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.020 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:22.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:22.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:22.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:22.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:22.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:22.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:22.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:22.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:22.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:22.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:22.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:22.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:22.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:22.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:22.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:22.026 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.026 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.026 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.026 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.026 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.026 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:22.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:22.030 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:22.024+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:22.086 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone41 from 0x7a7ec12 (overlap 0x929ef5) to 0x1d52fd 2024-09-18T05:15:22.129 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:22.122+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:22.215 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:22.215 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:22.215 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:22.215 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:22.230 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:22.230 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:22.222+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:22.276 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-18T05:15:22.331 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:22.324+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:22.350 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:22.351 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:22.365 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:22.433 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:22.426+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:22.517 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:22.517 INFO:teuthology.orchestra.run.smithi017.stdout:5488 write 0x469ef6a thru 0x469fc30 (0xcc7 bytes) 2024-09-18T05:15:22.533 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:22.533 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:27144 3.e 3:72e631ab:::rbd_data.118b9f2c0487.000000000000003c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 71.065709662000003, 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053442387000000001, 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 27144 2024-09-18T05:15:22.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462535+0000", 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462530+0000", 2024-09-18T05:15:22.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999957 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462560+0000", 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9933e-05 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462596+0000", 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5936000000000003e-05 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462621+0000", 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4644e-05 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.462748+0000", 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126892 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.463025+0000", 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027756100000000001 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.471585+0000", 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085600780000000005 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515712+0000", 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.044127 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515824+0000", 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112002 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515915+0000", 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0105999999999994e-05 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:11.515977+0000", 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2521999999999995e-05 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.539 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36312 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.719684086000001, 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050924795000000002, 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36312 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808560+0000", 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808562+0000", 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.522e-06 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808566+0000", 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0459999999999999e-06 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808569+0000", 2024-09-18T05:15:22.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1580000000000001e-06 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859475+0000", 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050906734000000002 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859485+0000", 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6029999999999994e-06 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36313 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.719672926999998, 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050958802999999997, 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36313 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808571+0000", 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808573+0000", 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4720000000000001e-06 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808577+0000", 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9899999999999999e-06 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808581+0000", 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.301e-06 2024-09-18T05:15:22.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859521+0000", 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939971000000001 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859530+0000", 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3309999999999993e-06 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:36314 3.e 3.8c59896e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.719660744999999, 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050974481000000002, 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 36314 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808584+0000", 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808583+0000", 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808585+0000", 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4839999999999999e-06 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808589+0000", 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0149999999999997e-06 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.808592+0000", 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2100000000000002e-06 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859552+0000", 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050959971999999999 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.859558+0000", 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0809999999999999e-06 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37032 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 366592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.551 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.581144414000001, 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050948475, 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37032 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:22.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947100+0000", 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947099+0000", 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947102+0000", 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3140000000000002e-06 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947107+0000", 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7169999999999996e-06 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947112+0000", 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6500000000000004e-06 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997959+0000", 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050847106000000003 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.997999+0000", 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0049000000000002e-05 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998048+0000", 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9211e-05 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.555 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37033 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 376832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.581117626000001, 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051119236999999998, 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37033 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.556 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947127+0000", 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947126+0000", 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947129+0000", 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5469999999999999e-06 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947135+0000", 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5069999999999997e-06 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947140+0000", 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7350000000000004e-06 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998080+0000", 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.050939401000000002 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998158+0000", 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8753999999999998e-05 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998246+0000", 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7682999999999994e-05 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37034 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 387072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.581100403999997, 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.05121883, 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.560 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37034 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:22.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947144+0000", 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947146+0000", 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.12e-06 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947152+0000", 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8560000000000003e-06 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947156+0000", 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5970000000000002e-06 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998271+0000", 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051114764 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998312+0000", 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1258999999999999e-05 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998363+0000", 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0581999999999998e-05 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37035 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.564 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.581084034, 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051399043999999998, 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37035 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947160+0000", 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947162+0000", 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1619999999999998e-06 2024-09-18T05:15:22.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947168+0000", 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7640000000000002e-06 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947172+0000", 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4750000000000004e-06 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998394+0000", 2024-09-18T05:15:22.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051222202000000001 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998472+0000", 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7228e-05 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998559+0000", 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7699000000000002e-05 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37036 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 407552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.581068467000001, 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051565297000000003, 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37036 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947176+0000", 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947178+0000", 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0169999999999999e-06 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947183+0000", 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7660000000000004e-06 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947188+0000", 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998583+0000", 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051394678999999999 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998661+0000", 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8631e-05 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998741+0000", 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0054000000000003e-05 2024-09-18T05:15:22.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37037 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 417792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.581052270000001, 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051746031999999997, 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37037 2024-09-18T05:15:22.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947192+0000", 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947194+0000", 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1100000000000001e-06 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947200+0000", 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2530000000000001e-06 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947205+0000", 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8319999999999996e-06 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998775+0000", 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051569934999999997 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998850+0000", 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4783999999999994e-05 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998938+0000", 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8442999999999993e-05 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37038 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.581034705999997, 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851468999999997, 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.577 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37038 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947210+0000", 2024-09-18T05:15:22.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947209+0000", 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947212+0000", 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947218+0000", 2024-09-18T05:15:22.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2319999999999998e-06 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947223+0000", 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8590000000000004e-06 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.998966+0000", 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051743193999999999 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999009+0000", 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999997e-05 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999061+0000", 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2216999999999998e-05 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37039 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.581017562, 2024-09-18T05:15:22.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052037513000000001, 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37039 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947227+0000", 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947226+0000", 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947229+0000", 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.198e-06 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947235+0000", 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.319e-06 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947240+0000", 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7260000000000002e-06 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999092+0000", 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.051851928999999998 2024-09-18T05:15:22.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999162+0000", 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0115000000000002e-05 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999264+0000", 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010256599999999999 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.585 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37040 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 448512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.580998792000003, 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052135867000000002, 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37040 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947246+0000", 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947245+0000", 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947248+0000", 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4439999999999998e-06 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947256+0000", 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9410000000000007e-06 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947260+0000", 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:15:22.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999286+0000", 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052025350999999997 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999330+0000", 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4226e-05 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999381+0000", 2024-09-18T05:15:22.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1529000000000001e-05 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37041 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 458752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.580979497000001, 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052321965999999998, 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.590 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37041 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947265+0000", 2024-09-18T05:15:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947275+0000", 2024-09-18T05:15:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0175e-05 2024-09-18T05:15:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947283+0000", 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8660000000000006e-06 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947287+0000", 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6369999999999998e-06 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999414+0000", 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052126541999999998 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999494+0000", 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999587+0000", 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2795999999999997e-05 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37042 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.580952668000002, 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052411412999999997, 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37042 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947292+0000", 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947291+0000", 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947294+0000", 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4559999999999999e-06 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947300+0000", 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5189999999999998e-06 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947305+0000", 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9049999999999996e-06 2024-09-18T05:15:22.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999614+0000", 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052308353000000002 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999653+0000", 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9879000000000002e-05 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999703+0000", 2024-09-18T05:15:22.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9710999999999999e-05 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37043 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 479232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.580930717999998, 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052588113999999998, 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.599 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37043 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947314+0000", 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947313+0000", 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947316+0000", 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4059999999999999e-06 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947322+0000", 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2999999999999998e-06 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947327+0000", 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7119999999999999e-06 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999735+0000", 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052408145000000003 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999812+0000", 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7540999999999995e-05 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999902+0000", 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9413000000000006e-05 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37044 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 489472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.580913529999997, 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052688817999999998, 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.603 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37044 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:22.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947331+0000", 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947333+0000", 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.396e-06 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947339+0000", 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947344+0000", 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9359999999999998e-06 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999929+0000", 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052584371999999997 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.999969+0000", 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0315000000000003e-05 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000020+0000", 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0807000000000003e-05 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37045 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 499712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.607 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.580895720999997, 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052875286000000001, 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37045 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:22.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947349+0000", 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947348+0000", 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947351+0000", 2024-09-18T05:15:22.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3130000000000001e-06 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947357+0000", 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2040000000000002e-06 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947362+0000", 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9269999999999996e-06 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000054+0000", 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052691799999999997 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000133+0000", 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9134999999999994e-05 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000224+0000", 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1315000000000002e-05 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37046 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.580878366999997, 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052973012999999999, 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37046 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947366+0000", 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947368+0000", 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3190000000000002e-06 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947374+0000", 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1569999999999997e-06 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947379+0000", 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6949999999999999e-06 2024-09-18T05:15:22.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000250+0000", 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052870752999999999 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000291+0000", 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0975e-05 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000339+0000", 2024-09-18T05:15:22.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8511999999999999e-05 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:37047 3.11 3:8c335db2:::rbd_data.118b475dc9c5.0000000000000013:13 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.580861376000001, 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.053159397999999997, 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:22.616 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 37047 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947383+0000", 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947385+0000", 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3070000000000001e-06 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947391+0000", 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.947396+0000", 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.921e-06 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000373+0000", 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052976957999999998 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000451+0000", 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8250000000000005e-05 2024-09-18T05:15:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:22.000542+0000", 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1242999999999994e-05 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:22.620 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:22.621 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:22.528+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:22.621 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:22.623 INFO:teuthology.orchestra.run.smithi017.stdout:5490 read 0xc1db51 thru 0xc21ffc (0x44ac bytes) 2024-09-18T05:15:22.623 INFO:teuthology.orchestra.run.smithi017.stdout:5491 write 0x9b863c1 thru 0x9b86e75 (0xab5 bytes) 2024-09-18T05:15:22.623 INFO:teuthology.orchestra.run.smithi017.stdout:5492 punch from 0x82512ab to 0x825621e, (0x4f73 bytes) 2024-09-18T05:15:22.623 INFO:teuthology.orchestra.run.smithi017.stdout:5493 read 0x7c120f7 thru 0x7c18235 (0x613f bytes) 2024-09-18T05:15:22.623 INFO:teuthology.orchestra.run.smithi017.stdout:5494 write 0x30b63bc thru 0x30bf88f (0x94d4 bytes) 2024-09-18T05:15:22.623 INFO:teuthology.orchestra.run.smithi017.stdout:5496 punch from 0x50eca to 0x5aefc, (0xa032 bytes) 2024-09-18T05:15:22.623 INFO:teuthology.orchestra.run.smithi017.stdout:5497 punch from 0x82aa5ae to 0x82b6cab, (0xc6fd bytes) 2024-09-18T05:15:22.624 INFO:teuthology.orchestra.run.smithi017.stdout:5498 write 0x7a3aeca thru 0x7a3fde8 (0x4f1f bytes) 2024-09-18T05:15:22.624 INFO:teuthology.orchestra.run.smithi017.stdout:5499 write 0x245d3aa thru 0x24690f4 (0xbd4b bytes) 2024-09-18T05:15:22.624 INFO:teuthology.orchestra.run.smithi017.stdout:5500 write 0xdcb689b thru 0xdcb94c3 (0x2c29 bytes) 2024-09-18T05:15:22.624 INFO:teuthology.orchestra.run.smithi017.stdout:5501 read 0x22050e1 thru 0x2209b80 (0x4aa0 bytes) 2024-09-18T05:15:22.624 INFO:teuthology.orchestra.run.smithi017.stdout:5502 write 0xe675373 thru 0xe677eaa (0x2b38 bytes) 2024-09-18T05:15:22.627 INFO:teuthology.orchestra.run.smithi017.stdout:5503 punch from 0x925ccd0 to 0x926b8ec, (0xec1c bytes) 2024-09-18T05:15:22.627 INFO:teuthology.orchestra.run.smithi017.stdout:5504 write 0x1561d18 thru 0x1571c97 (0xff80 bytes) 2024-09-18T05:15:22.637 INFO:teuthology.orchestra.run.smithi017.stdout:5505 write 0x71af72 thru 0x7226e4 (0x7773 bytes) 2024-09-18T05:15:22.668 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:22.664+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:22.685 INFO:teuthology.orchestra.run.smithi017.stdout:5507 trunc from 0xe677eab to 0x406db89 2024-09-18T05:15:22.727 INFO:teuthology.orchestra.run.smithi017.stdout:5508 write 0x4510987 thru 0x451197b (0xff5 bytes) 2024-09-18T05:15:22.733 INFO:teuthology.orchestra.run.smithi017.stdout:5509 read 0x32bed8f thru 0x32c8819 (0x9a8b bytes) 2024-09-18T05:15:22.734 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:22.730+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:22.753 INFO:teuthology.orchestra.run.smithi017.stdout:5511 write 0x6a2ef4e thru 0x6a301dd (0x1290 bytes) 2024-09-18T05:15:22.759 INFO:teuthology.orchestra.run.smithi017.stdout:5512 writesame 0x271b768 thru 0x2724783 data_size 0x2e(0x901c bytes) 2024-09-18T05:15:22.780 INFO:teuthology.orchestra.run.smithi017.stdout:5514 trunc from 0x6a301de to 0x1a17e6a 2024-09-18T05:15:22.807 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:22.807 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:22.807 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:22.807 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:22.812 INFO:teuthology.orchestra.run.smithi017.stdout:5515 punch from 0x14f90c9 to 0x14fa6d9, (0x1610 bytes) 2024-09-18T05:15:22.822 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:22.832 INFO:teuthology.orchestra.run.smithi017.stdout:5516 write 0x42812f2 thru 0x428f3a9 (0xe0b8 bytes) 2024-09-18T05:15:22.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:22.830+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:22.854 INFO:teuthology.orchestra.run.smithi017.stdout:5517 write 0x525ac3b thru 0x52638d6 (0x8c9c bytes) 2024-09-18T05:15:22.883 INFO:teuthology.orchestra.run.smithi017.stdout:5519 trunc from 0x52638d7 to 0xde74770 2024-09-18T05:15:22.895 INFO:teuthology.orchestra.run.smithi017.stdout:5520 read 0x402dc91 thru 0x403acb8 (0xd028 bytes) 2024-09-18T05:15:22.896 INFO:teuthology.orchestra.run.smithi017.stdout:5521 punch from 0x51ae1bb to 0x51b91a5, (0xafea bytes) 2024-09-18T05:15:22.897 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:22.897 INFO:teuthology.orchestra.run.smithi017.stdout:5523 write 0xc1045ee thru 0xc10755f (0x2f72 bytes) 2024-09-18T05:15:22.904 INFO:teuthology.orchestra.run.smithi017.stdout:5526 read 0x95ded6a thru 0x95e0454 (0x16eb bytes) 2024-09-18T05:15:22.905 INFO:teuthology.orchestra.run.smithi017.stdout:5528 punch from 0x2763bff to 0x276d7a3, (0x9ba4 bytes) 2024-09-18T05:15:22.911 INFO:teuthology.orchestra.run.smithi017.stdout:5530 trunc from 0xde74770 to 0xb70a928 2024-09-18T05:15:22.940 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:22.936+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:22.946 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:22.946 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:22.946 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:22.946 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:22.946 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:22.948 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:15:22.956 INFO:teuthology.orchestra.run.smithi017.stdout:5531 write 0xea966ae thru 0xea975f5 (0xf48 bytes) 2024-09-18T05:15:22.961 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:22.962 INFO:teuthology.orchestra.run.smithi017.stdout:5532 writesame 0x8836f03 thru 0x884227e data_size 0x2a(0xb37c bytes) 2024-09-18T05:15:22.967 INFO:teuthology.orchestra.run.smithi017.stdout:5534 write 0x152d6ac thru 0x15323dd (0x4d32 bytes) 2024-09-18T05:15:22.969 INFO:teuthology.orchestra.run.smithi017.stdout:5536 write 0x9f1ef58 thru 0x9f21be8 (0x2c91 bytes) 2024-09-18T05:15:22.974 INFO:teuthology.orchestra.run.smithi017.stdout:5538 writesame 0xd33df61 thru 0xd34adbc data_size 0x5e(0xce5c bytes) 2024-09-18T05:15:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:5539 read 0x63c4b7d thru 0x63c5528 (0x9ac bytes) 2024-09-18T05:15:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:5540 punch from 0x6fb1d00 to 0x6fc0d58, (0xf058 bytes) 2024-09-18T05:15:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:5541 read 0xd43a54e thru 0xd443c24 (0x96d7 bytes) 2024-09-18T05:15:22.980 INFO:teuthology.orchestra.run.smithi017.stdout:5542 writesame 0x27f253b thru 0x2801fcf data_size 0x1(0xfa95 bytes) 2024-09-18T05:15:23.037 INFO:teuthology.orchestra.run.smithi017.stdout:5543 trunc from 0xea975f6 to 0x6d79af9 2024-09-18T05:15:23.041 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:23.034+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:23.058 INFO:teuthology.orchestra.run.smithi017.stdout:5549 flatten 2024-09-18T05:15:23.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:23.120 INFO:teuthology.orchestra.run.smithi017.stdout:5550 write 0xa022fd7 thru 0xa0288e6 (0x5910 bytes) 2024-09-18T05:15:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:5551 writesame 0xb7b39fa thru 0xb7b560c data_size 0x1(0x1c13 bytes) 2024-09-18T05:15:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:5552 read 0x4e10387 thru 0x4e12def (0x2a69 bytes) 2024-09-18T05:15:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:5553 read 0xb6ec53c thru 0xb6f762c (0xb0f1 bytes) 2024-09-18T05:15:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:5558 read 0x13bc95a thru 0x13c5dac (0x9453 bytes) 2024-09-18T05:15:23.141 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59021 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.934969+0000", 2024-09-18T05:15:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.203562263000002, 2024-09-18T05:15:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029390646999999999, 2024-09-18T05:15:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59021 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.934969+0000", 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.934969+0000", 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.934968+0000", 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.934974+0000", 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.72e-06 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.934993+0000", 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8975999999999999e-05 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935007+0000", 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4161999999999999e-05 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.962716+0000", 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.027708943 2024-09-18T05:15:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.964175+0000", 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014588559999999999 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.964359+0000", 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000184093 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59022 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.935025+0000", 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.203505741999997, 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029995580000000001, 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59022 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935025+0000", 2024-09-18T05:15:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935025+0000", 2024-09-18T05:15:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935019+0000", 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999933 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935031+0000", 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119999999999999e-05 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935054+0000", 2024-09-18T05:15:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3329e-05 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935072+0000", 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8238999999999999e-05 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.964443+0000", 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029370576999999998 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.964621+0000", 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000177567 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965021+0000", 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00040024100000000002 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59023 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.935086+0000", 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.203445463999998, 2024-09-18T05:15:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030248826999999999, 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59023 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935086+0000", 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935086+0000", 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935084+0000", 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935103+0000", 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8638999999999999e-05 2024-09-18T05:15:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935132+0000", 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9062000000000001e-05 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935147+0000", 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4996e-05 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965036+0000", 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029889127000000001 2024-09-18T05:15:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965175+0000", 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013898 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965334+0000", 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159123 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59024 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 7667712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.935160+0000", 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.203370520999997, 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030489529000000001, 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59024 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935160+0000", 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935160+0000", 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935159+0000", 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935166+0000", 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3960000000000003e-06 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935184+0000", 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8142999999999999e-05 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935218+0000", 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4615e-05 2024-09-18T05:15:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965379+0000", 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030160677 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965501+0000", 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012189900000000001 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965650+0000", 2024-09-18T05:15:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000149042 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59025 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 8060928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.935232+0000", 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.203299440000002, 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030728221999999999, 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59025 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935232+0000", 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935232+0000", 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935230+0000", 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.935249+0000", 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8936e-05 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.943305+0000", 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080557140000000003 2024-09-18T05:15:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.943323+0000", 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7992e-05 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965693+0000", 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.022370436 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965817+0000", 2024-09-18T05:15:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012314699999999999 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.965960+0000", 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014320700000000001 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59272 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944263+0000", 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.194267547000003, 2024-09-18T05:15:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028653522000000001, 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59272 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944263+0000", 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944263+0000", 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944262+0000", 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944269+0000", 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3640000000000004e-06 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944286+0000", 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7325000000000001e-05 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944300+0000", 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3487e-05 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.972699+0000", 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028399987000000002 2024-09-18T05:15:23.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.972790+0000", 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0758000000000001e-05 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.972917+0000", 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012670800000000001 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59273 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944311+0000", 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.194220196000003, 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028862326000000001, 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59273 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944311+0000", 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944311+0000", 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944310+0000", 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944316+0000", 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8529999999999997e-06 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944332+0000", 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6912999999999999e-05 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944345+0000", 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2516e-05 2024-09-18T05:15:23.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.972947+0000", 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028602443000000002 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973054+0000", 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000106254 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973173+0000", 2024-09-18T05:15:23.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011943 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59274 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 2949120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944356+0000", 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.194175053999999, 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029065530999999999, 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59274 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944356+0000", 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944356+0000", 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944355+0000", 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944361+0000", 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6799999999999998e-06 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944377+0000", 2024-09-18T05:15:23.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944390+0000", 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2873e-05 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973218+0000", 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028828626999999999 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973307+0000", 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8918000000000005e-05 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973421+0000", 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000114091 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59275 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944401+0000", 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.194129740000001, 2024-09-18T05:15:23.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029276327000000001, 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59275 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944401+0000", 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944401+0000", 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944400+0000", 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944406+0000", 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6960000000000002e-06 2024-09-18T05:15:23.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944422+0000", 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6626e-05 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944436+0000", 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3679999999999999e-05 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973464+0000", 2024-09-18T05:15:23.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029027678000000001 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973572+0000", 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000108496 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973678+0000", 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105247 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59276 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944447+0000", 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.194083771000003, 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029415423999999999, 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59276 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944447+0000", 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944447+0000", 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944446+0000", 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944482+0000", 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5624999999999999e-05 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944500+0000", 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8165999999999999e-05 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944514+0000", 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3623e-05 2024-09-18T05:15:23.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973721+0000", 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029207232999999999 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973795+0000", 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4603000000000004e-05 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973863+0000", 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7181000000000006e-05 2024-09-18T05:15:23.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59277 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944527+0000", 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.194003610999999, 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029505100999999999, 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.186 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59277 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944527+0000", 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944527+0000", 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944526+0000", 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944533+0000", 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9770000000000003e-06 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944550+0000", 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6912e-05 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944562+0000", 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2853e-05 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973896+0000", 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029333379 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.973969+0000", 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3342000000000004e-05 2024-09-18T05:15:23.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974032+0000", 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3285000000000001e-05 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59278 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 5832704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944574+0000", 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.193956970000002, 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029603798000000001, 2024-09-18T05:15:23.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59278 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944574+0000", 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944574+0000", 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944573+0000", 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944579+0000", 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7799999999999997e-06 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944596+0000", 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6835000000000001e-05 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944608+0000", 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2857000000000001e-05 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974064+0000", 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029455129 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974116+0000", 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2187e-05 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974178+0000", 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2063000000000005e-05 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.194 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59279 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944619+0000", 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.193911761999999, 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029733397000000002, 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59279 2024-09-18T05:15:23.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944619+0000", 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944619+0000", 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944618+0000", 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944624+0000", 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8930000000000002e-06 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944641+0000", 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6748999999999998e-05 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944671+0000", 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9748999999999999e-05 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974207+0000", 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029536673999999999 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974271+0000", 2024-09-18T05:15:23.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3397000000000003e-05 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974353+0000", 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1997999999999997e-05 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.199 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59280 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944683+0000", 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.193848113999998, 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030038011999999999, 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59280 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944683+0000", 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944683+0000", 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944682+0000", 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944688+0000", 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.596e-06 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944706+0000", 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7756000000000001e-05 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944719+0000", 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3346000000000001e-05 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974452+0000", 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029732571999999999 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974584+0000", 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000131748 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974721+0000", 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000137224 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59281 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944731+0000", 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.193799939999998, 2024-09-18T05:15:23.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030162977000000001, 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59281 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944731+0000", 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944731+0000", 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944730+0000", 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944736+0000", 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6729999999999997e-06 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944753+0000", 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.749e-05 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944767+0000", 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3468999999999999e-05 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974759+0000", 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029992952 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974828+0000", 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8901999999999999e-05 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974894+0000", 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5650999999999999e-05 2024-09-18T05:15:23.208 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59282 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 8716288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944778+0000", 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.193752611999997, 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030319100000000002, 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.209 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59282 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944778+0000", 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944778+0000", 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944777+0000", 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944783+0000", 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7930000000000003e-06 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944811+0000", 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7999000000000001e-05 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944825+0000", 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3653e-05 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.974938+0000", 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030113484999999999 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.975011+0000", 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2611e-05 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.975097+0000", 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6708999999999999e-05 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.213 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:59283 3.a 3:524c302b:::rbd_data.118bf319cbab.000000000000000a:1c [sparse-read 9109504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:44.944837+0000", 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.193693840999998, 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030584712, 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 59283 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944837+0000", 2024-09-18T05:15:23.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944837+0000", 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944836+0000", 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944842+0000", 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1870000000000002e-06 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944859+0000", 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7244999999999998e-05 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.944873+0000", 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3360000000000001e-05 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.975134+0000", 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030261112 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.975257+0000", 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012343 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:44.975422+0000", 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000164518 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.217 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:99784 3.10 3:0d61ed54:::rbd_data.118b61442e0a.000000000000003e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.117224+0000", 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.021307258, 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034553533999999997, 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 99784 2024-09-18T05:15:23.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117224+0000", 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117224+0000", 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117222+0000", 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117234+0000", 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2087e-05 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117259+0000", 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5381999999999999e-05 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117279+0000", 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9726999999999999e-05 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117405+0000", 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126267 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117696+0000", 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000290279 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.123539+0000", 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058431020000000002 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.151612+0000", 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.028073213999999999 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.151631+0000", 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9429e-05 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.151719+0000", 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7491999999999995e-05 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.151777+0000", 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8482e-05 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:99785 3.10 3:0f040b13:::rbd_object_map.118b61442e0a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-18T05:15:23.223 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:07.117390+0000", 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.021140912, 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.035479532000000001, 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 99785 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117390+0000", 2024-09-18T05:15:23.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117390+0000", 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117388+0000", 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117400+0000", 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2106999999999999e-05 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117424+0000", 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4006e-05 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.117440+0000", 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6475999999999999e-05 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.150032+0000", 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032591847 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.150174+0000", 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014217400000000001 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.150740+0000", 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056556599999999999 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.152023+0000", 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012827730000000001 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.152757+0000", 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073390900000000004 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.152824+0000", 2024-09-18T05:15:23.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7348999999999995e-05 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:07.152870+0000", 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5559000000000002e-05 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:102332 3.10 3:0b2ae2d1:::rbd_data.118b62cc3496.000000000000001a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 11.011606022, 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.065837997999999995, 2024-09-18T05:15:23.229 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102332 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126923+0000", 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126935+0000", 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1970000000000001e-05 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126960+0000", 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4888999999999998e-05 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126980+0000", 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0642999999999999e-05 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127082+0000", 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101118 2024-09-18T05:15:23.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127332+0000", 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000250771 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.140319+0000", 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012987115 2024-09-18T05:15:23.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192666+0000", 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052346629999999998 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192681+0000", 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4769e-05 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192726+0000", 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4925000000000001e-05 2024-09-18T05:15:23.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192763+0000", 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7141000000000002e-05 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:23.235 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:23.236 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:23.134+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:23.237 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:23.238 INFO:teuthology.orchestra.run.smithi017.stdout:5559 writesame 0xc5e2a0e thru 0xc5eba6f data_size 0x1(0x9062 bytes) 2024-09-18T05:15:23.238 INFO:teuthology.orchestra.run.smithi017.stdout:5560 write 0x704fdba thru 0x705098b (0xbd2 bytes) 2024-09-18T05:15:23.238 INFO:teuthology.orchestra.run.smithi017.stdout:5562 trunc from 0xc5eba70 to 0x90db2cc 2024-09-18T05:15:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:5563 read 0x43a1f6f thru 0x43a36ee (0x1780 bytes) 2024-09-18T05:15:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:5564 write 0x91eec78 thru 0x91ef875 (0xbfe bytes) 2024-09-18T05:15:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:5565 write 0x8efe786 thru 0x8f0b4ef (0xcd6a bytes) 2024-09-18T05:15:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:5566 write 0xc7b6733 thru 0xc7bc83c (0x610a bytes) 2024-09-18T05:15:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:5567 read 0x39f819f thru 0x3a03c35 (0xba97 bytes) 2024-09-18T05:15:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:5570 writesame 0xd7b38d9 thru 0xd7b8181 data_size 0xb(0x48a9 bytes) 2024-09-18T05:15:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:5571 read 0x9c088d4 thru 0x9c09053 (0x780 bytes) 2024-09-18T05:15:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:5572 write 0xde2eee2 thru 0xde3383b (0x495a bytes) 2024-09-18T05:15:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:5574 trunc from 0xde3383c to 0xa775370 2024-09-18T05:15:23.243 INFO:teuthology.orchestra.run.smithi017.stdout:5576 write 0xd851a15 thru 0xd853c9a (0x2286 bytes) 2024-09-18T05:15:23.243 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:23.238+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:23.248 INFO:teuthology.orchestra.run.smithi017.stdout:5578 read 0xc83c756 thru 0xc846fc0 (0xa86b bytes) 2024-09-18T05:15:23.248 INFO:teuthology.orchestra.run.smithi017.stdout:5579 read 0x8dc35e8 thru 0x8dc7675 (0x408e bytes) 2024-09-18T05:15:23.248 INFO:teuthology.orchestra.run.smithi017.stdout:5580 writesame 0x1cc5ff0 thru 0x1cce000 data_size 0x5(0x8011 bytes) 2024-09-18T05:15:23.262 INFO:teuthology.orchestra.run.smithi017.stdout:5581 write 0x53c4e6 thru 0x544a8d (0x85a8 bytes) 2024-09-18T05:15:23.277 INFO:teuthology.orchestra.run.smithi017.stdout:5583 trunc from 0xd853c9b to 0x621358d 2024-09-18T05:15:23.282 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:23.282 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:23.295 INFO:teuthology.orchestra.run.smithi017.stdout:5584 write 0x255aa0c thru 0x255b7ea (0xddf bytes) 2024-09-18T05:15:23.299 INFO:teuthology.orchestra.run.smithi017.stdout:5585 trunc from 0x621358d to 0x5c4a877 2024-09-18T05:15:23.302 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:23.303 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:23.308 INFO:teuthology.orchestra.run.smithi017.stdout:5586 trunc from 0x5c4a877 to 0x652be85 2024-09-18T05:15:23.316 INFO:teuthology.orchestra.run.smithi017.stdout:5587 punch from 0x2d7a24c to 0x2d7b6b5, (0x1469 bytes) 2024-09-18T05:15:23.317 INFO:teuthology.orchestra.run.smithi017.stdout:5588 write 0x3071d79 thru 0x307e861 (0xcae9 bytes) 2024-09-18T05:15:23.320 INFO:teuthology.orchestra.run.smithi017.stdout:5589 clone 43 order 18 su 2048 sc 6 2024-09-18T05:15:23.324 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:23.341 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:23.342 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:23.336+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:23.361 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:23.361 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:23.368 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:23.368 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:23.381 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:23.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:23.401 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:23.422 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:23.422 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:23.482 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:23.478+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:23.520 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:23.520 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:23.534 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:23.544 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:23.540+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:23.645 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:23.638+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:23.705 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:23.705 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:23.719 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:23.746 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:23.740+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:23.847 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:23.842+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:23.887 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:23.888 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:23.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:23.938 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:15:23.948 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:23.944+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:24.050 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:24.044+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:24.066 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:24.066 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:24.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:24.151 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:24.146+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:24.164 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-18T05:15:24.172 INFO:teuthology.orchestra.run.smithi017.stdout:5591 punch from 0x176cba8 to 0x176f4ae, (0x2906 bytes) 2024-09-18T05:15:24.176 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:24.177 INFO:teuthology.orchestra.run.smithi017.stdout:5594 punch from 0x46515af to 0x4658af9, (0x754a bytes) 2024-09-18T05:15:24.186 INFO:teuthology.orchestra.run.smithi017.stdout:5595 trunc from 0x652be85 to 0xc6bd224 2024-09-18T05:15:24.195 INFO:teuthology.orchestra.run.smithi017.stdout:5596 read 0x7e47ad9 thru 0x7e4fc56 (0x817e bytes) 2024-09-18T05:15:24.195 INFO:teuthology.orchestra.run.smithi017.stdout:5597 write 0x2fadda thru 0x300ddd (0x6004 bytes) 2024-09-18T05:15:24.238 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:24.238 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:24.252 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:24.246+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:24.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:24.353 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:24.348+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:24.392 INFO:teuthology.orchestra.run.smithi017.stdout:5598 write 0x941552 thru 0x9422ea (0xd99 bytes) 2024-09-18T05:15:24.428 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:24.428 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:24.440 INFO:teuthology.orchestra.run.smithi017.stdout:5601 write 0x42d5a7c thru 0x42ddcaa (0x822f bytes) 2024-09-18T05:15:24.444 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:15:24.454 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:24.448+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:24.527 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-18T05:15:24.528 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:15:24.528 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-18T05:15:24.528 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-18T05:15:24.549 INFO:teuthology.orchestra.run.smithi017.stdout:5602 write 0xdbec863 thru 0xdbece91 (0x62f bytes) 2024-09-18T05:15:24.554 INFO:teuthology.orchestra.run.smithi017.stdout:5604 writesame 0x5978b48 thru 0x59828f9 data_size 0x16(0x9db2 bytes) 2024-09-18T05:15:24.555 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:24.548+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:24.567 INFO:teuthology.orchestra.run.smithi017.stdout:5605 trunc from 0xdbece92 to 0xc66191d 2024-09-18T05:15:24.580 INFO:teuthology.orchestra.run.smithi017.stdout:5606 writesame 0xa99ce67 thru 0xa9a298e data_size 0x4(0x5b28 bytes) 2024-09-18T05:15:24.603 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:24.603 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:24.608 INFO:teuthology.orchestra.run.smithi017.stdout:5607 trunc from 0xc66191d to 0x20dc7c0 2024-09-18T05:15:24.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:15:24.654 INFO:teuthology.orchestra.run.smithi017.stdout:5608 trunc from 0x20dc7c0 to 0xb17b976 2024-09-18T05:15:24.656 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:24.650+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:24.661 INFO:teuthology.orchestra.run.smithi017.stdout:5609 read 0xa6bee9a thru 0xa6cea4e (0xfbb5 bytes) 2024-09-18T05:15:24.662 INFO:teuthology.orchestra.run.smithi017.stdout:5610 read 0x731fb74 thru 0x7328247 (0x86d4 bytes) 2024-09-18T05:15:24.662 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:24.662 INFO:teuthology.orchestra.run.smithi017.stdout:5612 punch from 0x2bbdcb0 to 0x2bc3050, (0x53a0 bytes) 2024-09-18T05:15:24.662 INFO:teuthology.orchestra.run.smithi017.stdout:5613 writesame 0x4866a02 thru 0x486bb59 data_size 0x4c(0x5158 bytes) 2024-09-18T05:15:24.674 INFO:teuthology.orchestra.run.smithi017.stdout:5614 write 0x636a704 thru 0x636c211 (0x1b0e bytes) 2024-09-18T05:15:24.683 INFO:teuthology.orchestra.run.smithi017.stdout:5615 punch from 0x3b6491 to 0x3c396c, (0xd4db bytes) 2024-09-18T05:15:24.683 INFO:teuthology.orchestra.run.smithi017.stdout:5618 read 0x14fd8b2 thru 0x1505427 (0x7b76 bytes) 2024-09-18T05:15:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:5619 write 0x9d563bc thru 0x9d5694f (0x594 bytes) 2024-09-18T05:15:24.694 INFO:teuthology.orchestra.run.smithi017.stdout:5620 read 0x82522f4 thru 0x8260864 (0xe571 bytes) 2024-09-18T05:15:24.694 INFO:teuthology.orchestra.run.smithi017.stdout:5621 punch from 0x769b73a to 0x76a2544, (0x6e0a bytes) 2024-09-18T05:15:24.694 INFO:teuthology.orchestra.run.smithi017.stdout:5622 writesame 0x91fa29e thru 0x92001d1 data_size 0x12(0x5f34 bytes) 2024-09-18T05:15:24.718 INFO:teuthology.orchestra.run.smithi017.stdout:5623 trunc from 0xb17b976 to 0x21a7150 2024-09-18T05:15:24.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-18T05:15:24.744 INFO:teuthology.orchestra.run.smithi017.stdout:5625 writesame 0x262c512 thru 0x2630569 data_size 0x3a(0x4058 bytes) 2024-09-18T05:15:24.757 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:24.752+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:24.757 INFO:teuthology.orchestra.run.smithi017.stdout:5626 write 0x68b4a3e thru 0x68c3723 (0xece6 bytes) 2024-09-18T05:15:24.774 INFO:teuthology.orchestra.run.smithi017.stdout:5627 trunc from 0x68c3724 to 0xb0329b8 2024-09-18T05:15:24.783 INFO:teuthology.orchestra.run.smithi017.stdout:5628 trunc from 0xb0329b8 to 0x8f77e5b 2024-09-18T05:15:24.790 INFO:teuthology.orchestra.run.smithi017.stdout:5629 read 0x809667f thru 0x80a540b (0xed8d bytes) 2024-09-18T05:15:24.790 INFO:teuthology.orchestra.run.smithi017.stdout:5630 read 0x56262e1 thru 0x56264a4 (0x1c4 bytes) 2024-09-18T05:15:24.790 INFO:teuthology.orchestra.run.smithi017.stdout:5631 trunc from 0x8f77e5b to 0x90131c1 2024-09-18T05:15:24.795 INFO:teuthology.orchestra.run.smithi017.stdout:5632 writesame 0x5e7d753 thru 0x5e8aee4 data_size 0x1(0xd792 bytes) 2024-09-18T05:15:24.808 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:24.808 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:24.825 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:24.826 INFO:teuthology.orchestra.run.smithi017.stdout:5634 punch from 0x2a8d506 to 0x2a971a2, (0x9c9c bytes) 2024-09-18T05:15:24.826 INFO:teuthology.orchestra.run.smithi017.stdout:5635 read 0x3457540 thru 0x3466f72 (0xfa33 bytes) 2024-09-18T05:15:24.826 INFO:teuthology.orchestra.run.smithi017.stdout:5636 read 0x6978f83 thru 0x69888e4 (0xf962 bytes) 2024-09-18T05:15:24.826 INFO:teuthology.orchestra.run.smithi017.stdout:5637 write 0x2d57e1a thru 0x2d6412e (0xc315 bytes) 2024-09-18T05:15:24.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:24.837 INFO:teuthology.orchestra.run.smithi017.stdout:5641 write 0x18c3ba thru 0x1926ab (0x62f2 bytes) 2024-09-18T05:15:24.845 INFO:teuthology.orchestra.run.smithi017.stdout:5642 writesame 0x8be067b thru 0x8be6740 data_size 0x3(0x60c6 bytes) 2024-09-18T05:15:24.857 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:24.852+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:24.867 INFO:teuthology.orchestra.run.smithi017.stdout:5643 writesame 0xb4afde7 thru 0xb4bbfcd data_size 0x1(0xc1e7 bytes) 2024-09-18T05:15:24.868 INFO:teuthology.orchestra.run.smithi017.stdout:5644 trunc from 0xb4bbfce to 0xae7c1b7 2024-09-18T05:15:24.876 INFO:teuthology.orchestra.run.smithi017.stdout:5645 write 0x723247c thru 0x7241cda (0xf85f bytes) 2024-09-18T05:15:24.897 INFO:teuthology.orchestra.run.smithi017.stdout:5646 trunc from 0xae7c1b7 to 0x24359c2 2024-09-18T05:15:24.923 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:24.923 INFO:teuthology.orchestra.run.smithi017.stdout:5648 read 0x1242f7 thru 0x12b723 (0x742d bytes) 2024-09-18T05:15:24.926 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:24.941 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-18T05:15:24.942 INFO:teuthology.orchestra.run.smithi017.stdout:5651 write 0xaed38e4 thru 0xaed9a94 (0x61b1 bytes) 2024-09-18T05:15:24.953 INFO:teuthology.orchestra.run.smithi017.stdout:5652 write 0x6d38895 thru 0x6d38f97 (0x703 bytes) 2024-09-18T05:15:24.957 INFO:teuthology.orchestra.run.smithi017.stdout:5653 punch from 0xf2019d to 0xf27174, (0x6fd7 bytes) 2024-09-18T05:15:24.957 INFO:teuthology.orchestra.run.smithi017.stdout:5654 write 0x1891bf3 thru 0x18963a8 (0x47b6 bytes) 2024-09-18T05:15:24.958 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:24.954+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:24.979 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:24.980 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:24.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:25.086 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:25.082+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:25.104 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:25.115 INFO:teuthology.orchestra.run.smithi017.stdout:5658 write 0xe2e6937 thru 0xe2e6a6e (0x138 bytes) 2024-09-18T05:15:25.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-18T05:15:25.120 INFO:teuthology.orchestra.run.smithi017.stdout:5659 flatten 2024-09-18T05:15:25.160 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:25.156+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:25.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:25.260 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:25.256+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:25.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-18T05:15:25.361 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:25.356+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:25.387 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:25.388 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:25.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:25.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:25.494 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:25.490+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:25.554 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:25.554 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:25.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-18T05:15:25.562 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:25.556+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:25.568 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:25.627 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:25.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:25.663 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:25.656+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:25.693 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:25.693 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:25.714 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:25.714 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:25.748 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:25.749 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:25.763 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:25.756+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:25.768 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:25.788 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:25.788 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:25.788 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:25.788 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:25.788 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:25.800 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:25.800 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:25.806 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:25.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-18T05:15:25.823 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:25.892 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:25.888+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:25.964 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:25.960+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:25.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:15:25.990 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-18T05:15:25.997 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:25.997 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:25.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:25.997 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:25.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:25.997 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:25.997 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:25.997 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247340961999999, 2024-09-18T05:15:25.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:25.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:25.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:15:26.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.002 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.002 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:26.002 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247331972000001, 2024-09-18T05:15:26.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:15:26.002 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.002 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.002 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.002 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.004 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.004 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:15:26.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.004 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:15:26.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247323004999998, 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:15:26.008 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247314222, 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:15:26.016 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247305445999999, 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:15:26.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247295154, 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.021 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:15:26.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:15:26.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247281267000002, 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:15:26.025 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247272061, 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:26.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.033 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247263362999998, 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.034 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:26.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247254298000001, 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.042 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247230940000001, 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:26.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:26.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:15:26.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:26.047 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247221275000001, 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:15:26.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247194918000002, 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.052 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:26.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:15:26.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247181386000001, 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:15:26.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:15:26.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247169934999999, 2024-09-18T05:15:26.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:15:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:15:26.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247160453999999, 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:15:26.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247150372, 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:15:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247141284000001, 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:15:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:15:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247131726999999, 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:15:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.247122906000001, 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:15:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:15:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.086 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:26.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:26.088 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:26.084+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:26.128 INFO:teuthology.orchestra.run.smithi017.stdout:5660 writesame 0x9022bfe thru 0x90276bb data_size 0x9(0x4abe bytes) 2024-09-18T05:15:26.137 INFO:teuthology.orchestra.run.smithi017.stdout:5661 write 0xb55f5f8 thru 0xb5698be (0xa2c7 bytes) 2024-09-18T05:15:26.147 INFO:teuthology.orchestra.run.smithi017.stdout:5662 write 0x9949099 thru 0x99520bf (0x9027 bytes) 2024-09-18T05:15:26.154 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:26.154 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout:5666 write 0xb207ece thru 0xb20ce81 (0x4fb4 bytes) 2024-09-18T05:15:26.165 INFO:teuthology.orchestra.run.smithi017.stdout:5667 read 0x1afcc97 thru 0x1b03dcc (0x7136 bytes) 2024-09-18T05:15:26.166 INFO:teuthology.orchestra.run.smithi017.stdout:5669 write 0x552b080 thru 0x5539612 (0xe593 bytes) 2024-09-18T05:15:26.174 INFO:teuthology.orchestra.run.smithi017.stdout:5670 writesame 0x1176e89 thru 0x1186049 data_size 0x1(0xf1c1 bytes) 2024-09-18T05:15:26.185 INFO:teuthology.orchestra.run.smithi017.stdout:5671 writesame 0xc2fe77e thru 0xc307f53 data_size 0x82(0x97d6 bytes) 2024-09-18T05:15:26.188 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:26.183+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:26.201 INFO:teuthology.orchestra.run.smithi017.stdout:5672 punch from 0x5c776b5 to 0x5c7d676, (0x5fc1 bytes) 2024-09-18T05:15:26.201 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:26.217 INFO:teuthology.orchestra.run.smithi017.stdout:5674 trunc from 0xe2e6a6f to 0x2a8cc9 2024-09-18T05:15:26.268 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:26.269 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:26.283 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:26.284 INFO:teuthology.orchestra.run.smithi017.stdout:5675 write 0xa03e38a thru 0xa04a319 (0xbf90 bytes) 2024-09-18T05:15:26.289 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:26.282+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:26.300 INFO:teuthology.orchestra.run.smithi017.stdout:5677 writesame 0xc969e32 thru 0xc97988d data_size 0x6d(0xfa5c bytes) 2024-09-18T05:15:26.302 INFO:teuthology.orchestra.run.smithi017.stdout:5678 trunc from 0xc97988e to 0xe12621a 2024-09-18T05:15:26.307 INFO:teuthology.orchestra.run.smithi017.stdout:5680 write 0x8999401 thru 0x899ee62 (0x5a62 bytes) 2024-09-18T05:15:26.316 INFO:teuthology.orchestra.run.smithi017.stdout:5681 write 0x59d14c3 thru 0x59dbaaf (0xa5ed bytes) 2024-09-18T05:15:26.336 INFO:teuthology.orchestra.run.smithi017.stdout:5682 trunc from 0xe12621a to 0x3c80615 2024-09-18T05:15:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:5683 writesame 0x78cbcd4 thru 0x78d2312 data_size 0x19(0x663f bytes) 2024-09-18T05:15:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:5684 punch from 0x2afc7d2 to 0x2b0bb18, (0xf346 bytes) 2024-09-18T05:15:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:5685 punch from 0x5c883d6 to 0x5c97b23, (0xf74d bytes) 2024-09-18T05:15:26.370 INFO:teuthology.orchestra.run.smithi017.stdout:5686 write 0xb7a92ab thru 0xb7b3b55 (0xa8ab bytes) 2024-09-18T05:15:26.379 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:26.379 INFO:teuthology.orchestra.run.smithi017.stdout:5689 read 0x1ea202a thru 0x1ea3706 (0x16dd bytes) 2024-09-18T05:15:26.380 INFO:teuthology.orchestra.run.smithi017.stdout:5690 clone 44 order 18 su 131072 sc 15 2024-09-18T05:15:26.390 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:26.383+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:26.444 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:26.444 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:26.444 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:26.444 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:26.444 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:26.459 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:26.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:26.486+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:26.592 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:26.586+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:26.624 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:26.624 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:26.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:26.624 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959943347999996, 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.625 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:26.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959876429999994, 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.629 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:26.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959787919999997, 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:26.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:26.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959737364000006, 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.640 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:26.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.640 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:26.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959674249000003, 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.645 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:26.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.650 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959627329, 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959573449999993, 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959526316999998, 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959478695000001, 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:26.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959355873999996, 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:26.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:26.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:26.673 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959274543999996, 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:26.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959203301000002, 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:26.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:26.683 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959153090000001, 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:26.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.687 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959075896000002, 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.692 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.959026026000004, 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:26.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.958951455000005, 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.698 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:26.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:26.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.958885676999998, 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:26.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:26.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.706 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.958838641, 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.707 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:26.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:26.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:26.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:26.712 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.958776548000003, 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:26.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:26.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 64.958730169000006, 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:26.721 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:26.722 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:26.723 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:26.718+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:26.824 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:26.815+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:26.854 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:26.855 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:26.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:26.956 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:26.951+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:26.962 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:15:27.030 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:27.026+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:27.045 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:27.045 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:27.045 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:27.045 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:27.045 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:27.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:27.152 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:27.147+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:27.228 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:27.219+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:27.232 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:27.232 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:27.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:27.232 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121386 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 686080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.2725978869999999, 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056108969000000002, 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121386 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955696+0000", 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0874e-05 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955703+0000", 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3189999999999997e-06 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955708+0000", 2024-09-18T05:15:27.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0429999999999998e-06 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011705+0000", 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055996870999999997 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011743+0000", 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7895000000000002e-05 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011794+0000", 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1307999999999997e-05 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121387 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 698368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.272570304, 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056181659000000002, 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.237 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121387 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955712+0000", 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955715+0000", 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3760000000000002e-06 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955721+0000", 2024-09-18T05:15:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2589999999999997e-06 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955725+0000", 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4009999999999999e-06 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011813+0000", 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056088051999999999 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011848+0000", 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4847e-05 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011894+0000", 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121388 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.2725533920000001, 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056271570999999999, 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121388 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955729+0000", 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955731+0000", 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2019999999999998e-06 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955737+0000", 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9139999999999996e-06 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955751+0000", 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3311e-05 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011914+0000", 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163594999999997 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011952+0000", 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7834999999999999e-05 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012001+0000", 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9084e-05 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121389 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 722944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.2725272620000001, 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056345279999999998, 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.246 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121389 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:27.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:27.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955755+0000", 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955759+0000", 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3850000000000002e-06 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955766+0000", 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8499999999999996e-06 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955771+0000", 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0170000000000004e-06 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012021+0000", 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056250737000000002 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012057+0000", 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5271000000000002e-05 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012101+0000", 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4403999999999997e-05 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.251 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121390 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 735232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.272506334, 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056430889999999997, 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121390 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955776+0000", 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955779+0000", 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6290000000000002e-06 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955786+0000", 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.435e-06 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955791+0000", 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7520000000000004e-06 2024-09-18T05:15:27.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012120+0000", 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056329443999999999 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012158+0000", 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7925e-05 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012208+0000", 2024-09-18T05:15:27.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9301000000000001e-05 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121391 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 747520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.272474874, 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056498934000000001, 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.256 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121391 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:27.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955811+0000", 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9560000000000002e-06 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955818+0000", 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3339999999999996e-06 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955823+0000", 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2839999999999997e-06 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012227+0000", 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056403880000000003 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012262+0000", 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4618e-05 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012307+0000", 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5413e-05 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121392 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.2724550379999999, 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056582623999999998, 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121392 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.261 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955830+0000", 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999998e-06 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955837+0000", 2024-09-18T05:15:27.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955842+0000", 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6770000000000003e-06 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012326+0000", 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056483691000000003 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012363+0000", 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7024999999999999e-05 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012411+0000", 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7845e-05 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121393 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 772096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.272436618, 2024-09-18T05:15:27.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056662902000000001, 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121393 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955848+0000", 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2350000000000002e-06 2024-09-18T05:15:27.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955855+0000", 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0500000000000003e-06 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955860+0000", 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8080000000000004e-06 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012430+0000", 2024-09-18T05:15:27.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056570047999999998 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012465+0000", 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4718000000000002e-05 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012509+0000", 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4418000000000001e-05 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121394 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 784384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.2724187259999999, 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056750383000000001, 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121394 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:27.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955866+0000", 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955873+0000", 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4810000000000003e-06 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955878+0000", 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8500000000000002e-06 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012529+0000", 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056651708000000002 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012567+0000", 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7642000000000003e-05 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012615+0000", 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7811e-05 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121395 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.272401358, 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056832344999999999, 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.274 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121395 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955881+0000", 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955884+0000", 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3240000000000001e-06 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955890+0000", 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0909999999999998e-06 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955894+0000", 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012635+0000", 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056740087000000002 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012670+0000", 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5123999999999998e-05 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012714+0000", 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4384000000000001e-05 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121396 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 808960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:27.278 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.272368884, 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057018234000000001, 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121396 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955917+0000", 2024-09-18T05:15:27.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0979999999999998e-06 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955930+0000", 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3552e-05 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955936+0000", 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7309999999999998e-06 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012733+0000", 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056797146999999999 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012770+0000", 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7239e-05 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012932+0000", 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016205000000000001 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.282 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121397 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 821248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.272342227, 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057105428999999999, 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121397 2024-09-18T05:15:27.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955940+0000", 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955943+0000", 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7439999999999999e-06 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955950+0000", 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8129999999999998e-06 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955957+0000", 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1849999999999998e-06 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012953+0000", 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056995559000000001 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012987+0000", 2024-09-18T05:15:27.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4777000000000003e-05 2024-09-18T05:15:27.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013046+0000", 2024-09-18T05:15:27.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8867999999999999e-05 2024-09-18T05:15:27.287 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.287 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.287 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121398 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 833536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.2723213499999999, 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057212333999999997, 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.288 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121398 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955961+0000", 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955970+0000", 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6759999999999996e-06 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955981+0000", 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0706999999999999e-05 2024-09-18T05:15:27.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955986+0000", 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0719999999999999e-06 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013067+0000", 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057081595999999998 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013111+0000", 2024-09-18T05:15:27.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3331999999999998e-05 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013174+0000", 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3323000000000003e-05 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121399 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.272292338, 2024-09-18T05:15:27.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057281034000000002, 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121399 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955990+0000", 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955993+0000", 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955999+0000", 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4699999999999999e-06 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.956004+0000", 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013194+0000", 2024-09-18T05:15:27.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057189503000000003 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013233+0000", 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9082000000000003e-05 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013272+0000", 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9014000000000003e-05 2024-09-18T05:15:27.296 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121415 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.269460102, 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023800999999998, 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.297 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121415 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958825+0000", 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.835e-06 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958831+0000", 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.088e-06 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958842+0000", 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0916e-05 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014771+0000", 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055928731000000002 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014809+0000", 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7713999999999998e-05 2024-09-18T05:15:27.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014847+0000", 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7888e-05 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121416 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 528384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.269434857, 2024-09-18T05:15:27.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056112120000000001, 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121416 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958850+0000", 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.729e-06 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958858+0000", 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958866+0000", 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2840000000000006e-06 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014866+0000", 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056000419000000003 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014907+0000", 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0533e-05 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014960+0000", 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3427000000000002e-05 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.305 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121417 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 540672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.2694114089999999, 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056196533999999999, 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.306 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121417 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958871+0000", 2024-09-18T05:15:27.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958874+0000", 2024-09-18T05:15:27.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.537e-06 2024-09-18T05:15:27.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958881+0000", 2024-09-18T05:15:27.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1840000000000002e-06 2024-09-18T05:15:27.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958886+0000", 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014981+0000", 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056095036000000001 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015017+0000", 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6732e-05 2024-09-18T05:15:27.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015068+0000", 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0855e-05 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.311 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121418 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 552960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.269318282, 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056223713000000002, 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121418 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958889+0000", 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999247 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958968+0000", 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8638000000000002e-05 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958990+0000", 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1614e-05 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959004+0000", 2024-09-18T05:15:27.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4157e-05 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015088+0000", 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056084547999999998 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015129+0000", 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1048999999999999e-05 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015188+0000", 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8967e-05 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121420 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 577536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.268902558, 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056036506999999999, 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.316 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121420 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959383+0000", 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3689999999999998e-06 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959390+0000", 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1799999999999999e-06 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959396+0000", 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5330000000000002e-06 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015330+0000", 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055934086000000001 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015369+0000", 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8732000000000001e-05 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015417+0000", 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8241000000000001e-05 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.320 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121421 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 589824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.268881945, 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056116280999999997, 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121421 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959403+0000", 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6989999999999999e-06 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959409+0000", 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1099999999999999e-06 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959414+0000", 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6190000000000002e-06 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015437+0000", 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023252000000003 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015473+0000", 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6086e-05 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015517+0000", 2024-09-18T05:15:27.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4082999999999998e-05 2024-09-18T05:15:27.325 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.325 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.325 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.325 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.325 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.325 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:27.326 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-09-18T05:15:27.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:27.368 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:27.363+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:27.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:27.422+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:27.498 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:27.498 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:27.498 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:27.498 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:27.512 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:27.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:27.522+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:27.536 INFO:teuthology.orchestra.run.smithi017.stdout:5691 read 0x7a0576d thru 0x7a09e76 (0x470a bytes) 2024-09-18T05:15:27.554 INFO:teuthology.orchestra.run.smithi017.stdout:5693 write 0xc497291 thru 0xc4a3fad (0xcd1d bytes) 2024-09-18T05:15:27.561 INFO:teuthology.orchestra.run.smithi017.stdout:5694 read 0x5b71278 thru 0x5b7c370 (0xb0f9 bytes) 2024-09-18T05:15:27.561 INFO:teuthology.orchestra.run.smithi017.stdout:5696 writesame 0x4995904 thru 0x499b8da data_size 0x7(0x5fd7 bytes) 2024-09-18T05:15:27.569 INFO:teuthology.orchestra.run.smithi017.stdout:5698 read 0x62e1173 thru 0x62edd29 (0xcbb7 bytes) 2024-09-18T05:15:27.569 INFO:teuthology.orchestra.run.smithi017.stdout:5699 read 0x21feac8 thru 0x21ffe4b (0x1384 bytes) 2024-09-18T05:15:27.569 INFO:teuthology.orchestra.run.smithi017.stdout:5700 read 0x29986f5 thru 0x299f99f (0x72ab bytes) 2024-09-18T05:15:27.588 INFO:teuthology.orchestra.run.smithi017.stdout:5702 trunc from 0xc4a3fae to 0x7feedf 2024-09-18T05:15:27.630 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:27.626+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:27.643 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:27.644 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:27.644 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:27.644 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:27.644 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:27.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:27.661 INFO:teuthology.orchestra.run.smithi017.stdout:5703 writesame 0xb80ec88 thru 0xb813fe8 data_size 0x5(0x5361 bytes) 2024-09-18T05:15:27.662 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.662 INFO:teuthology.orchestra.run.smithi017.stdout:5706 write 0xe9d558 thru 0xea4b20 (0x75c9 bytes) 2024-09-18T05:15:27.671 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5708 read 0xa190db5 thru 0xa19c428 (0xb674 bytes) 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5711 read 0x16e6019 thru 0x16f06f5 (0xa6dd bytes) 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5712 punch from 0xa3c3e87 to 0xa3d0630, (0xc7a9 bytes) 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5713 read 0x781ca6a thru 0x782a32e (0xd8c5 bytes) 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5714 read 0x31c20aa thru 0x31c6fb0 (0x4f07 bytes) 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5715 punch from 0x7865113 to 0x7874977, (0xf864 bytes) 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5717 read 0x6e277f1 thru 0x6e28741 (0xf51 bytes) 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5718 punch from 0x561c6a0 to 0x5627818, (0xb178 bytes) 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5719 punch from 0x8ab1f28 to 0x8ac07be, (0xe896 bytes) 2024-09-18T05:15:27.672 INFO:teuthology.orchestra.run.smithi017.stdout:5720 punch from 0x2600c56 to 0x2605589, (0x4933 bytes) 2024-09-18T05:15:27.673 INFO:teuthology.orchestra.run.smithi017.stdout:5722 write 0x33c85dd thru 0x33d78e0 (0xf304 bytes) 2024-09-18T05:15:27.677 INFO:teuthology.orchestra.run.smithi017.stdout:5723 read 0xa1312ae thru 0xa13f578 (0xe2cb bytes) 2024-09-18T05:15:27.677 INFO:teuthology.orchestra.run.smithi017.stdout:5724 flatten 2024-09-18T05:15:27.727 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.728 INFO:teuthology.orchestra.run.smithi017.stdout:5727 read 0x712d18d thru 0x7139dbf (0xcc33 bytes) 2024-09-18T05:15:27.728 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.728 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.728 INFO:teuthology.orchestra.run.smithi017.stdout:5732 read 0x9e4065f thru 0x9e44e40 (0x47e2 bytes) 2024-09-18T05:15:27.728 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.728 INFO:teuthology.orchestra.run.smithi017.stdout:5735 punch from 0xac69c1d to 0xac6e28a, (0x466d bytes) 2024-09-18T05:15:27.728 INFO:teuthology.orchestra.run.smithi017.stdout:5736 write 0x63fad82 thru 0x640604f (0xb2ce bytes) 2024-09-18T05:15:27.731 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:27.726+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:27.735 INFO:teuthology.orchestra.run.smithi017.stdout:5737 punch from 0x28fbb58 to 0x2903446, (0x78ee bytes) 2024-09-18T05:15:27.735 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.735 INFO:teuthology.orchestra.run.smithi017.stdout:5739 read 0x30ae1a2 thru 0x30baf42 (0xcda1 bytes) 2024-09-18T05:15:27.736 INFO:teuthology.orchestra.run.smithi017.stdout:5740 write 0x7ca2738 thru 0x7cae321 (0xbbea bytes) 2024-09-18T05:15:27.740 INFO:teuthology.orchestra.run.smithi017.stdout:5741 read 0xef5456 thru 0xefe669 (0x9214 bytes) 2024-09-18T05:15:27.740 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.740 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.740 INFO:teuthology.orchestra.run.smithi017.stdout:5744 write 0x24f71f9 thru 0x25056fd (0xe505 bytes) 2024-09-18T05:15:27.748 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.748 INFO:teuthology.orchestra.run.smithi017.stdout:5747 read 0x4b799a8 thru 0x4b7ee61 (0x54ba bytes) 2024-09-18T05:15:27.748 INFO:teuthology.orchestra.run.smithi017.stdout:5748 write 0x383a71f thru 0x38484f8 (0xddda bytes) 2024-09-18T05:15:27.756 INFO:teuthology.orchestra.run.smithi017.stdout:5750 writesame 0xa74ba70 thru 0xa75a52b data_size 0x53(0xeabc bytes) 2024-09-18T05:15:27.761 INFO:teuthology.orchestra.run.smithi017.stdout:5751 write 0x1c38c65 thru 0x1c48677 (0xfa13 bytes) 2024-09-18T05:15:27.770 INFO:teuthology.orchestra.run.smithi017.stdout:5752 punch from 0xa14f844 to 0xa156a47, (0x7203 bytes) 2024-09-18T05:15:27.770 INFO:teuthology.orchestra.run.smithi017.stdout:5754 read 0x9b79b7a thru 0x9b83bc5 (0xa04c bytes) 2024-09-18T05:15:27.770 INFO:teuthology.orchestra.run.smithi017.stdout:5756 write 0x9ec1a11 thru 0x9ec3ae6 (0x20d6 bytes) 2024-09-18T05:15:27.775 INFO:teuthology.orchestra.run.smithi017.stdout:5757 punch from 0x9aa8b59 to 0x9ab2511, (0x99b8 bytes) 2024-09-18T05:15:27.775 INFO:teuthology.orchestra.run.smithi017.stdout:5758 write 0xc7fdf9 thru 0xc83a52 (0x3c5a bytes) 2024-09-18T05:15:27.782 INFO:teuthology.orchestra.run.smithi017.stdout:5759 punch from 0x1652cf4 to 0x165f49f, (0xc7ab bytes) 2024-09-18T05:15:27.783 INFO:teuthology.orchestra.run.smithi017.stdout:5761 punch from 0x5ebe6a2 to 0x5ec67ba, (0x8118 bytes) 2024-09-18T05:15:27.783 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:27.783 INFO:teuthology.orchestra.run.smithi017.stdout:5764 write 0x6c28979 thru 0x6c33ba1 (0xb229 bytes) 2024-09-18T05:15:27.795 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:27.795 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:27.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:27.795 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:27.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.795 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:102332 3.10 3:0b2ae2d1:::rbd_data.118b62cc3496.000000000000001a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-18T05:15:27.795 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:27.795 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.665207577, 2024-09-18T05:15:27.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.065837997999999995, 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102332 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126923+0000", 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126935+0000", 2024-09-18T05:15:27.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1970000000000001e-05 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126960+0000", 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4888999999999998e-05 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126980+0000", 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0642999999999999e-05 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127082+0000", 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101118 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127332+0000", 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000250771 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.140319+0000", 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012987115 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192666+0000", 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052346629999999998 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192681+0000", 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4769e-05 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192726+0000", 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4925000000000001e-05 2024-09-18T05:15:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192763+0000", 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7141000000000002e-05 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121156 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2064384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.900829734, 2024-09-18T05:15:27.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038247947999999997, 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121156 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891302+0000", 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891314+0000", 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1557e-05 2024-09-18T05:15:27.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891321+0000", 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7619999999999998e-06 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891325+0000", 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6600000000000003e-06 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929365+0000", 2024-09-18T05:15:27.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038039942 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929467+0000", 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101191 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929551+0000", 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4220000000000003e-05 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121157 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2076672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.900802595, 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038423377000000002, 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121157 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.806 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891332+0000", 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891338+0000", 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9800000000000003e-06 2024-09-18T05:15:27.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891342+0000", 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3470000000000001e-06 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929593+0000", 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038250926999999997 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929674+0000", 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0976999999999994e-05 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929753+0000", 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8948000000000004e-05 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121158 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2088960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.810 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.9007859740000002, 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818722, 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121158 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891346+0000", 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891349+0000", 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5050000000000002e-06 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891355+0000", 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4370000000000004e-06 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891365+0000", 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7520000000000008e-06 2024-09-18T05:15:27.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929862+0000", 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038497177 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930078+0000", 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000215992 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930165+0000", 2024-09-18T05:15:27.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7243000000000005e-05 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121271 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1906688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.887723134, 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038405050000000003, 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.815 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121271 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904416+0000", 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0160000000000003e-06 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904423+0000", 2024-09-18T05:15:27.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9890000000000003e-06 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904428+0000", 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6890000000000003e-06 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942670+0000", 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038242653000000001 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942752+0000", 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2140999999999998e-05 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942814+0000", 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2101999999999996e-05 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121272 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1918976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:27.819 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8876955629999999, 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038493807999999997, 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121272 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904439+0000", 2024-09-18T05:15:27.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3870000000000002e-06 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904445+0000", 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0240000000000003e-06 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904450+0000", 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9400000000000001e-06 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942846+0000", 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038395692000000002 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942889+0000", 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3659000000000003e-05 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942931+0000", 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1470000000000001e-05 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.823 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121273 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1931264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8876782140000001, 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038620175, 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.824 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121273 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904456+0000", 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3360000000000002e-06 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904462+0000", 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7289999999999997e-06 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904472+0000", 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0020999999999999e-05 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942960+0000", 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038488306999999999 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943002+0000", 2024-09-18T05:15:27.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2089999999999999e-05 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943075+0000", 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2092e-05 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121274 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1943552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8876477739999999, 2024-09-18T05:15:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818021000000001, 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121274 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904484+0000", 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904487+0000", 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-18T05:15:27.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904494+0000", 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0940000000000002e-06 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904499+0000", 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.933e-06 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943121+0000", 2024-09-18T05:15:27.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038622507 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943208+0000", 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6397999999999995e-05 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943303+0000", 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4895000000000005e-05 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121275 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1955840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8876294840000001, 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039005943000000001, 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121275 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:27.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904505+0000", 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904511+0000", 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0190000000000003e-06 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904516+0000", 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9200000000000003e-06 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943351+0000", 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038834425999999998 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943430+0000", 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9505000000000005e-05 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943509+0000", 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121276 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1968128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.887612088, 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039192704000000002, 2024-09-18T05:15:27.837 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121276 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904523+0000", 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5179999999999999e-06 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904529+0000", 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4860000000000002e-06 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904533+0000", 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2390000000000004e-06 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943554+0000", 2024-09-18T05:15:27.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039020332999999997 2024-09-18T05:15:27.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943634+0000", 2024-09-18T05:15:27.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0673000000000005e-05 2024-09-18T05:15:27.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943713+0000", 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8858999999999998e-05 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121277 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1980416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.887594765, 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039321828000000003, 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121277 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:27.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904537+0000", 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904544+0000", 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8990000000000004e-06 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904551+0000", 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3940000000000001e-06 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904556+0000", 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1200000000000001e-06 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943770+0000", 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039214514999999998 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943816+0000", 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5371999999999999e-05 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943860+0000", 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3875999999999998e-05 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121278 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1992704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.849 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8875721410000001, 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039412773999999998, 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121278 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:27.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904563+0000", 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5000000000000002e-06 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904569+0000", 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.224e-06 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904574+0000", 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8659999999999997e-06 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943890+0000", 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039316027000000003 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943931+0000", 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1137000000000003e-05 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943973+0000", 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2416999999999997e-05 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.853 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121279 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2004992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8875546669999999, 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039512600000000002, 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121279 2024-09-18T05:15:27.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904580+0000", 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3640000000000002e-06 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904587+0000", 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6719999999999998e-06 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904591+0000", 2024-09-18T05:15:27.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5549999999999996e-06 2024-09-18T05:15:27.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944001+0000", 2024-09-18T05:15:27.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039410387999999998 2024-09-18T05:15:27.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944046+0000", 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4626000000000003e-05 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944090+0000", 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4351000000000003e-05 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121280 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2017280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8875367999999999, 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039608457999999999, 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121280 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904595+0000", 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904598+0000", 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4549999999999998e-06 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904604+0000", 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904609+0000", 2024-09-18T05:15:27.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7949999999999998e-06 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944120+0000", 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039511211999999997 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944161+0000", 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0766000000000002e-05 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944204+0000", 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3234e-05 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121281 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2029568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8875191259999999, 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039699867999999999, 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121281 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904615+0000", 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.305e-06 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904622+0000", 2024-09-18T05:15:27.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4320000000000004e-06 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904627+0000", 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.729e-06 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944231+0000", 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039604749000000002 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944270+0000", 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8531000000000001e-05 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944313+0000", 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3479000000000002e-05 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121282 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2041856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:27.867 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.88748026, 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039764847999999998, 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121282 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904655+0000", 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8219999999999998e-06 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904661+0000", 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8539999999999999e-06 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904677+0000", 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5488000000000001e-05 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944340+0000", 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039663588999999999 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944380+0000", 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9548999999999997e-05 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944417+0000", 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7138000000000003e-05 2024-09-18T05:15:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121283 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2054144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.887450592, 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039840091000000001, 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.872 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121283 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904689+0000", 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7190000000000001e-06 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904696+0000", 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6529999999999997e-06 2024-09-18T05:15:27.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904701+0000", 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.101e-06 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944443+0000", 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039741601000000001 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944483+0000", 2024-09-18T05:15:27.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0138000000000001e-05 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944522+0000", 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9289000000000003e-05 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121284 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2066432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8874274559999999, 2024-09-18T05:15:27.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039925616999999997, 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121284 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904707+0000", 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.616e-06 2024-09-18T05:15:27.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904714+0000", 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.161e-06 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904718+0000", 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8389999999999997e-06 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944553+0000", 2024-09-18T05:15:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039834596 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944591+0000", 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944631+0000", 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9526000000000001e-05 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121285 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2078720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8874092930000002, 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040039444, 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121285 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904726+0000", 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6630000000000002e-06 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904732+0000", 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6069999999999996e-06 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904737+0000", 2024-09-18T05:15:27.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9609999999999996e-06 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944658+0000", 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039920421999999997 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944696+0000", 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8395000000000001e-05 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944763+0000", 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6761999999999995e-05 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121286 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2091008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.8873903109999999, 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040212352999999999, 2024-09-18T05:15:27.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121286 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904744+0000", 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904751+0000", 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7689999999999999e-06 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904756+0000", 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5959999999999997e-06 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944796+0000", 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040040048000000002 2024-09-18T05:15:27.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944883+0000", 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7268999999999994e-05 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944955+0000", 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1505000000000001e-05 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:27.889 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:27.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:27.892 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:27.883+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:27.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:27.893 INFO:teuthology.orchestra.run.smithi017.stdout:5765 writesame 0xc453958 thru 0xc454477 data_size 0x8(0xb20 bytes) 2024-09-18T05:15:27.893 INFO:teuthology.orchestra.run.smithi017.stdout:5766 writesame 0xabe8d32 thru 0xabea390 data_size 0x17(0x165f bytes) 2024-09-18T05:15:27.893 INFO:teuthology.orchestra.run.smithi017.stdout:5768 trunc from 0xc454478 to 0x46ba0cb 2024-09-18T05:15:27.893 INFO:teuthology.orchestra.run.smithi017.stdout:5769 read 0x338f80b thru 0x339c9e3 (0xd1d9 bytes) 2024-09-18T05:15:27.893 INFO:teuthology.orchestra.run.smithi017.stdout:5770 punch from 0x389f233 to 0x38a94e3, (0xa2b0 bytes) 2024-09-18T05:15:27.893 INFO:teuthology.orchestra.run.smithi017.stdout:5771 writesame 0xb9cb4e8 thru 0xb9d322e data_size 0x1(0x7d47 bytes) 2024-09-18T05:15:27.893 INFO:teuthology.orchestra.run.smithi017.stdout:5772 read 0x5496ff9 thru 0x54a3a14 (0xca1c bytes) 2024-09-18T05:15:27.894 INFO:teuthology.orchestra.run.smithi017.stdout:5775 writesame 0xadf4900 thru 0xadf8df0 data_size 0x3(0x44f1 bytes) 2024-09-18T05:15:27.894 INFO:teuthology.orchestra.run.smithi017.stdout:5777 read 0x34e184e thru 0x34ee008 (0xc7bb bytes) 2024-09-18T05:15:27.896 INFO:teuthology.orchestra.run.smithi017.stdout:5779 writesame 0x7e7b5e2 thru 0x7e84164 data_size 0x5(0x8b83 bytes) 2024-09-18T05:15:27.908 INFO:teuthology.orchestra.run.smithi017.stdout:5781 read 0x9c8bf01 thru 0x9c9a49a (0xe59a bytes) 2024-09-18T05:15:27.908 INFO:teuthology.orchestra.run.smithi017.stdout:5782 write 0x4fa1539 thru 0x4fb0e98 (0xf960 bytes) 2024-09-18T05:15:27.930 INFO:teuthology.orchestra.run.smithi017.stdout:5783 trunc from 0xb9d322f to 0x485cf16 2024-09-18T05:15:27.953 INFO:teuthology.orchestra.run.smithi017.stdout:5784 read 0x403a5fb thru 0x404428c (0x9c92 bytes) 2024-09-18T05:15:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:5785 trunc from 0x485cf16 to 0x32800cb 2024-09-18T05:15:27.992 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:27.986+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:28.010 INFO:teuthology.orchestra.run.smithi017.stdout:5786 writesame 0xe829a62 thru 0xe8330f4 data_size 0x3(0x9693 bytes) 2024-09-18T05:15:28.010 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.010 INFO:teuthology.orchestra.run.smithi017.stdout:5789 punch from 0x8217352 to 0x821d3d2, (0x6080 bytes) 2024-09-18T05:15:28.010 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.010 INFO:teuthology.orchestra.run.smithi017.stdout:5792 write 0xbd719a5 thru 0xbd74623 (0x2c7f bytes) 2024-09-18T05:15:28.015 INFO:teuthology.orchestra.run.smithi017.stdout:5793 read 0x15e0c68 thru 0x15efffd (0xf396 bytes) 2024-09-18T05:15:28.029 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:28.029 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:28.029 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:28.029 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:28.032 INFO:teuthology.orchestra.run.smithi017.stdout:5794 trunc from 0xe8330f5 to 0x29be923 2024-09-18T05:15:28.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:28.053 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.062 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:28.063 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:28.074 INFO:teuthology.orchestra.run.smithi017.stdout:5796 write 0x92f0f80 thru 0x92f1ef2 (0xf73 bytes) 2024-09-18T05:15:28.080 INFO:teuthology.orchestra.run.smithi017.stdout:5797 punch from 0x4506722 to 0x450ec54, (0x8532 bytes) 2024-09-18T05:15:28.080 INFO:teuthology.orchestra.run.smithi017.stdout:5798 read 0x1eef5f1 thru 0x1ef12f4 (0x1d04 bytes) 2024-09-18T05:15:28.080 INFO:teuthology.orchestra.run.smithi017.stdout:5799 punch from 0x411f233 to 0x412b5bf, (0xc38c bytes) 2024-09-18T05:15:28.080 INFO:teuthology.orchestra.run.smithi017.stdout:5801 writesame 0x4c96638 thru 0x4c99b0a data_size 0x1(0x34d3 bytes) 2024-09-18T05:15:28.081 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:28.093 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:28.087+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:28.098 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:28.101 INFO:teuthology.orchestra.run.smithi017.stdout:5802 writesame 0x7583d0f thru 0x758c2a8 data_size 0x31(0x859a bytes) 2024-09-18T05:15:28.107 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.107 INFO:teuthology.orchestra.run.smithi017.stdout:5805 read 0x763afb6 thru 0x764206b (0x70b6 bytes) 2024-09-18T05:15:28.118 INFO:teuthology.orchestra.run.smithi017.stdout:5806 trunc from 0x92f1ef3 to 0x1e00629 2024-09-18T05:15:28.118 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:28.118 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:28.146 INFO:teuthology.orchestra.run.smithi017.stdout:5807 trunc from 0x1e00629 to 0x82ecba2 2024-09-18T05:15:28.155 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:28.156 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:28.158 INFO:teuthology.orchestra.run.smithi017.stdout:5808 read 0x179e3c6 thru 0x17a769d (0x92d8 bytes) 2024-09-18T05:15:28.158 INFO:teuthology.orchestra.run.smithi017.stdout:5809 write 0x3434f8d thru 0x343dec0 (0x8f34 bytes) 2024-09-18T05:15:28.170 INFO:teuthology.orchestra.run.smithi017.stdout:5810 trunc from 0x82ecba2 to 0x3ebae49 2024-09-18T05:15:28.177 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:28.178 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:28.181 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.181 INFO:teuthology.orchestra.run.smithi017.stdout:5812 write 0x1c6a74c thru 0x1c76bb4 (0xc469 bytes) 2024-09-18T05:15:28.188 INFO:teuthology.orchestra.run.smithi017.stdout:5813 trunc from 0x3ebae49 to 0x42a12b5 2024-09-18T05:15:28.190 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:28.190 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:28.195 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:28.187+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:28.200 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:28.200 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:28.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:28.223 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:28.227 INFO:teuthology.orchestra.run.smithi017.stdout:5814 write 0xe8d3ea3 thru 0xe8d3f14 (0x72 bytes) 2024-09-18T05:15:28.233 INFO:teuthology.orchestra.run.smithi017.stdout:5815 read 0x7cf0d3c thru 0x7cfb0ee (0xa3b3 bytes) 2024-09-18T05:15:28.233 INFO:teuthology.orchestra.run.smithi017.stdout:5816 write 0x2302383 thru 0x230a803 (0x8481 bytes) 2024-09-18T05:15:28.240 INFO:teuthology.orchestra.run.smithi017.stdout:5817 trunc from 0xe8d3f15 to 0xdb8a532 2024-09-18T05:15:28.261 INFO:teuthology.orchestra.run.smithi017.stdout:5818 read 0xd8500ea thru 0xd8593cf (0x92e6 bytes) 2024-09-18T05:15:28.261 INFO:teuthology.orchestra.run.smithi017.stdout:5820 write 0xbe9a07a thru 0xbea10c1 (0x7048 bytes) 2024-09-18T05:15:28.269 INFO:teuthology.orchestra.run.smithi017.stdout:5821 read 0xd15bf67 thru 0xd15c1b1 (0x24b bytes) 2024-09-18T05:15:28.270 INFO:teuthology.orchestra.run.smithi017.stdout:5822 trunc from 0xdb8a532 to 0xe8243fb 2024-09-18T05:15:28.282 INFO:teuthology.orchestra.run.smithi017.stdout:5823 writesame 0xaab2a3 thru 0xab076e data_size 0x4(0x54cc bytes) 2024-09-18T05:15:28.293 INFO:teuthology.orchestra.run.smithi017.stdout:5824 punch from 0x4ec94dc to 0x4ed432e, (0xae52 bytes) 2024-09-18T05:15:28.293 INFO:teuthology.orchestra.run.smithi017.stdout:5825 punch from 0xbfd127d to 0xbfdc64b, (0xb3ce bytes) 2024-09-18T05:15:28.295 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:28.287+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:28.311 INFO:teuthology.orchestra.run.smithi017.stdout:5826 trunc from 0xe8243fb to 0x33c422a 2024-09-18T05:15:28.350 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:28.351 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:28.367 INFO:teuthology.orchestra.run.smithi017.stdout:5827 writesame 0xc0287b0 thru 0xc02913f data_size 0x24(0x990 bytes) 2024-09-18T05:15:28.368 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:28.385 INFO:teuthology.orchestra.run.smithi017.stdout:5828 trunc from 0xc029140 to 0x2bdcfd4 2024-09-18T05:15:28.407 INFO:teuthology.orchestra.run.smithi017.stdout:5829 writesame 0x206f34a thru 0x207c301 data_size 0x88(0xcfb8 bytes) 2024-09-18T05:15:28.407 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:28.402+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:28.414 INFO:teuthology.orchestra.run.smithi017.stdout:5830 read 0x22441a2 thru 0x2253ffc (0xfe5b bytes) 2024-09-18T05:15:28.414 INFO:teuthology.orchestra.run.smithi017.stdout:5831 read 0x7bb786 thru 0x7c8fcc (0xd847 bytes) 2024-09-18T05:15:28.436 INFO:teuthology.orchestra.run.smithi017.stdout:5832 write 0x722aabd thru 0x7233336 (0x887a bytes) 2024-09-18T05:15:28.442 INFO:teuthology.orchestra.run.smithi017.stdout:5833 punch from 0x5740228 to 0x574eb04, (0xe8dc bytes) 2024-09-18T05:15:28.442 INFO:teuthology.orchestra.run.smithi017.stdout:5834 read 0x701da5c thru 0x70245cb (0x6b70 bytes) 2024-09-18T05:15:28.442 INFO:teuthology.orchestra.run.smithi017.stdout:5836 writesame 0x555c505 thru 0x55621ba data_size 0x1(0x5cb6 bytes) 2024-09-18T05:15:28.463 INFO:teuthology.orchestra.run.smithi017.stdout:5837 write 0x6d4f69b thru 0x6d54e29 (0x578f bytes) 2024-09-18T05:15:28.471 INFO:teuthology.orchestra.run.smithi017.stdout:5838 write 0x2cd67b2 thru 0x2ce0fc5 (0xa814 bytes) 2024-09-18T05:15:28.481 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.481 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.483 INFO:teuthology.orchestra.run.smithi017.stdout:5842 trunc from 0x7233337 to 0x8e04160 2024-09-18T05:15:28.497 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:28.490+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:28.499 INFO:teuthology.orchestra.run.smithi017.stdout:5843 writesame 0x11817cc thru 0x1189fbe data_size 0x9(0x87f3 bytes) 2024-09-18T05:15:28.527 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:28.527 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:28.531 INFO:teuthology.orchestra.run.smithi017.stdout:5844 writesame 0xdceb6f3 thru 0xdcf5e6e data_size 0x36(0xa77c bytes) 2024-09-18T05:15:28.531 INFO:teuthology.orchestra.run.smithi017.stdout:5845 read 0x1c4abd1 thru 0x1c4f493 (0x48c3 bytes) 2024-09-18T05:15:28.532 INFO:teuthology.orchestra.run.smithi017.stdout:5846 read 0x70fe7e0 thru 0x710a7c9 (0xbfea bytes) 2024-09-18T05:15:28.532 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.532 INFO:teuthology.orchestra.run.smithi017.stdout:5849 read 0x92023d1 thru 0x920916d (0x6d9d bytes) 2024-09-18T05:15:28.532 INFO:teuthology.orchestra.run.smithi017.stdout:5850 write 0x2928f12 thru 0x293498b (0xba7a bytes) 2024-09-18T05:15:28.546 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:28.546 INFO:teuthology.orchestra.run.smithi017.stdout:5851 trunc from 0xdcf5e6f to 0x9da3e66 2024-09-18T05:15:28.560 INFO:teuthology.orchestra.run.smithi017.stdout:5852 punch from 0x5f0414d to 0x5f0c808, (0x86bb bytes) 2024-09-18T05:15:28.562 INFO:teuthology.orchestra.run.smithi017.stdout:5853 trunc from 0x9da3e66 to 0xaecb9f1 2024-09-18T05:15:28.574 INFO:teuthology.orchestra.run.smithi017.stdout:5854 read 0x16d7caa thru 0x16df5a7 (0x78fe bytes) 2024-09-18T05:15:28.574 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.575 INFO:teuthology.orchestra.run.smithi017.stdout:5857 writesame 0x415f15c thru 0x4165693 data_size 0x8(0x6538 bytes) 2024-09-18T05:15:28.582 INFO:teuthology.orchestra.run.smithi017.stdout:5858 punch from 0x884fd91 to 0x885a986, (0xabf5 bytes) 2024-09-18T05:15:28.582 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.582 INFO:teuthology.orchestra.run.smithi017.stdout:5860 write 0x9c7212f thru 0x9c7ed02 (0xcbd4 bytes) 2024-09-18T05:15:28.588 INFO:teuthology.orchestra.run.smithi017.stdout:5861 read 0x7c493cf thru 0x7c526ce (0x9300 bytes) 2024-09-18T05:15:28.592 INFO:teuthology.orchestra.run.smithi017.stdout:5863 trunc from 0xaecb9f1 to 0xd2dce5f 2024-09-18T05:15:28.597 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:28.590+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:28.603 INFO:teuthology.orchestra.run.smithi017.stdout:5866 write 0x9bb4288 thru 0x9bc258c (0xe305 bytes) 2024-09-18T05:15:28.612 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.612 INFO:teuthology.orchestra.run.smithi017.stdout:5868 writesame 0x8ec059e thru 0x8ec0a0d data_size 0x8(0x470 bytes) 2024-09-18T05:15:28.618 INFO:teuthology.orchestra.run.smithi017.stdout:5869 write 0x79996f7 thru 0x79a4bc6 (0xb4d0 bytes) 2024-09-18T05:15:28.625 INFO:teuthology.orchestra.run.smithi017.stdout:5871 write 0x1cb7123 thru 0x1cbcb24 (0x5a02 bytes) 2024-09-18T05:15:28.631 INFO:teuthology.orchestra.run.smithi017.stdout:5872 read 0xca7667c thru 0xca78ca8 (0x262d bytes) 2024-09-18T05:15:28.650 INFO:teuthology.orchestra.run.smithi017.stdout:5874 trunc from 0xd2dce5f to 0x29c27e9 2024-09-18T05:15:28.698 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:28.694+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:28.702 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:28.702 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:28.711 INFO:teuthology.orchestra.run.smithi017.stdout:5875 trunc from 0x29c27e9 to 0xe64b7fb 2024-09-18T05:15:28.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:5876 punch from 0x8eca2c8 to 0x8ed723e, (0xcf76 bytes) 2024-09-18T05:15:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:5877 writesame 0x50baadb thru 0x50c6cee data_size 0x2(0xc214 bytes) 2024-09-18T05:15:28.749 INFO:teuthology.orchestra.run.smithi017.stdout:5878 writesame 0xc3d2284 thru 0xc3db750 data_size 0x1(0x94cd bytes) 2024-09-18T05:15:28.792 INFO:teuthology.orchestra.run.smithi017.stdout:5879 writesame 0x57df232 thru 0x57ee292 data_size 0x3b(0xf061 bytes) 2024-09-18T05:15:28.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:28.794+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:28.801 INFO:teuthology.orchestra.run.smithi017.stdout:5880 read 0x6bfd1ff thru 0x6c0432b (0x712d bytes) 2024-09-18T05:15:28.804 INFO:teuthology.orchestra.run.smithi017.stdout:5881 trunc from 0xe64b7fb to 0xc35da75 2024-09-18T05:15:28.827 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.827 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:28.827 INFO:teuthology.orchestra.run.smithi017.stdout:5885 read 0xa6e72e7 thru 0xa6f3e75 (0xcb8f bytes) 2024-09-18T05:15:28.827 INFO:teuthology.orchestra.run.smithi017.stdout:5886 write 0x3a8351 thru 0x3b5fa5 (0xdc55 bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5887 read 0x24239db thru 0x2423a34 (0x5a bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5888 punch from 0x3a1058b to 0x3a1177a, (0x11ef bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5889 read 0x1d05092 thru 0x1d14e6e (0xfddd bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5890 read 0x165590 thru 0x169738 (0x41a9 bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5891 punch from 0x60508aa to 0x60554aa, (0x4c00 bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5892 read 0xa066189 thru 0xa06a263 (0x40db bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5893 read 0xb5c3bb5 thru 0xb5c9fa7 (0x63f3 bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5894 read 0x4ce18dc thru 0x4ceb97d (0xa0a2 bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5895 read 0x3124106 thru 0x312989a (0x5795 bytes) 2024-09-18T05:15:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:5898 write 0x9d88835 thru 0x9d8ece8 (0x64b4 bytes) 2024-09-18T05:15:28.840 INFO:teuthology.orchestra.run.smithi017.stdout:5899 punch from 0x3dd2c44 to 0x3dd9510, (0x68cc bytes) 2024-09-18T05:15:28.840 INFO:teuthology.orchestra.run.smithi017.stdout:5900 read 0x52040c8 thru 0x5204902 (0x83b bytes) 2024-09-18T05:15:28.840 INFO:teuthology.orchestra.run.smithi017.stdout:5902 trunc from 0xc35da75 to 0xc419577 2024-09-18T05:15:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:28.852 INFO:teuthology.orchestra.run.smithi017.stdout:5903 writesame 0xbb89db4 thru 0xbb8d279 data_size 0x23(0x34c6 bytes) 2024-09-18T05:15:28.859 INFO:teuthology.orchestra.run.smithi017.stdout:5904 punch from 0x2a37ca3 to 0x2a3a190, (0x24ed bytes) 2024-09-18T05:15:28.859 INFO:teuthology.orchestra.run.smithi017.stdout:5905 write 0x187e426 thru 0x1889eea (0xbac5 bytes) 2024-09-18T05:15:28.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:28.868 INFO:teuthology.orchestra.run.smithi017.stdout:5906 writesame 0x2840e6b thru 0x284c5c2 data_size 0x4(0xb758 bytes) 2024-09-18T05:15:28.885 INFO:teuthology.orchestra.run.smithi017.stdout:5908 clone 45 order 25 su 1048576 sc 8 2024-09-18T05:15:28.901 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:28.895+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:28.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:15:28.992 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:28.992 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:29.001 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:28.995+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:29.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:15:29.102 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:29.095+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:29.203 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:29.195+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:29.220 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:29.221 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:29.236 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:15:29.264 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #43, image image_client.0-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent44 2024-09-18T05:15:29.304 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:29.299+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:29.368 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:29.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:29.405 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:29.399+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:29.505 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:29.498+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:29.550 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:29.551 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:29.568 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:29.614 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:29.610+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:29.618 INFO:teuthology.orchestra.run.smithi017.stdout:5909 writesame 0xb030272 thru 0xb03ce69 data_size 0x3d(0xcbf8 bytes) 2024-09-18T05:15:29.664 INFO:teuthology.orchestra.run.smithi017.stdout:5910 write 0xe4d347b thru 0xe4de0d2 (0xac58 bytes) 2024-09-18T05:15:29.675 INFO:teuthology.orchestra.run.smithi017.stdout:5911 read 0x8780f3e thru 0x87849b3 (0x3a76 bytes) 2024-09-18T05:15:29.675 INFO:teuthology.orchestra.run.smithi017.stdout:5912 read 0x1fccea6 thru 0x1fd1bdf (0x4d3a bytes) 2024-09-18T05:15:29.680 INFO:teuthology.orchestra.run.smithi017.stdout:5914 trunc from 0xe4de0d3 to 0xbefd7b9 2024-09-18T05:15:29.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:29.702+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:29.724 INFO:teuthology.orchestra.run.smithi017.stdout:5915 read 0x2df7858 thru 0x2df7b60 (0x309 bytes) 2024-09-18T05:15:29.724 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:29.724 INFO:teuthology.orchestra.run.smithi017.stdout:5918 read 0x95d6660 thru 0x95e3be1 (0xd582 bytes) 2024-09-18T05:15:29.725 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:29.725 INFO:teuthology.orchestra.run.smithi017.stdout:5920 clone 46 order 24 su 2097152 sc 11 2024-09-18T05:15:29.755 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:29.755 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:29.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:29.810 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:29.806+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:29.909 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:29.903+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:29.938 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:29.938 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:29.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:29.965 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:15:30.030 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:30.026+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:30.066 INFO:teuthology.orchestra.run.smithi017.stdout:truncating image image_client.0-clone45 from 0xbefd7b9 (overlap 0xbefd7b9) to 0x2632b25 2024-09-18T05:15:30.098 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:30.098 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:30.111 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:30.106+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:30.113 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:30.212 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:30.207+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:30.230 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #44, image image_client.0-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent45 2024-09-18T05:15:30.236 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:30.236 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:30.245 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:30.250 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:30.340 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:30.335+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:30.410 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:30.411 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:30.414 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:30.410+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:30.425 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:30.425 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:30.427 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:30.427 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:30.439 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:30.444 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:30.445 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:30.461 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:30.461 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:30.479 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:30.480 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:30.500 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:30.501 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:30.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:30.510+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:30.517 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:30.517 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:30.536 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:30.537 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:30.609 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:30.610 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:30.610 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:30.616 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:30.610+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:30.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:5921 trunc from 0xbefd7b9 to 0xaf0dff9 2024-09-18T05:15:30.668 INFO:teuthology.orchestra.run.smithi017.stdout:5922 write 0xda39076 thru 0xda3c929 (0x38b4 bytes) 2024-09-18T05:15:30.672 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:30.672 INFO:teuthology.orchestra.run.smithi017.stdout:5924 writesame 0x540360d thru 0x540b8f1 data_size 0x1(0x82e5 bytes) 2024-09-18T05:15:30.699 INFO:teuthology.orchestra.run.smithi017.stdout:5926 punch from 0x30faafc to 0x31097a6, (0xecaa bytes) 2024-09-18T05:15:30.699 INFO:teuthology.orchestra.run.smithi017.stdout:5927 write 0x53f0e7a thru 0x53f3217 (0x239e bytes) 2024-09-18T05:15:30.706 INFO:teuthology.orchestra.run.smithi017.stdout:5928 write 0x6e2331f thru 0x6e2fd67 (0xca49 bytes) 2024-09-18T05:15:30.717 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:30.710+0000 7fee3477c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26156) UID: 0 2024-09-18T05:15:30.722 INFO:teuthology.orchestra.run.smithi017.stdout:5929 writesame 0x4e93841 thru 0x4ea1fae data_size 0xb(0xe76e bytes) 2024-09-18T05:15:30.736 INFO:teuthology.orchestra.run.smithi017.stdout:5930 read 0xa9a8fcf thru 0xa9b099b (0x79cd bytes) 2024-09-18T05:15:30.737 INFO:teuthology.orchestra.run.smithi017.stdout:5931 read 0xb4341b6 thru 0xb442441 (0xe28c bytes) 2024-09-18T05:15:30.737 INFO:teuthology.orchestra.run.smithi017.stdout:5933 read 0x28ec776 thru 0x28f02e7 (0x3b72 bytes) 2024-09-18T05:15:30.738 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:30.749 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:30.749 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:30.750 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:30.750 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:30.752 INFO:teuthology.orchestra.run.smithi017.stdout:5936 write 0xe40c5a4 thru 0xe40eb47 (0x25a4 bytes) 2024-09-18T05:15:30.765 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:30.795 INFO:teuthology.orchestra.run.smithi017.stdout:5937 trunc from 0xe40eb48 to 0x75236b 2024-09-18T05:15:30.818 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:30.811+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:30.833 INFO:teuthology.orchestra.run.smithi017.stdout:5939 read 0x32ffd3 thru 0x33396e (0x399c bytes) 2024-09-18T05:15:30.851 INFO:teuthology.orchestra.run.smithi017.stdout:5940 write 0x221268a thru 0x2217eb5 (0x582c bytes) 2024-09-18T05:15:30.894 INFO:teuthology.orchestra.run.smithi017.stdout:5941 write 0xb8cf861 thru 0xb8dd6d7 (0xde77 bytes) 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235840206999995, 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235773288999994, 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235684778999996, 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235634223000005, 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235571108000002, 2024-09-18T05:15:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235524187999999, 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235470308999993, 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235423175999998, 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235375554000001, 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235252732999996, 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235171402999995, 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235100160000002, 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.235049949, 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.234972755000001, 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.234922885000003, 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.234848314000004, 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.234782535999997, 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.234735499999999, 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.234673407000002, 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.234627028000006, 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:30.987 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:30.989 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:30.990 INFO:teuthology.orchestra.run.smithi017.stdout:5943 read 0x3352bf7 thru 0x335de74 (0xb27e bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5945 punch from 0x33347be to 0x333d69b, (0x8edd bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5946 write 0x646f4a1 thru 0x64726ee (0x324e bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5947 punch from 0x30bbfd0 to 0x30c2770, (0x67a0 bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5948 write 0xe8da44d thru 0xe8e09f9 (0x65ad bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5950 read 0xd34dfa4 thru 0xd35a227 (0xc284 bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5952 write 0x2d58b58 thru 0x2d671b5 (0xe65e bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5954 punch from 0x1f09718 to 0x1f12b68, (0x9450 bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5956 writesame 0x25765c0 thru 0x257b296 data_size 0x3(0x4cd7 bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5957 read 0xb29b1db thru 0xb29e050 (0x2e76 bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5959 punch from 0x6ac6685 to 0x6ad5b94, (0xf50f bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5960 punch from 0xafd3ca2 to 0xafd7893, (0x3bf1 bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5961 write 0x46c8ee8 thru 0x46cc0a5 (0x31be bytes) 2024-09-18T05:15:30.991 INFO:teuthology.orchestra.run.smithi017.stdout:5962 read 0x918ea20 thru 0x919dd73 (0xf354 bytes) 2024-09-18T05:15:30.992 INFO:teuthology.orchestra.run.smithi017.stdout:5963 write 0x60a0090 thru 0x60a0186 (0xf7 bytes) 2024-09-18T05:15:30.992 INFO:teuthology.orchestra.run.smithi017.stdout:5964 read 0xe77069a thru 0xe77df8e (0xd8f5 bytes) 2024-09-18T05:15:30.992 INFO:teuthology.orchestra.run.smithi017.stdout:5965 punch from 0x9f31637 to 0x9f397c8, (0x8191 bytes) 2024-09-18T05:15:30.992 INFO:teuthology.orchestra.run.smithi017.stdout:5966 trunc from 0xe8e09fa to 0x93392af 2024-09-18T05:15:30.992 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:30.982+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:30.999 INFO:teuthology.orchestra.run.smithi017.stdout:5968 punch from 0x3404beb to 0x340fadf, (0xaef4 bytes) 2024-09-18T05:15:30.999 INFO:teuthology.orchestra.run.smithi017.stdout:5969 writesame 0x110b57b thru 0x111a094 data_size 0x15(0xeb1a bytes) 2024-09-18T05:15:31.007 INFO:teuthology.orchestra.run.smithi017.stdout:5970 write 0x298a00c thru 0x2996d74 (0xcd69 bytes) 2024-09-18T05:15:31.015 INFO:teuthology.orchestra.run.smithi017.stdout:5971 punch from 0x29490f8 to 0x2954340, (0xb248 bytes) 2024-09-18T05:15:31.044 INFO:teuthology.orchestra.run.smithi017.stdout:5973 write 0xeb9a30e thru 0xeba6f2c (0xcc1f bytes) 2024-09-18T05:15:31.053 INFO:teuthology.orchestra.run.smithi017.stdout:5975 read 0x5a114a0 thru 0x5a12780 (0x12e1 bytes) 2024-09-18T05:15:31.054 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:31.054 INFO:teuthology.orchestra.run.smithi017.stdout:5978 punch from 0xb29517a to 0xb298873, (0x36f9 bytes) 2024-09-18T05:15:31.054 INFO:teuthology.orchestra.run.smithi017.stdout:5979 writesame 0x82d461e thru 0x82ddacf data_size 0x7(0x94b2 bytes) 2024-09-18T05:15:31.065 INFO:teuthology.orchestra.run.smithi017.stdout:5980 trunc from 0xeba6f2d to 0xe9543b8 2024-09-18T05:15:31.080 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:31.080 INFO:teuthology.orchestra.run.smithi017.stdout:5983 read 0x800ed87 thru 0x8018878 (0x9af2 bytes) 2024-09-18T05:15:31.080 INFO:teuthology.orchestra.run.smithi017.stdout:5984 write 0x91ed6f8 thru 0x91f867a (0xaf83 bytes) 2024-09-18T05:15:31.083 INFO:teuthology.orchestra.run.smithi017.stdout:5985 read 0xda53d2f thru 0xda634ca (0xf79c bytes) 2024-09-18T05:15:31.083 INFO:teuthology.orchestra.run.smithi017.stdout:5986 write 0x9258c62 thru 0x925c22c (0x35cb bytes) 2024-09-18T05:15:31.086 INFO:teuthology.orchestra.run.smithi017.stdout:5987 read 0xa048dec thru 0xa0560c6 (0xd2db bytes) 2024-09-18T05:15:31.089 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:31.082+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:31.091 INFO:teuthology.orchestra.run.smithi017.stdout:5988 trunc from 0xe9543b8 to 0xd2bea84 2024-09-18T05:15:31.106 INFO:teuthology.orchestra.run.smithi017.stdout:5990 read 0xb442ba4 thru 0xb444446 (0x18a3 bytes) 2024-09-18T05:15:31.112 INFO:teuthology.orchestra.run.smithi017.stdout:5991 trunc from 0xd2bea84 to 0xbcdcc4e 2024-09-18T05:15:31.132 INFO:teuthology.orchestra.run.smithi017.stdout:5993 read 0x5dadae6 thru 0x5dbbb66 (0xe081 bytes) 2024-09-18T05:15:31.133 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:31.133 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:31.133 INFO:teuthology.orchestra.run.smithi017.stdout:compare and write disabled 2024-09-18T05:15:31.139 INFO:teuthology.orchestra.run.smithi017.stdout:5998 trunc from 0xbcdcc4e to 0xe1dbe36 2024-09-18T05:15:31.172 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:125598 3.13 3:cca0eee4:::rbd_header.118b8121651:head [call rbd.get_size in=19b,call rbd.get_object_prefix in=20b,call rbd.get_features in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-18T05:15:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:31.170381+0000", 2024-09-18T05:15:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00053591800000000003, 2024-09-18T05:15:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058504599999999998, 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 125598 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:31.170381+0000", 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:31.170381+0000", 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:31.170379+0000", 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:31.170393+0000", 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3419e-05 2024-09-18T05:15:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:31.170421+0000", 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8479e-05 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:31.170435+0000", 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4222999999999999e-05 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:31.170569+0000", 2024-09-18T05:15:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000133879 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:31.170823+0000", 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000253401 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 1 2024-09-18T05:15:31.176 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:31.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:31.189 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:31.183+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:31.204 INFO:teuthology.orchestra.run.smithi017.stdout:checking clone #45, image image_client.0-clone45 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent46 2024-09-18T05:15:31.290 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-18T05:15:31.290 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:15:31.290 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-18T05:15:31.290 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T05:15:31.290 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:15:31.291 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:31.283+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:31.303 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:31.303 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:31.303 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:31.303 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:31.304 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:31.317 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:31.383 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T05:15:31.383 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.2 2024-09-18T05:15:31.383 INFO:tasks.thrashosds.thrasher:remote for osd 2 is ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:15:31.383 DEBUG:teuthology.orchestra.run.smithi017:> type ceph-objectstore-tool 2024-09-18T05:15:31.388 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T05:15:31.389 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op list-pgs 2024-09-18T05:15:31.408 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:31.403+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:31.492 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:31.487+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:31.496 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:31.496 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:31.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:31.496 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:31.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.496 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121386 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 686080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.497 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:31.497 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5358648190000004, 2024-09-18T05:15:31.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056108969000000002, 2024-09-18T05:15:31.497 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.497 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.497 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.497 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.497 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.497 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121386 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955696+0000", 2024-09-18T05:15:31.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0874e-05 2024-09-18T05:15:31.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955703+0000", 2024-09-18T05:15:31.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3189999999999997e-06 2024-09-18T05:15:31.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955708+0000", 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0429999999999998e-06 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011705+0000", 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055996870999999997 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011743+0000", 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7895000000000002e-05 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011794+0000", 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1307999999999997e-05 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.503 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121387 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 698368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.503 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:31.503 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5358372359999999, 2024-09-18T05:15:31.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056181659000000002, 2024-09-18T05:15:31.503 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.503 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.504 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.504 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121387 2024-09-18T05:15:31.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.504 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:31.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:31.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955712+0000", 2024-09-18T05:15:31.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955715+0000", 2024-09-18T05:15:31.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3760000000000002e-06 2024-09-18T05:15:31.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955721+0000", 2024-09-18T05:15:31.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2589999999999997e-06 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955725+0000", 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4009999999999999e-06 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011813+0000", 2024-09-18T05:15:31.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056088051999999999 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011848+0000", 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4847e-05 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011894+0000", 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.509 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121388 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5358203240000003, 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056271570999999999, 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.510 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121388 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955729+0000", 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955731+0000", 2024-09-18T05:15:31.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2019999999999998e-06 2024-09-18T05:15:31.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955737+0000", 2024-09-18T05:15:31.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9139999999999996e-06 2024-09-18T05:15:31.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955751+0000", 2024-09-18T05:15:31.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3311e-05 2024-09-18T05:15:31.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011914+0000", 2024-09-18T05:15:31.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163594999999997 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011952+0000", 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7834999999999999e-05 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012001+0000", 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9084e-05 2024-09-18T05:15:31.515 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121389 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 722944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5357941940000002, 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056345279999999998, 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.516 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121389 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955755+0000", 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955759+0000", 2024-09-18T05:15:31.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3850000000000002e-06 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955766+0000", 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8499999999999996e-06 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955771+0000", 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0170000000000004e-06 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012021+0000", 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056250737000000002 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012057+0000", 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5271000000000002e-05 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012101+0000", 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4403999999999997e-05 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121390 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 735232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5357732659999996, 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056430889999999997, 2024-09-18T05:15:31.524 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121390 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955776+0000", 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955779+0000", 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6290000000000002e-06 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955786+0000", 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.435e-06 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955791+0000", 2024-09-18T05:15:31.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7520000000000004e-06 2024-09-18T05:15:31.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012120+0000", 2024-09-18T05:15:31.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056329443999999999 2024-09-18T05:15:31.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012158+0000", 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7925e-05 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012208+0000", 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9301000000000001e-05 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121391 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 747520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5357418059999999, 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056498934000000001, 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121391 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955811+0000", 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9560000000000002e-06 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955818+0000", 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3339999999999996e-06 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955823+0000", 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2839999999999997e-06 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012227+0000", 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056403880000000003 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012262+0000", 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4618e-05 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012307+0000", 2024-09-18T05:15:31.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5413e-05 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121392 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.53572197, 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056582623999999998, 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.535 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121392 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955830+0000", 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999998e-06 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955837+0000", 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955842+0000", 2024-09-18T05:15:31.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6770000000000003e-06 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012326+0000", 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056483691000000003 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012363+0000", 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7024999999999999e-05 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012411+0000", 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7845e-05 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121393 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 772096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:31.540 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.53570355, 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056662902000000001, 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121393 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955848+0000", 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2350000000000002e-06 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955855+0000", 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0500000000000003e-06 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955860+0000", 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8080000000000004e-06 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012430+0000", 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056570047999999998 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012465+0000", 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4718000000000002e-05 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012509+0000", 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4418000000000001e-05 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.545 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121394 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 784384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5356856580000002, 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056750383000000001, 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121394 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.546 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955866+0000", 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955873+0000", 2024-09-18T05:15:31.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4810000000000003e-06 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955878+0000", 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8500000000000002e-06 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012529+0000", 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056651708000000002 2024-09-18T05:15:31.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012567+0000", 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7642000000000003e-05 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012615+0000", 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7811e-05 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.550 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121395 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5356682900000003, 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056832344999999999, 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.551 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121395 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:31.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955881+0000", 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955884+0000", 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3240000000000001e-06 2024-09-18T05:15:31.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955890+0000", 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0909999999999998e-06 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955894+0000", 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012635+0000", 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056740087000000002 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012670+0000", 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5123999999999998e-05 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012714+0000", 2024-09-18T05:15:31.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4384000000000001e-05 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121396 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 808960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5356358160000001, 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057018234000000001, 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.556 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121396 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955917+0000", 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0979999999999998e-06 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955930+0000", 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3552e-05 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955936+0000", 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7309999999999998e-06 2024-09-18T05:15:31.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012733+0000", 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056797146999999999 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012770+0000", 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7239e-05 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012932+0000", 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016205000000000001 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121397 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 821248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5356091589999998, 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057105428999999999, 2024-09-18T05:15:31.561 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121397 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:31.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955940+0000", 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955943+0000", 2024-09-18T05:15:31.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7439999999999999e-06 2024-09-18T05:15:31.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955950+0000", 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8129999999999998e-06 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955957+0000", 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1849999999999998e-06 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012953+0000", 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056995559000000001 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012987+0000", 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4777000000000003e-05 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013046+0000", 2024-09-18T05:15:31.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8867999999999999e-05 2024-09-18T05:15:31.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.567 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.567 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121398 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 833536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.567 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:31.567 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.535588282, 2024-09-18T05:15:31.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057212333999999997, 2024-09-18T05:15:31.568 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.568 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.568 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121398 2024-09-18T05:15:31.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.568 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955961+0000", 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955970+0000", 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6759999999999996e-06 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955981+0000", 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0706999999999999e-05 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955986+0000", 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0719999999999999e-06 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013067+0000", 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057081595999999998 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013111+0000", 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3331999999999998e-05 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013174+0000", 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3323000000000003e-05 2024-09-18T05:15:31.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121399 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5355592700000003, 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057281034000000002, 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.574 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.574 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.574 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121399 2024-09-18T05:15:31.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.574 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:31.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955990+0000", 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955993+0000", 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955999+0000", 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4699999999999999e-06 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.956004+0000", 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013194+0000", 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057189503000000003 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013233+0000", 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9082000000000003e-05 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013272+0000", 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9014000000000003e-05 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.578 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121415 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5327270339999997, 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023800999999998, 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121415 2024-09-18T05:15:31.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958825+0000", 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.835e-06 2024-09-18T05:15:31.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958831+0000", 2024-09-18T05:15:31.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.088e-06 2024-09-18T05:15:31.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958842+0000", 2024-09-18T05:15:31.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0916e-05 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014771+0000", 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055928731000000002 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014809+0000", 2024-09-18T05:15:31.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7713999999999998e-05 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014847+0000", 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7888e-05 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.585 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121416 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 528384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.585 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:31.585 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5327017889999999, 2024-09-18T05:15:31.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056112120000000001, 2024-09-18T05:15:31.585 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.585 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.585 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.585 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.585 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.586 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121416 2024-09-18T05:15:31.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.586 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:31.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:31.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:31.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958850+0000", 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.729e-06 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958858+0000", 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:15:31.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958866+0000", 2024-09-18T05:15:31.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2840000000000006e-06 2024-09-18T05:15:31.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014866+0000", 2024-09-18T05:15:31.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056000419000000003 2024-09-18T05:15:31.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014907+0000", 2024-09-18T05:15:31.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0533e-05 2024-09-18T05:15:31.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014960+0000", 2024-09-18T05:15:31.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3427000000000002e-05 2024-09-18T05:15:31.591 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.591 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.591 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.591 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121417 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 540672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.592 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:31.592 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5326783410000004, 2024-09-18T05:15:31.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056196533999999999, 2024-09-18T05:15:31.592 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.592 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.592 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.592 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.592 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.592 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121417 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:31.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958871+0000", 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958874+0000", 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.537e-06 2024-09-18T05:15:31.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958881+0000", 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1840000000000002e-06 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958886+0000", 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014981+0000", 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056095036000000001 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015017+0000", 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6732e-05 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015068+0000", 2024-09-18T05:15:31.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0855e-05 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121418 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 552960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.532585214, 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056223713000000002, 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.597 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121418 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958889+0000", 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999247 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958968+0000", 2024-09-18T05:15:31.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8638000000000002e-05 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958990+0000", 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1614e-05 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959004+0000", 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4157e-05 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015088+0000", 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056084547999999998 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015129+0000", 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1048999999999999e-05 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015188+0000", 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8967e-05 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121420 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 577536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5321694900000002, 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056036506999999999, 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.602 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121420 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959383+0000", 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3689999999999998e-06 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959390+0000", 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1799999999999999e-06 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959396+0000", 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5330000000000002e-06 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015330+0000", 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055934086000000001 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015369+0000", 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8732000000000001e-05 2024-09-18T05:15:31.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015417+0000", 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8241000000000001e-05 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121421 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 589824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:31.607 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.532148877, 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056116280999999997, 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121421 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:31.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959403+0000", 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6989999999999999e-06 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959409+0000", 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1099999999999999e-06 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959414+0000", 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6190000000000002e-06 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015437+0000", 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023252000000003 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:31.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015473+0000", 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6086e-05 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015517+0000", 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4082999999999998e-05 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:31.612 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:31.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:31.615 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:31.610+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:31.715 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:31.707+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:31.741 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:31.741 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:31.742 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:31.742 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:31.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:31.817 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:31.810+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:31.900 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:31.900 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:31.900 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:31.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:31.910+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:31.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:31.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:15:32.017 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:32.011+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:32.094 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:32.094 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55853 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8142848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453960993999999, 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052962084999999999, 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55853 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636950+0000", 2024-09-18T05:15:32.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636957+0000", 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636994+0000", 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6879999999999999e-05 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637005+0000", 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1430000000000001e-05 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689750+0000", 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052744345999999998 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689837+0000", 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7581000000000001e-05 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689913+0000", 2024-09-18T05:15:32.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5797999999999995e-05 2024-09-18T05:15:32.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.100 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.100 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55854 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8159232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.100 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:32.100 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453896649000001, 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053068918, 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55854 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637014+0000", 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637020+0000", 2024-09-18T05:15:32.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5149999999999997e-06 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637034+0000", 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4696e-05 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637045+0000", 2024-09-18T05:15:32.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0334e-05 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689962+0000", 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052916773 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690024+0000", 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2009999999999998e-05 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690084+0000", 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0485000000000001e-05 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55855 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453856084000002, 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053239090000000003, 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55855 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:32.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637055+0000", 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637060+0000", 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9139999999999999e-06 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637080+0000", 2024-09-18T05:15:32.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9873000000000001e-05 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637091+0000", 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0852999999999999e-05 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690124+0000", 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053033736999999997 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690217+0000", 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2263999999999996e-05 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690295+0000", 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8193000000000002e-05 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55856 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:32.109 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453810916000002, 2024-09-18T05:15:32.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053363617000000002, 2024-09-18T05:15:32.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55856 2024-09-18T05:15:32.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.110 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:32.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637100+0000", 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637106+0000", 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637120+0000", 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4885999999999999e-05 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637131+0000", 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.064e-05 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690344+0000", 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053212832000000002 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690404+0000", 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0516999999999997e-05 2024-09-18T05:15:32.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690465+0000", 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0132e-05 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55857 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453771148000001, 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053529896, 2024-09-18T05:15:32.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55857 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637140+0000", 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637145+0000", 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-18T05:15:32.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637158+0000", 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3465999999999999e-05 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637168+0000", 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4919999999999999e-06 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690506+0000", 2024-09-18T05:15:32.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053337801999999997 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690595+0000", 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8925000000000007e-05 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690671+0000", 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5983999999999996e-05 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55858 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8224768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453733833000001, 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053665767000000003, 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55858 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637177+0000", 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637182+0000", 2024-09-18T05:15:32.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.028e-06 2024-09-18T05:15:32.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637197+0000", 2024-09-18T05:15:32.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4341999999999999e-05 2024-09-18T05:15:32.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637207+0000", 2024-09-18T05:15:32.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0345e-05 2024-09-18T05:15:32.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690719+0000", 2024-09-18T05:15:32.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053511982 2024-09-18T05:15:32.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690783+0000", 2024-09-18T05:15:32.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3683999999999995e-05 2024-09-18T05:15:32.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690844+0000", 2024-09-18T05:15:32.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1116000000000002e-05 2024-09-18T05:15:32.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.127 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.127 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55859 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8241152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.127 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:32.127 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453695691999997, 2024-09-18T05:15:32.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053835149999999998, 2024-09-18T05:15:32.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.128 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.128 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.128 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.128 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55859 2024-09-18T05:15:32.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.129 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:32.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:32.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637215+0000", 2024-09-18T05:15:32.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637221+0000", 2024-09-18T05:15:32.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4879999999999998e-06 2024-09-18T05:15:32.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637239+0000", 2024-09-18T05:15:32.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7665000000000001e-05 2024-09-18T05:15:32.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637252+0000", 2024-09-18T05:15:32.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3735e-05 2024-09-18T05:15:32.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690887+0000", 2024-09-18T05:15:32.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053635163 2024-09-18T05:15:32.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690977+0000", 2024-09-18T05:15:32.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9452999999999999e-05 2024-09-18T05:15:32.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691051+0000", 2024-09-18T05:15:32.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4374000000000003e-05 2024-09-18T05:15:32.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.138 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.138 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55860 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.139 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:32.139 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453624277000003, 2024-09-18T05:15:32.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053934739000000002, 2024-09-18T05:15:32.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.140 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.140 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55860 2024-09-18T05:15:32.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.140 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:32.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:32.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637287+0000", 2024-09-18T05:15:32.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637293+0000", 2024-09-18T05:15:32.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:32.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637309+0000", 2024-09-18T05:15:32.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6214000000000001e-05 2024-09-18T05:15:32.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637322+0000", 2024-09-18T05:15:32.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2413e-05 2024-09-18T05:15:32.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691101+0000", 2024-09-18T05:15:32.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053779456000000003 2024-09-18T05:15:32.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691164+0000", 2024-09-18T05:15:32.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2199000000000005e-05 2024-09-18T05:15:32.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691222+0000", 2024-09-18T05:15:32.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8758999999999998e-05 2024-09-18T05:15:32.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.148 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55861 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8273920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.148 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:32.148 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453581819, 2024-09-18T05:15:32.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054100101999999997, 2024-09-18T05:15:32.148 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.148 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55861 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637329+0000", 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637333+0000", 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2619999999999999e-06 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637340+0000", 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5279999999999998e-06 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637347+0000", 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691264+0000", 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916886999999997 2024-09-18T05:15:32.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691353+0000", 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9560000000000003e-05 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691430+0000", 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6715e-05 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55862 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8290304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453546873999997, 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054235677000000003, 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55862 2024-09-18T05:15:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:32.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637364+0000", 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637368+0000", 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637378+0000", 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0545e-05 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637384+0000", 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.592e-06 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691479+0000", 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054095022 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691540+0000", 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0958999999999997e-05 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691601+0000", 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0976e-05 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55863 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8306688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.158 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.453522927000002, 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054421542000000003, 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55863 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:32.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637388+0000", 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637391+0000", 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637398+0000", 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8249999999999999e-06 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637403+0000", 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3879999999999999e-06 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691642+0000", 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054238572999999998 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691732+0000", 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0413000000000003e-05 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691810+0000", 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8079999999999998e-05 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.162 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55864 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.452836720999997, 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053905402999999998, 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55864 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.163 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637413+0000", 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9993382 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638082+0000", 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066932099999999996 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638103+0000", 2024-09-18T05:15:32.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638115+0000", 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2935000000000001e-05 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691859+0000", 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053743055999999997 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691920+0000", 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1087999999999995e-05 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691980+0000", 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0853999999999997e-05 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55865 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8339456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.452784252999997, 2024-09-18T05:15:32.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054056874999999997, 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55865 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638127+0000", 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638133+0000", 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7869999999999998e-06 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638146+0000", 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3030000000000001e-05 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638156+0000", 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0523000000000001e-05 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692022+0000", 2024-09-18T05:15:32.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053866149000000002 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692109+0000", 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6428000000000007e-05 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692184+0000", 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5760999999999995e-05 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55936 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7413760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.450252585000001, 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052856933000000002, 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55936 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640661+0000", 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3479999999999998e-06 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640672+0000", 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0424999999999999e-05 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640677+0000", 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:15:32.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693392+0000", 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052714446999999998 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693456+0000", 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4426999999999998e-05 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693516+0000", 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0154e-05 2024-09-18T05:15:32.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55937 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7430144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.450230005000002, 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053045085999999998, 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55937 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640681+0000", 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640685+0000", 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0799999999999999e-06 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640700+0000", 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4768e-05 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640707+0000", 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.81e-06 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693559+0000", 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052852022999999998 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693648+0000", 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8908999999999999e-05 2024-09-18T05:15:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693727+0000", 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9123999999999997e-05 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55938 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7446528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.450199949999998, 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053184652999999998, 2024-09-18T05:15:32.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55938 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640711+0000", 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640714+0000", 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0070000000000002e-06 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640721+0000", 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640728+0000", 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6479999999999997e-06 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693775+0000", 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047086 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693836+0000", 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1513999999999994e-05 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693897+0000", 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0315000000000001e-05 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55939 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7462912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.184 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.450176251999999, 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369857999999999, 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55939 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:32.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640735+0000", 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640739+0000", 2024-09-18T05:15:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-06 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640750+0000", 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0668e-05 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640755+0000", 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4299999999999997e-06 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693938+0000", 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053182462 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694028+0000", 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0781999999999999e-05 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694105+0000", 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049e-05 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55940 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7479296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.450152002000003, 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053517447000000003, 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55940 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640759+0000", 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640769+0000", 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4730000000000006e-06 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640779+0000", 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9899999999999992e-06 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640784+0000", 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:15:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694154+0000", 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369648999999998 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694217+0000", 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2540999999999996e-05 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694277+0000", 2024-09-18T05:15:32.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0671999999999998e-05 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77660 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2347008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.985152053999997, 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052901814999999998, 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.193 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77660 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105759+0000", 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105764+0000", 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.403e-06 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105776+0000", 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2371000000000001e-05 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105785+0000", 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3670000000000003e-06 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158517+0000", 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052731497000000002 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158584+0000", 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7282999999999999e-05 2024-09-18T05:15:32.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158662+0000", 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7488000000000001e-05 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77702 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2109440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.985118776999997, 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047159000000003, 2024-09-18T05:15:32.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77702 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105792+0000", 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105797+0000", 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1779999999999996e-06 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105809+0000", 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2295e-05 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105818+0000", 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4040000000000001e-06 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158692+0000", 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052873766000000003 2024-09-18T05:15:32.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158760+0000", 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8422000000000003e-05 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158840+0000", 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9769000000000001e-05 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.201 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.202 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:32.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:32.203 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:32.195+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:32.304 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:32.299+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:125939 3.4 3.69b415a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:32.165777+0000", 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.15971816999999999, 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.15975472199999999, 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for peered", 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 125939 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:32.165777+0000", 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:32.165777+0000", 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:32.165774+0000", 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:32.165786+0000", 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1761e-05 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:32.165810+0000", 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3421000000000002e-05 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:32.165822+0000", 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1951e-05 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:32.165903+0000", 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1941999999999996e-05 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:32.165913+0000", 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3309999999999993e-06 2024-09-18T05:15:32.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.332 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.332 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:15:32.332 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 1 2024-09-18T05:15:32.332 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:32.342 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:32.405 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:32.403+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:32.458 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:32.458 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:32.459 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:32.459 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:32.459 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:32.473 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:32.518 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:32.514+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:32.556 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:32.594 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:32.594 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:32.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77168 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2203648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.502566518000002, 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049653801999999997, 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77168 2024-09-18T05:15:32.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087448+0000", 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087454+0000", 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2539999999999998e-06 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087471+0000", 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6912999999999999e-05 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087484+0000", 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.131161+0000", 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.043676751999999999 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.134176+0000", 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030155300000000002 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137103+0000", 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029268459999999999 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77182 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2289664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.501711968999999, 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048114297, 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77182 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088303+0000", 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088309+0000", 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5969999999999997e-06 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088330+0000", 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1339999999999999e-05 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088365+0000", 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5036000000000001e-05 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136187+0000", 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047821474000000003 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136288+0000", 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010091599999999999 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136418+0000", 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013007700000000001 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77183 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2330624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.501638069000002, 2024-09-18T05:15:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048282688999999997, 2024-09-18T05:15:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77183 2024-09-18T05:15:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088377+0000", 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088383+0000", 2024-09-18T05:15:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9029999999999998e-06 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088404+0000", 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996999999999999e-05 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088420+0000", 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5353e-05 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136450+0000", 2024-09-18T05:15:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048030394999999997 2024-09-18T05:15:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136554+0000", 2024-09-18T05:15:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103442 2024-09-18T05:15:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136660+0000", 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010664500000000001 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77188 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2129920~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.501237078999999, 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048117532999999997, 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77188 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088778+0000", 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088784+0000", 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8000000000000001e-06 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088802+0000", 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088835+0000", 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2846999999999999e-05 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136693+0000", 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047858165000000001 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136783+0000", 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9862000000000001e-05 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136896+0000", 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112792 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77190 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2170880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.501072354999998, 2024-09-18T05:15:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048251255, 2024-09-18T05:15:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77190 2024-09-18T05:15:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088942+0000", 2024-09-18T05:15:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088973+0000", 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0737000000000001e-05 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088996+0000", 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3013000000000001e-05 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089023+0000", 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7183e-05 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136930+0000", 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047907155 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137033+0000", 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103205 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137195+0000", 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016126899999999999 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77192 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2211840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500924689000001, 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048391998999999998, 2024-09-18T05:15:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77192 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089090+0000", 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089096+0000", 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089113+0000", 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6379999999999999e-05 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089130+0000", 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7730000000000001e-05 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137239+0000", 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048108962999999998 2024-09-18T05:15:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137342+0000", 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010229399999999999 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137483+0000", 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141235 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77193 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2252800~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500873224999999, 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048619480999999999, 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77193 2024-09-18T05:15:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089141+0000", 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089158+0000", 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6362999999999999e-05 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089178+0000", 2024-09-18T05:15:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0469999999999999e-05 2024-09-18T05:15:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089192+0000", 2024-09-18T05:15:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4204e-05 2024-09-18T05:15:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137535+0000", 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048342382000000003 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137639+0000", 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104042 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137762+0000", 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012304699999999999 2024-09-18T05:15:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77194 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2293760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500809449000002, 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048842564999999998, 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77194 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089205+0000", 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089212+0000", 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5100000000000004e-06 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089229+0000", 2024-09-18T05:15:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7263000000000001e-05 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089242+0000", 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3027000000000001e-05 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137800+0000", 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048558220999999999 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137928+0000", 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128183 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138049+0000", 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120387 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77195 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2334720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500762209000001, 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049100602, 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77195 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089252+0000", 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089258+0000", 2024-09-18T05:15:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089276+0000", 2024-09-18T05:15:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.719e-05 2024-09-18T05:15:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089291+0000", 2024-09-18T05:15:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5347000000000001e-05 2024-09-18T05:15:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138091+0000", 2024-09-18T05:15:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048800518000000001 2024-09-18T05:15:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138223+0000", 2024-09-18T05:15:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131889 2024-09-18T05:15:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138354+0000", 2024-09-18T05:15:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013071099999999999 2024-09-18T05:15:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77202 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2134016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500336326000003, 2024-09-18T05:15:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048921765999999998, 2024-09-18T05:15:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77202 2024-09-18T05:15:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089677+0000", 2024-09-18T05:15:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089695+0000", 2024-09-18T05:15:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.804e-05 2024-09-18T05:15:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089735+0000", 2024-09-18T05:15:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0080000000000003e-05 2024-09-18T05:15:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089748+0000", 2024-09-18T05:15:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2493e-05 2024-09-18T05:15:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138392+0000", 2024-09-18T05:15:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048644219000000002 2024-09-18T05:15:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138489+0000", 2024-09-18T05:15:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6836999999999995e-05 2024-09-18T05:15:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138601+0000", 2024-09-18T05:15:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112494 2024-09-18T05:15:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77203 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2174976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500259086, 2024-09-18T05:15:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049108851000000002, 2024-09-18T05:15:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77203 2024-09-18T05:15:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089756+0000", 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089761+0000", 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1000000000000003e-06 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089770+0000", 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999999e-06 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089777+0000", 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138641+0000", 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048863453000000001 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138737+0000", 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5828000000000005e-05 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138865+0000", 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128804 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77204 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2215936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500232363000002, 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049349094000000003, 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77204 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089786+0000", 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4529999999999998e-06 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089795+0000", 2024-09-18T05:15:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4130000000000006e-06 2024-09-18T05:15:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089801+0000", 2024-09-18T05:15:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8600000000000004e-06 2024-09-18T05:15:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138903+0000", 2024-09-18T05:15:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049101643 2024-09-18T05:15:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139001+0000", 2024-09-18T05:15:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7707000000000005e-05 2024-09-18T05:15:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139132+0000", 2024-09-18T05:15:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013160099999999999 2024-09-18T05:15:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77205 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2256896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500208473000001, 2024-09-18T05:15:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049589756999999998, 2024-09-18T05:15:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77205 2024-09-18T05:15:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089825+0000", 2024-09-18T05:15:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8340000000000001e-05 2024-09-18T05:15:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089842+0000", 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6606999999999999e-05 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089854+0000", 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.292e-05 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139170+0000", 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049315335000000002 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139269+0000", 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9339000000000006e-05 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139397+0000", 2024-09-18T05:15:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127806 2024-09-18T05:15:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77206 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2297856~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500148969999998, 2024-09-18T05:15:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049792218999999999, 2024-09-18T05:15:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77206 2024-09-18T05:15:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089866+0000", 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089872+0000", 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9599999999999997e-06 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089888+0000", 2024-09-18T05:15:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-05 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089920+0000", 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890000000000001e-05 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139435+0000", 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049514916999999999 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139530+0000", 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4847999999999997e-05 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139659+0000", 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012879999999999999 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77207 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2338816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.500076970000002, 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04998259, 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77207 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089937+0000", 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089944+0000", 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089963+0000", 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8623000000000001e-05 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089976+0000", 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3203999999999999e-05 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139698+0000", 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049722211000000002 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139796+0000", 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7200000000000004e-05 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139921+0000", 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012560499999999999 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104467 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.32272427, 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63367687500000003, 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104467 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267289+0000", 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267300+0000", 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0382e-05 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267326+0000", 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5850000000000002e-05 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267339+0000", 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3754000000000001e-05 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267425+0000", 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5544999999999995e-05 2024-09-18T05:15:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267444+0000", 2024-09-18T05:15:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8947999999999999e-05 2024-09-18T05:15:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900405+0000", 2024-09-18T05:15:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63296088699999997 2024-09-18T05:15:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900624+0000", 2024-09-18T05:15:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219466 2024-09-18T05:15:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900968+0000", 2024-09-18T05:15:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034406500000000001 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104468 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.322632091999999, 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63418863999999997, 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104468 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267382+0000", 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267390+0000", 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.028e-06 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267406+0000", 2024-09-18T05:15:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5446000000000001e-05 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267419+0000", 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3514e-05 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8612e-05 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267503+0000", 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4714e-05 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901334+0000", 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.633831747 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901437+0000", 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010287499999999999 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901572+0000", 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013484799999999999 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104469 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 2359296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.322585571999999, 2024-09-18T05:15:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63443118099999996, 2024-09-18T05:15:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104469 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267429+0000", 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267435+0000", 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2100000000000001e-06 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267447+0000", 2024-09-18T05:15:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2532e-05 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267457+0000", 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0010000000000001e-05 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267545+0000", 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7627999999999995e-05 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267559+0000", 2024-09-18T05:15:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3963e-05 2024-09-18T05:15:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901627+0000", 2024-09-18T05:15:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63406880399999999 2024-09-18T05:15:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901723+0000", 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5629000000000002e-05 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901861+0000", 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013816499999999999 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104470 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 3211264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.322527248, 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.634540459, 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104470 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267493+0000", 2024-09-18T05:15:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5280000000000003e-06 2024-09-18T05:15:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267509+0000", 2024-09-18T05:15:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5517999999999999e-05 2024-09-18T05:15:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267518+0000", 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7030000000000001e-06 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267607+0000", 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9202000000000004e-05 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267620+0000", 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2612999999999999e-05 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901913+0000", 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63429272599999997 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901965+0000", 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2391e-05 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902029+0000", 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3626000000000004e-05 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104471 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.322476309000001, 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63472597500000005, 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104471 2024-09-18T05:15:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267544+0000", 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2379999999999997e-06 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267557+0000", 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3020000000000001e-05 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267566+0000", 2024-09-18T05:15:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.38e-06 2024-09-18T05:15:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267658+0000", 2024-09-18T05:15:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1852000000000001e-05 2024-09-18T05:15:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267670+0000", 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.224e-05 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902059+0000", 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63438875900000002 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902124+0000", 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5374000000000001e-05 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902265+0000", 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140922 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:32.708 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:32.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:32.710 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:32.711 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:32.703+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:32.725 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:32.728 INFO:teuthology.orchestra.run.smithi017.stdout:3.9 2024-09-18T05:15:32.728 INFO:teuthology.orchestra.run.smithi017.stdout:3.4 2024-09-18T05:15:32.728 INFO:teuthology.orchestra.run.smithi017.stdout:2.7 2024-09-18T05:15:32.728 INFO:teuthology.orchestra.run.smithi017.stdout:2.3 2024-09-18T05:15:32.728 INFO:teuthology.orchestra.run.smithi017.stdout:3.0 2024-09-18T05:15:32.728 INFO:teuthology.orchestra.run.smithi017.stdout:2.1 2024-09-18T05:15:32.743 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:32.743 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:32.763 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:32.763 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:32.783 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:32.783 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:32.804 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:32.804 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:32.810 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:32.803+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:32.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:32.825 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:32.829 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:32.830 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:32.841 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:32.841 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:32.855 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:32.912 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:32.907+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:32.996 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:15:33.013 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:33.007+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:33.024 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:33.024 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:33.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:33.126 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:33.122+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:33.191 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:33.191 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:33.204 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:33.252 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:33.247+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:33.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op export --pgid 2.7 --file /var/log/ceph/exp.2.7.2 2024-09-18T05:15:33.315 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:33.307+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:33.335 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:33.335 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:33.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:33.436 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:33.431+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:33.512 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:33.513 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:33.517 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:33.514+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:33.526 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:33.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:33.614+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:33.689 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:33.690 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:33.703 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:33.719 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:33.714+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:33.820 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:33.814+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:33.824 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:33.824 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:33.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:33.921 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:33.914+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:33.955 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:33.955 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:33.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:34.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:34.014+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:34.093 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:34.093 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:34.107 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:34.152 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:34.147+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:34.224 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:34.219+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:34.237 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:34.237 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:34.251 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:34.336 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:34.331+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:34.416 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:34.417 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:34.426 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:34.422+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:34.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:Exporting 2.7 info 2.7( empty local-lis/les=79/80 n=0 ec=18/18 lis/c=79/79 les/c/f=80/80/0 sis=79) 2024-09-18T05:15:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:Export successful 2024-09-18T05:15:34.527 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:34.519+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:34.593 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:34.594 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:34.608 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:34.627 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:34.622+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:34.728 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:34.723+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:34.778 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:34.778 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:34.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:34.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:34.836 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:34.831+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:34.930 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:34.926+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:34.956 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:34.956 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:34.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:34.989 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:34.990 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:34.990 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --force --op remove --pgid 2.7 2024-09-18T05:15:35.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:35.013 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:35.013 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:35.018 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:15:35.031 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:35.032 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:35.032 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:35.026+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:35.055 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:35.055 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:35.074 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:35.097 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:35.106 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:35.106 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:35.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:35.106 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:35.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.106 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:102332 3.10 3:0b2ae2d1:::rbd_data.118b62cc3496.000000000000001a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-18T05:15:35.106 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:35.106 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.976440361000002, 2024-09-18T05:15:35.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.065837997999999995, 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102332 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126923+0000", 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126935+0000", 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1970000000000001e-05 2024-09-18T05:15:35.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126960+0000", 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4888999999999998e-05 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126980+0000", 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0642999999999999e-05 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127082+0000", 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101118 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127332+0000", 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000250771 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.140319+0000", 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012987115 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192666+0000", 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052346629999999998 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192681+0000", 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4769e-05 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192726+0000", 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4925000000000001e-05 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192763+0000", 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7141000000000002e-05 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121156 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2064384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.2120625179999998, 2024-09-18T05:15:35.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038247947999999997, 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121156 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:35.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891302+0000", 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891314+0000", 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1557e-05 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891321+0000", 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7619999999999998e-06 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891325+0000", 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6600000000000003e-06 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929365+0000", 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038039942 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929467+0000", 2024-09-18T05:15:35.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101191 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929551+0000", 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4220000000000003e-05 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121157 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2076672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:35.118 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.2120353789999996, 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038423377000000002, 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121157 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891332+0000", 2024-09-18T05:15:35.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891338+0000", 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9800000000000003e-06 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891342+0000", 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3470000000000001e-06 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929593+0000", 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038250926999999997 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929674+0000", 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0976999999999994e-05 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929753+0000", 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8948000000000004e-05 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121158 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2088960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.2120187579999993, 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818722, 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121158 2024-09-18T05:15:35.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891346+0000", 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891349+0000", 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5050000000000002e-06 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891355+0000", 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4370000000000004e-06 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891365+0000", 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7520000000000008e-06 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929862+0000", 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038497177 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930078+0000", 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000215992 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930165+0000", 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7243000000000005e-05 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121271 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1906688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1989559179999993, 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038405050000000003, 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.127 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121271 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904416+0000", 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0160000000000003e-06 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904423+0000", 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9890000000000003e-06 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904428+0000", 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6890000000000003e-06 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942670+0000", 2024-09-18T05:15:35.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038242653000000001 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942752+0000", 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2140999999999998e-05 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942814+0000", 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2101999999999996e-05 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.131 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121272 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1918976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1989283470000007, 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038493807999999997, 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.132 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121272 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904439+0000", 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3870000000000002e-06 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904445+0000", 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0240000000000003e-06 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904450+0000", 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9400000000000001e-06 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942846+0000", 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038395692000000002 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942889+0000", 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3659000000000003e-05 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942931+0000", 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1470000000000001e-05 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121273 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1931264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1989109980000006, 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038620175, 2024-09-18T05:15:35.137 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121273 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904456+0000", 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3360000000000002e-06 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904462+0000", 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7289999999999997e-06 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904472+0000", 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0020999999999999e-05 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942960+0000", 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038488306999999999 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943002+0000", 2024-09-18T05:15:35.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2089999999999999e-05 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943075+0000", 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2092e-05 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.142 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121274 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1943552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1988805580000008, 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818021000000001, 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121274 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.143 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904484+0000", 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904487+0000", 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904494+0000", 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0940000000000002e-06 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904499+0000", 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.933e-06 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943121+0000", 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038622507 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943208+0000", 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6397999999999995e-05 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943303+0000", 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4895000000000005e-05 2024-09-18T05:15:35.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121275 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1955840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1988622679999992, 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039005943000000001, 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121275 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904505+0000", 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904511+0000", 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0190000000000003e-06 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904516+0000", 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9200000000000003e-06 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943351+0000", 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038834425999999998 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943430+0000", 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9505000000000005e-05 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943509+0000", 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121276 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1968128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1988448720000004, 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039192704000000002, 2024-09-18T05:15:35.152 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121276 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904523+0000", 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5179999999999999e-06 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904529+0000", 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4860000000000002e-06 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904533+0000", 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2390000000000004e-06 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943554+0000", 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039020332999999997 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943634+0000", 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0673000000000005e-05 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943713+0000", 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8858999999999998e-05 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.156 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121277 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1980416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1988275490000007, 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039321828000000003, 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121277 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:35.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904537+0000", 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904544+0000", 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8990000000000004e-06 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904551+0000", 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3940000000000001e-06 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904556+0000", 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1200000000000001e-06 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943770+0000", 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039214514999999998 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943816+0000", 2024-09-18T05:15:35.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5371999999999999e-05 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943860+0000", 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3875999999999998e-05 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121278 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1992704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.161 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1988049249999992, 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039412773999999998, 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121278 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904563+0000", 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5000000000000002e-06 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904569+0000", 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.224e-06 2024-09-18T05:15:35.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904574+0000", 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8659999999999997e-06 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943890+0000", 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039316027000000003 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943931+0000", 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1137000000000003e-05 2024-09-18T05:15:35.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943973+0000", 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2416999999999997e-05 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121279 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2004992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1987874509999994, 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039512600000000002, 2024-09-18T05:15:35.166 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121279 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904580+0000", 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3640000000000002e-06 2024-09-18T05:15:35.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904587+0000", 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6719999999999998e-06 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904591+0000", 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5549999999999996e-06 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944001+0000", 2024-09-18T05:15:35.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039410387999999998 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944046+0000", 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4626000000000003e-05 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944090+0000", 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4351000000000003e-05 2024-09-18T05:15:35.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121280 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2017280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1987695840000008, 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039608457999999999, 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.171 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121280 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904595+0000", 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904598+0000", 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4549999999999998e-06 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904604+0000", 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904609+0000", 2024-09-18T05:15:35.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7949999999999998e-06 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944120+0000", 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039511211999999997 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944161+0000", 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0766000000000002e-05 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944204+0000", 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3234e-05 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121281 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2029568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.176 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:35.177 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1987519100000004, 2024-09-18T05:15:35.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039699867999999999, 2024-09-18T05:15:35.177 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.177 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.177 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.178 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.178 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.178 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121281 2024-09-18T05:15:35.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.178 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:35.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:35.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:35.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904615+0000", 2024-09-18T05:15:35.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.305e-06 2024-09-18T05:15:35.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904622+0000", 2024-09-18T05:15:35.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4320000000000004e-06 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904627+0000", 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.729e-06 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944231+0000", 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039604749000000002 2024-09-18T05:15:35.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944270+0000", 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8531000000000001e-05 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944313+0000", 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3479000000000002e-05 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121282 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2041856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1987130439999998, 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039764847999999998, 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121282 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.184 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904655+0000", 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8219999999999998e-06 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904661+0000", 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8539999999999999e-06 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904677+0000", 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5488000000000001e-05 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944340+0000", 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039663588999999999 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944380+0000", 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9548999999999997e-05 2024-09-18T05:15:35.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944417+0000", 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7138000000000003e-05 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121283 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2054144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.198683376, 2024-09-18T05:15:35.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039840091000000001, 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121283 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904689+0000", 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7190000000000001e-06 2024-09-18T05:15:35.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904696+0000", 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6529999999999997e-06 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904701+0000", 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.101e-06 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944443+0000", 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039741601000000001 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944483+0000", 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0138000000000001e-05 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944522+0000", 2024-09-18T05:15:35.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9289000000000003e-05 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121284 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2066432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1986602400000006, 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039925616999999997, 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121284 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904707+0000", 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.616e-06 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904714+0000", 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.161e-06 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904718+0000", 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8389999999999997e-06 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944553+0000", 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039834596 2024-09-18T05:15:35.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944591+0000", 2024-09-18T05:15:35.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-18T05:15:35.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944631+0000", 2024-09-18T05:15:35.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9526000000000001e-05 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121285 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2078720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1986420770000006, 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040039444, 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.198 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121285 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904726+0000", 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6630000000000002e-06 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904732+0000", 2024-09-18T05:15:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6069999999999996e-06 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904737+0000", 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9609999999999996e-06 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944658+0000", 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039920421999999997 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944696+0000", 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8395000000000001e-05 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944763+0000", 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6761999999999995e-05 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121286 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2091008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1986230950000003, 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040212352999999999, 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121286 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904744+0000", 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904751+0000", 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7689999999999999e-06 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904756+0000", 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5959999999999997e-06 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944796+0000", 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040040048000000002 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944883+0000", 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7268999999999994e-05 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944955+0000", 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1505000000000001e-05 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:35.207 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:35.208 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:35.213 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:35.214 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:35.203+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:35.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:35.215 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:35.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:35.302+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:35.381 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:35.382 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:35.382 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:35.382 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:35.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:35.410 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:35.403+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:35.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:35.506+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:35.560 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:35.560 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:35.560 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:35.561 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:35.561 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:35.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:35.618 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:35.614+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:35.713 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:35.711+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:35.733 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:35.733 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:35.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55853 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8142848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.091225684000001, 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052962084999999999, 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55853 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636950+0000", 2024-09-18T05:15:35.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636957+0000", 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636994+0000", 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6879999999999999e-05 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637005+0000", 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1430000000000001e-05 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689750+0000", 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052744345999999998 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689837+0000", 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7581000000000001e-05 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689913+0000", 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5797999999999995e-05 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55854 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8159232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.091161339000003, 2024-09-18T05:15:35.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053068918, 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55854 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637014+0000", 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637020+0000", 2024-09-18T05:15:35.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5149999999999997e-06 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637034+0000", 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4696e-05 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637045+0000", 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0334e-05 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689962+0000", 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052916773 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690024+0000", 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2009999999999998e-05 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690084+0000", 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0485000000000001e-05 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55855 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.091120773999997, 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053239090000000003, 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55855 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.743 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637055+0000", 2024-09-18T05:15:35.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637060+0000", 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9139999999999999e-06 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637080+0000", 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9873000000000001e-05 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637091+0000", 2024-09-18T05:15:35.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0852999999999999e-05 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690124+0000", 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053033736999999997 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690217+0000", 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2263999999999996e-05 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690295+0000", 2024-09-18T05:15:35.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8193000000000002e-05 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55856 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.091075605999997, 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053363617000000002, 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55856 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637100+0000", 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637106+0000", 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637120+0000", 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4885999999999999e-05 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637131+0000", 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.064e-05 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690344+0000", 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053212832000000002 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690404+0000", 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0516999999999997e-05 2024-09-18T05:15:35.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690465+0000", 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0132e-05 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55857 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.091035838000003, 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053529896, 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55857 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637140+0000", 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637145+0000", 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637158+0000", 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3465999999999999e-05 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637168+0000", 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4919999999999999e-06 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690506+0000", 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053337801999999997 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690595+0000", 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8925000000000007e-05 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690671+0000", 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5983999999999996e-05 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55858 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8224768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.090998523000003, 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053665767000000003, 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55858 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637177+0000", 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637182+0000", 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.028e-06 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637197+0000", 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4341999999999999e-05 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637207+0000", 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0345e-05 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690719+0000", 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053511982 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690783+0000", 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3683999999999995e-05 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690844+0000", 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1116000000000002e-05 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55859 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8241152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.090960381999999, 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053835149999999998, 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55859 2024-09-18T05:15:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637215+0000", 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637221+0000", 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4879999999999998e-06 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637239+0000", 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7665000000000001e-05 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637252+0000", 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3735e-05 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690887+0000", 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053635163 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690977+0000", 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9452999999999999e-05 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691051+0000", 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4374000000000003e-05 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55860 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.090888966999998, 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053934739000000002, 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55860 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637287+0000", 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637293+0000", 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637309+0000", 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6214000000000001e-05 2024-09-18T05:15:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637322+0000", 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2413e-05 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691101+0000", 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053779456000000003 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691164+0000", 2024-09-18T05:15:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2199000000000005e-05 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691222+0000", 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8758999999999998e-05 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55861 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8273920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.090846509000002, 2024-09-18T05:15:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054100101999999997, 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55861 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637329+0000", 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637333+0000", 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2619999999999999e-06 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637340+0000", 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5279999999999998e-06 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637347+0000", 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691264+0000", 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916886999999997 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691353+0000", 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9560000000000003e-05 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691430+0000", 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6715e-05 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55862 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8290304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.090811563999999, 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054235677000000003, 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55862 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637364+0000", 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637368+0000", 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637378+0000", 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0545e-05 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637384+0000", 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.592e-06 2024-09-18T05:15:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691479+0000", 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054095022 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691540+0000", 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0958999999999997e-05 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691601+0000", 2024-09-18T05:15:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0976e-05 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55863 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8306688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.090787616999997, 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054421542000000003, 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55863 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637388+0000", 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637391+0000", 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637398+0000", 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8249999999999999e-06 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637403+0000", 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3879999999999999e-06 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691642+0000", 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054238572999999998 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691732+0000", 2024-09-18T05:15:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0413000000000003e-05 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691810+0000", 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8079999999999998e-05 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55864 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.090101410999999, 2024-09-18T05:15:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053905402999999998, 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55864 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637413+0000", 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9993382 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638082+0000", 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066932099999999996 2024-09-18T05:15:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638103+0000", 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638115+0000", 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2935000000000001e-05 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691859+0000", 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053743055999999997 2024-09-18T05:15:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691920+0000", 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1087999999999995e-05 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691980+0000", 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0853999999999997e-05 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55865 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8339456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.090048942999999, 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054056874999999997, 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55865 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638127+0000", 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638133+0000", 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7869999999999998e-06 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638146+0000", 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3030000000000001e-05 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638156+0000", 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0523000000000001e-05 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692022+0000", 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053866149000000002 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692109+0000", 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6428000000000007e-05 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692184+0000", 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5760999999999995e-05 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55936 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7413760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.087517275000003, 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052856933000000002, 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55936 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640661+0000", 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3479999999999998e-06 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640672+0000", 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0424999999999999e-05 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640677+0000", 2024-09-18T05:15:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693392+0000", 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052714446999999998 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693456+0000", 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4426999999999998e-05 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693516+0000", 2024-09-18T05:15:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0154e-05 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55937 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7430144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.087494694999997, 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053045085999999998, 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55937 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640681+0000", 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640685+0000", 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0799999999999999e-06 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640700+0000", 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4768e-05 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640707+0000", 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.81e-06 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693559+0000", 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052852022999999998 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693648+0000", 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8908999999999999e-05 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693727+0000", 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9123999999999997e-05 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55938 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7446528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.08746464, 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053184652999999998, 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55938 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640711+0000", 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640714+0000", 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0070000000000002e-06 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640721+0000", 2024-09-18T05:15:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640728+0000", 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6479999999999997e-06 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693775+0000", 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047086 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693836+0000", 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1513999999999994e-05 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693897+0000", 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0315000000000001e-05 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55939 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7462912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.087440942000001, 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369857999999999, 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55939 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640735+0000", 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640739+0000", 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-06 2024-09-18T05:15:35.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640750+0000", 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0668e-05 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640755+0000", 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4299999999999997e-06 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693938+0000", 2024-09-18T05:15:35.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053182462 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694028+0000", 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0781999999999999e-05 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694105+0000", 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049e-05 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55940 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7479296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.087416691999998, 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053517447000000003, 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55940 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640759+0000", 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640769+0000", 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4730000000000006e-06 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640779+0000", 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9899999999999992e-06 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640784+0000", 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:15:35.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694154+0000", 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369648999999998 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694217+0000", 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2540999999999996e-05 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694277+0000", 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0671999999999998e-05 2024-09-18T05:15:35.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77660 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2347008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.622416743999999, 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052901814999999998, 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77660 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105759+0000", 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105764+0000", 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.403e-06 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105776+0000", 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2371000000000001e-05 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105785+0000", 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3670000000000003e-06 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158517+0000", 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052731497000000002 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158584+0000", 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7282999999999999e-05 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158662+0000", 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7488000000000001e-05 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77702 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2109440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.622383466999999, 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047159000000003, 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:35.815 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77702 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:35.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105792+0000", 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105797+0000", 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1779999999999996e-06 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105809+0000", 2024-09-18T05:15:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2295e-05 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105818+0000", 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4040000000000001e-06 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158692+0000", 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052873766000000003 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158760+0000", 2024-09-18T05:15:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8422000000000003e-05 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158840+0000", 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9769000000000001e-05 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:35.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:35.821 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:35.819+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:35.921 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:35.915+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:35.954 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:35.954 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:35.954 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:35.954 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:35.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:15:36.022 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:36.015+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:36.110 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:36.110 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:36.110 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:36.110 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:36.111 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:36.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:36.118+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:36.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:36.141 INFO:teuthology.orchestra.run.smithi017.stdout: marking collection for removal 2024-09-18T05:15:36.141 INFO:teuthology.orchestra.run.smithi017.stdout:setting '_remove' omap key 2024-09-18T05:15:36.141 INFO:teuthology.orchestra.run.smithi017.stdout:finish_remove_pgs 2.7_head removing 2.7 2024-09-18T05:15:36.148 INFO:teuthology.orchestra.run.smithi017.stdout:Remove successful 2024-09-18T05:15:36.224 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:36.218+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77168 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2203648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.169495191000003, 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049653801999999997, 2024-09-18T05:15:36.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77168 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087448+0000", 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087454+0000", 2024-09-18T05:15:36.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2539999999999998e-06 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087471+0000", 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6912999999999999e-05 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087484+0000", 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.131161+0000", 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.043676751999999999 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.134176+0000", 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030155300000000002 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137103+0000", 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029268459999999999 2024-09-18T05:15:36.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77182 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2289664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.168640642, 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048114297, 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77182 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088303+0000", 2024-09-18T05:15:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088309+0000", 2024-09-18T05:15:36.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5969999999999997e-06 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088330+0000", 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1339999999999999e-05 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088365+0000", 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5036000000000001e-05 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136187+0000", 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047821474000000003 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136288+0000", 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010091599999999999 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136418+0000", 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013007700000000001 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77183 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2330624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.168566742000003, 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048282688999999997, 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.272 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77183 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:36.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088377+0000", 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088383+0000", 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9029999999999998e-06 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088404+0000", 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996999999999999e-05 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088420+0000", 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5353e-05 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136450+0000", 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048030394999999997 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136554+0000", 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103442 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136660+0000", 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010664500000000001 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77188 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2129920~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.276 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.168165752, 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048117532999999997, 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77188 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088778+0000", 2024-09-18T05:15:36.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088784+0000", 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8000000000000001e-06 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088802+0000", 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088835+0000", 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2846999999999999e-05 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136693+0000", 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047858165000000001 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136783+0000", 2024-09-18T05:15:36.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9862000000000001e-05 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136896+0000", 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112792 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77190 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2170880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.168001027999999, 2024-09-18T05:15:36.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048251255, 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77190 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088942+0000", 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088973+0000", 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0737000000000001e-05 2024-09-18T05:15:36.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088996+0000", 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3013000000000001e-05 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089023+0000", 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7183e-05 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136930+0000", 2024-09-18T05:15:36.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047907155 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137033+0000", 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103205 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137195+0000", 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016126899999999999 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77192 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2211840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167853362000002, 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048391998999999998, 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77192 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089090+0000", 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089096+0000", 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089113+0000", 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6379999999999999e-05 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089130+0000", 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7730000000000001e-05 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137239+0000", 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048108962999999998 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137342+0000", 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010229399999999999 2024-09-18T05:15:36.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137483+0000", 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141235 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.290 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77193 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2252800~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167801898, 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048619480999999999, 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77193 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089141+0000", 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089158+0000", 2024-09-18T05:15:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6362999999999999e-05 2024-09-18T05:15:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089178+0000", 2024-09-18T05:15:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0469999999999999e-05 2024-09-18T05:15:36.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089192+0000", 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4204e-05 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137535+0000", 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048342382000000003 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137639+0000", 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104042 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137762+0000", 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012304699999999999 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77194 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2293760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.295 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167738122000003, 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048842564999999998, 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77194 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089205+0000", 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089212+0000", 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5100000000000004e-06 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089229+0000", 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7263000000000001e-05 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089242+0000", 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3027000000000001e-05 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137800+0000", 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048558220999999999 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137928+0000", 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128183 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138049+0000", 2024-09-18T05:15:36.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120387 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77195 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2334720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167690882000002, 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049100602, 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77195 2024-09-18T05:15:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089252+0000", 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089258+0000", 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089276+0000", 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.719e-05 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089291+0000", 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5347000000000001e-05 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138091+0000", 2024-09-18T05:15:36.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048800518000000001 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138223+0000", 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131889 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138354+0000", 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013071099999999999 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77202 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2134016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167264998999997, 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048921765999999998, 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77202 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.306 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089677+0000", 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089695+0000", 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.804e-05 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089735+0000", 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0080000000000003e-05 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089748+0000", 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2493e-05 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138392+0000", 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048644219000000002 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138489+0000", 2024-09-18T05:15:36.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6836999999999995e-05 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138601+0000", 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112494 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77203 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2174976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167187759000001, 2024-09-18T05:15:36.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049108851000000002, 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77203 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089756+0000", 2024-09-18T05:15:36.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089761+0000", 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1000000000000003e-06 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089770+0000", 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999999e-06 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089777+0000", 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138641+0000", 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048863453000000001 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138737+0000", 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5828000000000005e-05 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138865+0000", 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128804 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77204 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2215936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167161036000003, 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049349094000000003, 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.315 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77204 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:36.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089786+0000", 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4529999999999998e-06 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089795+0000", 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4130000000000006e-06 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089801+0000", 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8600000000000004e-06 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138903+0000", 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049101643 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139001+0000", 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7707000000000005e-05 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139132+0000", 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013160099999999999 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77205 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2256896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:36.319 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167137146000002, 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049589756999999998, 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77205 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:36.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089825+0000", 2024-09-18T05:15:36.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8340000000000001e-05 2024-09-18T05:15:36.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089842+0000", 2024-09-18T05:15:36.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6606999999999999e-05 2024-09-18T05:15:36.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089854+0000", 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.292e-05 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139170+0000", 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049315335000000002 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139269+0000", 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9339000000000006e-05 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139397+0000", 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127806 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77206 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2297856~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:36.324 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167077642999999, 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049792218999999999, 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77206 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089866+0000", 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089872+0000", 2024-09-18T05:15:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9599999999999997e-06 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089888+0000", 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-05 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089920+0000", 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890000000000001e-05 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139435+0000", 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049514916999999999 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139530+0000", 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4847999999999997e-05 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139659+0000", 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012879999999999999 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.328 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77207 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2338816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.167005643000003, 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04998259, 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77207 2024-09-18T05:15:36.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089937+0000", 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089944+0000", 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089963+0000", 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8623000000000001e-05 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089976+0000", 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3203999999999999e-05 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139698+0000", 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049722211000000002 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139796+0000", 2024-09-18T05:15:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7200000000000004e-05 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139921+0000", 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012560499999999999 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104467 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.989652942999999, 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63367687500000003, 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104467 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267289+0000", 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:36.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267300+0000", 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0382e-05 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267326+0000", 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5850000000000002e-05 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267339+0000", 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3754000000000001e-05 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267425+0000", 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5544999999999995e-05 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267444+0000", 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8947999999999999e-05 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900405+0000", 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63296088699999997 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900624+0000", 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219466 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900968+0000", 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034406500000000001 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104468 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.989560765, 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63418863999999997, 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104468 2024-09-18T05:15:36.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267382+0000", 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267390+0000", 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.028e-06 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267406+0000", 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5446000000000001e-05 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267419+0000", 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3514e-05 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8612e-05 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267503+0000", 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4714e-05 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901334+0000", 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.633831747 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901437+0000", 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010287499999999999 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901572+0000", 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013484799999999999 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.344 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104469 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 2359296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.989514244999999, 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63443118099999996, 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104469 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267429+0000", 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267435+0000", 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2100000000000001e-06 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267447+0000", 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2532e-05 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267457+0000", 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0010000000000001e-05 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267545+0000", 2024-09-18T05:15:36.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7627999999999995e-05 2024-09-18T05:15:36.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:36.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267559+0000", 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3963e-05 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901627+0000", 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63406880399999999 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901723+0000", 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5629000000000002e-05 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901861+0000", 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013816499999999999 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104470 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 3211264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.989455921000001, 2024-09-18T05:15:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.634540459, 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104470 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267493+0000", 2024-09-18T05:15:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5280000000000003e-06 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267509+0000", 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5517999999999999e-05 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267518+0000", 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7030000000000001e-06 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267607+0000", 2024-09-18T05:15:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9202000000000004e-05 2024-09-18T05:15:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267620+0000", 2024-09-18T05:15:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2612999999999999e-05 2024-09-18T05:15:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901913+0000", 2024-09-18T05:15:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63429272599999997 2024-09-18T05:15:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901965+0000", 2024-09-18T05:15:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2391e-05 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902029+0000", 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3626000000000004e-05 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104471 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.989404982, 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63472597500000005, 2024-09-18T05:15:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104471 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267544+0000", 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2379999999999997e-06 2024-09-18T05:15:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267557+0000", 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3020000000000001e-05 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267566+0000", 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.38e-06 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267658+0000", 2024-09-18T05:15:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1852000000000001e-05 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267670+0000", 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.224e-05 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902059+0000", 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63438875900000002 2024-09-18T05:15:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902124+0000", 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5374000000000001e-05 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902265+0000", 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140922 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.363 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:36.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:36.365 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:36.359+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:36.465 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:36.458+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:36.534 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:36.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:36.534 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:36.534 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:36.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:36.590 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:36.586+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:36.667 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:36.662+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:36.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.7.2 2024-09-18T05:15:36.719 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:36.719 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:36.719 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:36.719 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:36.719 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:36.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:36.778 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:36.774+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:36.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:36.862+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:36.895 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.981428816, 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:15:36.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.98139787300001, 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.901 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:15:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.98137230899999, 2024-09-18T05:15:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:15:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:15:36.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.981347593, 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:36.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:15:36.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.98132135900001, 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:15:36.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.98129245, 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.98126861999999, 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:15:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.981244144, 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.928 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:15:36.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.932 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.98112634500001, 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:15:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.97813438999999, 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.937 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:15:36.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.97805632799999, 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:15:36.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:15:36.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.978025041, 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.946 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:15:36.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.977999028, 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:15:36.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:15:36.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.954 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.977971255, 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:15:36.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:36.959 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.977946192, 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:36.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.963 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.977921162, 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.964 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:15:36.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.973796834, 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:36.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.972 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.973776289, 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:36.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.976 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 104.973756607, 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:15:36.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.705685160000002, 2024-09-18T05:15:36.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:15:36.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:15:36.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:15:36.987 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:36.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:36.988 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:36.989 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:36.990 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:36.983+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:37.090 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:37.086+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:37.136 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:37.136 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:37.136 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:37.136 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:37.154 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:37.204 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:37.199+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:37.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:37.276 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:37.276 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:37.276 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:37.276 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:37.276 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:37.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:37.332 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:37.327+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:37.364 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:37.364 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:37.381 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:37.381 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:37.381 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:37.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:37.386+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:37.397 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:37.397 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:37.416 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:37.416 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:37.435 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:37.436 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:37.456 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:37.456 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:37.457 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:37.457 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:37.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:37.473 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:37.473 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:37.477 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:37.477 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:37.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:37.518+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:37.593 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:37.593 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:37.595 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:37.590+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:37.607 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:37.697 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:37.691+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:37.724 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:37.724 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:37.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:37.824 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:37.819+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:37.899 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:37.894+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:37.905 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:37.905 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:37.910 INFO:teuthology.orchestra.run.smithi017.stdout:get_pg_num_history pg_num_history pg_num_history(e100 pg_nums {1={15=1},2={18=8},3={22=32}} deleted_pools ) 2024-09-18T05:15:37.911 INFO:teuthology.orchestra.run.smithi017.stdout:Importing pgid 2.7 2024-09-18T05:15:37.911 INFO:teuthology.orchestra.run.smithi017.stdout:write_pg epoch 80 info 2.7( empty local-lis/les=79/80 n=0 ec=18/18 lis/c=79/79 les/c/f=80/80/0 sis=79) 2024-09-18T05:15:37.918 INFO:teuthology.orchestra.run.smithi017.stdout:Import successful 2024-09-18T05:15:37.920 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:37.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:37.994+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:38.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:15:38.099 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:38.099 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:38.100 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:38.091+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:38.116 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:38.201 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:38.194+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:38.286 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:38.287 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:38.301 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:38.302 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:38.295+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:38.402 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:38.398+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:38.464 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:38.464 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:38.478 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:38.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /var/log/ceph/exp.2.7.2 2024-09-18T05:15:38.524 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:38.519+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:38.601 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:38.601 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:38.604 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:38.599+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:38.615 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:38.705 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:38.699+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:38.784 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:38.784 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:38.798 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:38.840 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:38.835+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:38.907 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:38.899+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:38.964 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:38.964 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:38.978 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:39.020 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:39.015+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:39.036 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:15:39.109 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:39.102+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:39.133 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:39.133 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:39.150 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:39.242 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:39.238+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:39.312 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:39.307+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:39.324 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:39.324 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:39.338 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:39.412 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:39.407+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:39.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:39.513 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:39.513 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:39.514 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:39.511+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:39.528 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:39.614 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:39.607+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:39.637 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:39.637 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:39.654 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:39.654 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:39.654 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:39.671 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:39.671 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:39.691 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:39.703 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:39.704 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:39.712 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:39.712 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:39.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:39.710+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:39.718 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:39.734 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:39.735 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:39.756 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:39.760 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:39.760 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:39.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:39.810+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:39.850 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:39.850 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:39.851 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:39.851 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:39.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:39.917 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:39.911+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:40.018 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:40.014+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:40.035 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:40.035 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:40.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:40.035 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:40.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.035 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77168 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2203648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.035 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:40.035 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.942353521000001, 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049653801999999997, 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77168 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087448+0000", 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087454+0000", 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2539999999999998e-06 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087471+0000", 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6912999999999999e-05 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087484+0000", 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-18T05:15:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.131161+0000", 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.043676751999999999 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.134176+0000", 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030155300000000002 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137103+0000", 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029268459999999999 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77182 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2289664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.941498971999998, 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048114297, 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77182 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088303+0000", 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088309+0000", 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5969999999999997e-06 2024-09-18T05:15:40.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088330+0000", 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1339999999999999e-05 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088365+0000", 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5036000000000001e-05 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136187+0000", 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047821474000000003 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136288+0000", 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010091599999999999 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136418+0000", 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013007700000000001 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.044 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77183 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2330624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.941425072000001, 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048282688999999997, 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77183 2024-09-18T05:15:40.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088377+0000", 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088383+0000", 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9029999999999998e-06 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088404+0000", 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996999999999999e-05 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088420+0000", 2024-09-18T05:15:40.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5353e-05 2024-09-18T05:15:40.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136450+0000", 2024-09-18T05:15:40.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048030394999999997 2024-09-18T05:15:40.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136554+0000", 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103442 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136660+0000", 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010664500000000001 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77188 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2129920~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.941024081999998, 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048117532999999997, 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.050 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77188 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088778+0000", 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088784+0000", 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8000000000000001e-06 2024-09-18T05:15:40.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088802+0000", 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088835+0000", 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2846999999999999e-05 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136693+0000", 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047858165000000001 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136783+0000", 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9862000000000001e-05 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136896+0000", 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112792 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77190 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2170880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.940859357999997, 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048251255, 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77190 2024-09-18T05:15:40.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088942+0000", 2024-09-18T05:15:40.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:40.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088973+0000", 2024-09-18T05:15:40.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0737000000000001e-05 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088996+0000", 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3013000000000001e-05 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089023+0000", 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7183e-05 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136930+0000", 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047907155 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137033+0000", 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103205 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137195+0000", 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016126899999999999 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77192 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2211840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:40.060 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.940711692000001, 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048391998999999998, 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77192 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089090+0000", 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089096+0000", 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089113+0000", 2024-09-18T05:15:40.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6379999999999999e-05 2024-09-18T05:15:40.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089130+0000", 2024-09-18T05:15:40.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7730000000000001e-05 2024-09-18T05:15:40.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137239+0000", 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048108962999999998 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137342+0000", 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010229399999999999 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137483+0000", 2024-09-18T05:15:40.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141235 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77193 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2252800~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.940660227999999, 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048619480999999999, 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.066 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77193 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:40.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089141+0000", 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089158+0000", 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6362999999999999e-05 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089178+0000", 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0469999999999999e-05 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089192+0000", 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4204e-05 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137535+0000", 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048342382000000003 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137639+0000", 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104042 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137762+0000", 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012304699999999999 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.070 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77194 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2293760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.940596452000001, 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048842564999999998, 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77194 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089205+0000", 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089212+0000", 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5100000000000004e-06 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089229+0000", 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7263000000000001e-05 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089242+0000", 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3027000000000001e-05 2024-09-18T05:15:40.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137800+0000", 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048558220999999999 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137928+0000", 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128183 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138049+0000", 2024-09-18T05:15:40.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120387 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77195 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2334720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.940549212000001, 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049100602, 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.075 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77195 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089252+0000", 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089258+0000", 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089276+0000", 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.719e-05 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089291+0000", 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5347000000000001e-05 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138091+0000", 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048800518000000001 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138223+0000", 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131889 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138354+0000", 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013071099999999999 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.079 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77202 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2134016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.940123329000002, 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048921765999999998, 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77202 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089677+0000", 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089695+0000", 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.804e-05 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089735+0000", 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0080000000000003e-05 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089748+0000", 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2493e-05 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138392+0000", 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048644219000000002 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138489+0000", 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6836999999999995e-05 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138601+0000", 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112494 2024-09-18T05:15:40.083 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77203 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2174976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.940046088999999, 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049108851000000002, 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.084 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77203 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089756+0000", 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089761+0000", 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1000000000000003e-06 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089770+0000", 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999999e-06 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089777+0000", 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138641+0000", 2024-09-18T05:15:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048863453000000001 2024-09-18T05:15:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138737+0000", 2024-09-18T05:15:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5828000000000005e-05 2024-09-18T05:15:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138865+0000", 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128804 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77204 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2215936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.940019366000001, 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049349094000000003, 2024-09-18T05:15:40.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77204 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:40.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089786+0000", 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4529999999999998e-06 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089795+0000", 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4130000000000006e-06 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089801+0000", 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8600000000000004e-06 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138903+0000", 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049101643 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139001+0000", 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7707000000000005e-05 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139132+0000", 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013160099999999999 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.095 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77205 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2256896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.095 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:40.095 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.939995476, 2024-09-18T05:15:40.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049589756999999998, 2024-09-18T05:15:40.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.096 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77205 2024-09-18T05:15:40.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.096 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:40.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:40.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089825+0000", 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8340000000000001e-05 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089842+0000", 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6606999999999999e-05 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089854+0000", 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.292e-05 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139170+0000", 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049315335000000002 2024-09-18T05:15:40.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139269+0000", 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9339000000000006e-05 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139397+0000", 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127806 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77206 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2297856~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.939935972999997, 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049792218999999999, 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77206 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089866+0000", 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089872+0000", 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9599999999999997e-06 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089888+0000", 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-05 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089920+0000", 2024-09-18T05:15:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890000000000001e-05 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139435+0000", 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049514916999999999 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139530+0000", 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4847999999999997e-05 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139659+0000", 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012879999999999999 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77207 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2338816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.939863973000001, 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04998259, 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77207 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089937+0000", 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089944+0000", 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089963+0000", 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8623000000000001e-05 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089976+0000", 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3203999999999999e-05 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139698+0000", 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049722211000000002 2024-09-18T05:15:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139796+0000", 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7200000000000004e-05 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139921+0000", 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012560499999999999 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104467 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.762511273000001, 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63367687500000003, 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104467 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267289+0000", 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267300+0000", 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0382e-05 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267326+0000", 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5850000000000002e-05 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267339+0000", 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3754000000000001e-05 2024-09-18T05:15:40.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267425+0000", 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5544999999999995e-05 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267444+0000", 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8947999999999999e-05 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900405+0000", 2024-09-18T05:15:40.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63296088699999997 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900624+0000", 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219466 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900968+0000", 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034406500000000001 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104468 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.762419094999998, 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63418863999999997, 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104468 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.115 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267382+0000", 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267390+0000", 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.028e-06 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267406+0000", 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5446000000000001e-05 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267419+0000", 2024-09-18T05:15:40.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3514e-05 2024-09-18T05:15:40.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:40.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8612e-05 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267503+0000", 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4714e-05 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901334+0000", 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.633831747 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901437+0000", 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010287499999999999 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901572+0000", 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013484799999999999 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104469 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 2359296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.762372575000001, 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63443118099999996, 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104469 2024-09-18T05:15:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267429+0000", 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267435+0000", 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2100000000000001e-06 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267447+0000", 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2532e-05 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267457+0000", 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0010000000000001e-05 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267545+0000", 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7627999999999995e-05 2024-09-18T05:15:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267559+0000", 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3963e-05 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901627+0000", 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63406880399999999 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901723+0000", 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5629000000000002e-05 2024-09-18T05:15:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901861+0000", 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013816499999999999 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104470 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 3211264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.762314250999999, 2024-09-18T05:15:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.634540459, 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104470 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267493+0000", 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5280000000000003e-06 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267509+0000", 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5517999999999999e-05 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267518+0000", 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7030000000000001e-06 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267607+0000", 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9202000000000004e-05 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267620+0000", 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2612999999999999e-05 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901913+0000", 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63429272599999997 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901965+0000", 2024-09-18T05:15:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2391e-05 2024-09-18T05:15:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902029+0000", 2024-09-18T05:15:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3626000000000004e-05 2024-09-18T05:15:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104471 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.762263312000002, 2024-09-18T05:15:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63472597500000005, 2024-09-18T05:15:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104471 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267544+0000", 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2379999999999997e-06 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267557+0000", 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3020000000000001e-05 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267566+0000", 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.38e-06 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267658+0000", 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1852000000000001e-05 2024-09-18T05:15:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267670+0000", 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.224e-05 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902059+0000", 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63438875900000002 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902124+0000", 2024-09-18T05:15:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5374000000000001e-05 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902265+0000", 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140922 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.138 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:40.140 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:40.140 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:40.134+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:40.241 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:40.235+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:40.327 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:40.327 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:40.341 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:40.342 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:40.335+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:40.443 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:40.439+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:40.467 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:40.467 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:40.482 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:40.543 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:40.535+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:40.613 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.69909963800001, 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:15:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:15:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.69906869499999, 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:15:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.699043131, 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:15:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:15:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:15:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.699018415, 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:15:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.69899218099999, 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:15:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.698963272, 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:15:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.698939442, 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:15:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:15:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:15:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.698914966, 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:15:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.698797167, 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.695805212, 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:15:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:15:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.69572715, 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:15:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.695695863, 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:15:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:15:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.69566985, 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:15:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.695642077, 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.69561701400001, 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:15:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:15:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.695591984, 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:15:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:15:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.691467656, 2024-09-18T05:15:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:15:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:15:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.691447111, 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:15:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 108.691427429, 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:15:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:15:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.423355981999997, 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:15:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:15:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:15:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:40.704 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:40.706 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:40.706 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:40.699+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:40.807 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:40.799+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:40.837 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:40.837 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:40.837 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:40.837 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:40.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:40.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:40.902+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:41.009 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:41.002+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:41.014 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:41.014 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:41.014 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:41.014 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:41.015 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:41.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:41.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:15:41.109 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:41.103+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:41.169 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:41.169 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:41.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:41.169 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417171852000003, 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:41.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417162861999998, 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.174 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:15:41.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.178 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417153894999998, 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:41.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:15:41.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417145112, 2024-09-18T05:15:41.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:15:41.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:15:41.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417136335999999, 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:41.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:15:41.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417126044, 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.192 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:15:41.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:15:41.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417112156999998, 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.196 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:41.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:15:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417102950999997, 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.201 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:15:41.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417094253000002, 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.205 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:15:41.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:15:41.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417085188000001, 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:15:41.209 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:15:41.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417061830000002, 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:15:41.217 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417052165000001, 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.218 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417025807999998, 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:41.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:41.226 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417012276000001, 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:15:41.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:15:41.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.417000825000002, 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:41.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:15:41.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:15:41.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.416991344000003, 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:15:41.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:15:41.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.416981262, 2024-09-18T05:15:41.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:41.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:15:41.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.416972174000001, 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:15:41.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:15:41.247 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.416962617000003, 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.248 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.416953796000001, 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.252 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.256 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:41.258 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:41.258 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:41.251+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:41.358 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:41.351+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:41.428 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:41.428 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:41.429 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:41.429 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:41.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:41.485 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:41.479+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:41.560 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:41.554+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:41.611 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:41.611 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:41.611 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:41.611 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:41.611 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:41.625 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:41.672 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:41.667+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:41.746 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:41.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:41.746 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:41.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.746 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.081227795000004, 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:41.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:41.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:41.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:41.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:41.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.755 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.755 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:41.755 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.081160877000002, 2024-09-18T05:15:41.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:41.755 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.755 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.081072367000004, 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.761 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:41.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.762 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:41.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:41.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.081021810999999, 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:41.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:41.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:41.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:41.771 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080958695999996, 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:41.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080911775999994, 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.776 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:41.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:41.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080857897000001, 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:41.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:41.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:41.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:41.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:41.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080810764000006, 2024-09-18T05:15:41.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:41.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:41.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:41.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:41.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:41.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:41.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.791 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.791 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.791 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:41.791 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080763141999995, 2024-09-18T05:15:41.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:41.792 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.792 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.792 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.792 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.792 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.792 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:41.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080640321000004, 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:41.797 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.798 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.798 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.798 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.798 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.798 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:41.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.798 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:41.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:41.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:41.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:41.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:41.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:41.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080558991000004, 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.804 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:41.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.804 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:41.807 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080487747999996, 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.808 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080437536999995, 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:41.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:41.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080360342999995, 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:41.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:41.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:41.821 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080310472999997, 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:41.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:41.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080235901999998, 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.827 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:41.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080170124000006, 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.832 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:41.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:41.836 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080123087999993, 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:41.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:41.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080060994999997, 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:41.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.080014616, 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:41.845 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:41.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:41.849 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:41.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:41.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:41.846+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:41.852 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:41.951 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:41.946+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:42.009 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:42.023 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:42.023 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:42.023 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:42.023 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:42.025 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:42.025 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:42.026 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:42.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:42.041 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:42.059 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:42.059 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:42.068 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:15:42.080 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:42.075+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:42.081 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:42.081 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:42.100 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:42.119 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:42.123 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:42.124 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:42.163 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:42.164 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:42.166 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:42.162+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:42.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:42.268 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:42.263+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:42.347 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:42.347 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:42.355 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:42.347+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:42.360 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:42.456 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:42.450+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:42.525 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:42.526 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:42.540 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:42.557 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:42.554+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:42.658 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:42.654+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:42.664 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:42.664 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:42.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:42.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:42.754+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:42.793 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:42.794 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:42.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:42.859 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:42.851+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:42.942 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:42.942 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:42.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:42.960 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:42.955+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:43.060 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:43.055+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:43.091 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:43.092 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:43.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:43.161 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:43.154+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:43.241 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:43.241 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:43.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:43.262 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:43.255+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:43.363 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:43.358+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:43.429 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:43.430 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:43.444 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:43.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:43.482+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:43.536 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [2] live_osds: [0, 1, 3, 4, 5, 7, 6] 2024-09-18T05:15:43.536 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:15:43.537 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-18T05:15:43.537 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T05:15:43.537 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T05:15:43.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-18T05:15:43.564 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:43.558+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:43.614 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:43.614 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:43.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:43.665 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:43.659+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:43.668 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:43.668 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T05:15:43.668 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:43.766 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:43.763+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:43.796 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:43.797 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:43.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:43.867 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:43.859+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:43.953 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:43.998 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:43.994+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:44.069 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:44.063+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:44.078 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:44.079 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:44.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:15:44.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:44.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:44.202 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:44.198+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:44.241 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:44.241 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:44.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:44.302 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:44.298+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:44.330 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:44.348 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:44.348 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:44.348 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:44.364 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:44.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:44.366+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:44.384 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:44.384 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:44.393 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:44.393 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:44.393 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:44.393 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:44.405 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:44.408 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:44.422 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:44.422 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:44.442 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:44.442 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:44.445 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:44.445 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:44.472 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:44.463+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:44.531 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:44.532 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:44.532 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:44.532 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:44.532 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:44.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:44.588 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:44.583+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:44.674 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:44.667+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:44.713 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963506191, 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:15:44.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:15:44.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963497201000003, 2024-09-18T05:15:44.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:44.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963488234000003, 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.723 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.727 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963479450999998, 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:15:44.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:15:44.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963470675000003, 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:15:44.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:44.736 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963460382999997, 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:44.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963446496000003, 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:15:44.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963437290000002, 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.745 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:15:44.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:15:44.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:15:44.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:44.749 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963428592, 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:15:44.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:15:44.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963419526999999, 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:15:44.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963396168999999, 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:15:44.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963386503999999, 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:15:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963360147000003, 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:15:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963346614999999, 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:15:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963335164, 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:15:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:15:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963325683000001, 2024-09-18T05:15:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:15:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963315600999998, 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:15:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963306512999999, 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:15:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963296956000001, 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.963288134999999, 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:44.801 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:44.802 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:44.802 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:44.795+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:44.903 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:44.895+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:44.972 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:44.972 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:44.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:45.028 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:45.023+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:15:45.104 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:45.098+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:45.164 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:45.164 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:45.165 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:45.165 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:45.165 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:45.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:45.205 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:45.198+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:45.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:45.302+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:45.318 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:45.318 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:45.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:45.318 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.654274510999997, 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:45.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:45.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:45.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:45.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:45.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.323 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.654207592999995, 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:45.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.654119082999998, 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:45.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:45.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.654068527000007, 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.332 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:45.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:45.336 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.654005412000004, 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653958492000001, 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653904612999995, 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653857479999999, 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653809858000002, 2024-09-18T05:15:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653687036999997, 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653605706999997, 2024-09-18T05:15:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653534464000003, 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653484253000002, 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653407059000003, 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653357189000005, 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653282618000006, 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653216839999999, 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653169804000001, 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653107711000004, 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.653061331999993, 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.410 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:45.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:45.412 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:45.403+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:45.512 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:45.507+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:45.584 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:45.584 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:45.585 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:45.585 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:45.598 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:45.642 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:45.635+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:45.714 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:45.707+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:45.773 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:45.774 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:45.787 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:45.828 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:45.823+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:45.916 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:45.910+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:45.955 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:45.955 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:45.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:45.955 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:45.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.955 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121386 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 686080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.955 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:45.955 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.995067321000001, 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056108969000000002, 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121386 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955696+0000", 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0874e-05 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955703+0000", 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3189999999999997e-06 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955708+0000", 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0429999999999998e-06 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011705+0000", 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055996870999999997 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011743+0000", 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7895000000000002e-05 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011794+0000", 2024-09-18T05:15:45.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1307999999999997e-05 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121387 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 698368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.995039737999999, 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056181659000000002, 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.960 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121387 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955712+0000", 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955715+0000", 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3760000000000002e-06 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955721+0000", 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2589999999999997e-06 2024-09-18T05:15:45.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955725+0000", 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4009999999999999e-06 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011813+0000", 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056088051999999999 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011848+0000", 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4847e-05 2024-09-18T05:15:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011894+0000", 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121388 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.995022826, 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056271570999999999, 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121388 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955729+0000", 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955731+0000", 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2019999999999998e-06 2024-09-18T05:15:45.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955737+0000", 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9139999999999996e-06 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955751+0000", 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3311e-05 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011914+0000", 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163594999999997 2024-09-18T05:15:45.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011952+0000", 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7834999999999999e-05 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012001+0000", 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9084e-05 2024-09-18T05:15:45.968 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121389 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 722944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994996696000001, 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056345279999999998, 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.969 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121389 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:45.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955755+0000", 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955759+0000", 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3850000000000002e-06 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955766+0000", 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8499999999999996e-06 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955771+0000", 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0170000000000004e-06 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012021+0000", 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056250737000000002 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012057+0000", 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5271000000000002e-05 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012101+0000", 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4403999999999997e-05 2024-09-18T05:15:45.973 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121390 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 735232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994975768, 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056430889999999997, 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.974 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121390 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955776+0000", 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955779+0000", 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6290000000000002e-06 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955786+0000", 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.435e-06 2024-09-18T05:15:45.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955791+0000", 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7520000000000004e-06 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012120+0000", 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056329443999999999 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012158+0000", 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7925e-05 2024-09-18T05:15:45.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012208+0000", 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9301000000000001e-05 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121391 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 747520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994944308000001, 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056498934000000001, 2024-09-18T05:15:45.978 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121391 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955811+0000", 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9560000000000002e-06 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955818+0000", 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3339999999999996e-06 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955823+0000", 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2839999999999997e-06 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012227+0000", 2024-09-18T05:15:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056403880000000003 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012262+0000", 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4618e-05 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012307+0000", 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5413e-05 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121392 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994924472000001, 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056582623999999998, 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121392 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955830+0000", 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999998e-06 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955837+0000", 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955842+0000", 2024-09-18T05:15:45.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6770000000000003e-06 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012326+0000", 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056483691000000003 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012363+0000", 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7024999999999999e-05 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012411+0000", 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7845e-05 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121393 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 772096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994906052000001, 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056662902000000001, 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.987 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121393 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:45.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955848+0000", 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2350000000000002e-06 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955855+0000", 2024-09-18T05:15:45.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0500000000000003e-06 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955860+0000", 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8080000000000004e-06 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012430+0000", 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056570047999999998 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012465+0000", 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4718000000000002e-05 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012509+0000", 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4418000000000001e-05 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121394 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 784384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.991 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994888159999999, 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056750383000000001, 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121394 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955866+0000", 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955873+0000", 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4810000000000003e-06 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955878+0000", 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8500000000000002e-06 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012529+0000", 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056651708000000002 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012567+0000", 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7642000000000003e-05 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012615+0000", 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7811e-05 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:45.995 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121395 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994870792, 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056832344999999999, 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121395 2024-09-18T05:15:45.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955881+0000", 2024-09-18T05:15:45.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955884+0000", 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3240000000000001e-06 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955890+0000", 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0909999999999998e-06 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955894+0000", 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012635+0000", 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056740087000000002 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012670+0000", 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5123999999999998e-05 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:45.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012714+0000", 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4384000000000001e-05 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121396 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 808960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994838317999999, 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057018234000000001, 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.000 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121396 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955917+0000", 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0979999999999998e-06 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955930+0000", 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3552e-05 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955936+0000", 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7309999999999998e-06 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012733+0000", 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056797146999999999 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012770+0000", 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7239e-05 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012932+0000", 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016205000000000001 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121397 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 821248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994811661, 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057105428999999999, 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121397 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:46.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955940+0000", 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955943+0000", 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7439999999999999e-06 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955950+0000", 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8129999999999998e-06 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955957+0000", 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1849999999999998e-06 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012953+0000", 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056995559000000001 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012987+0000", 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4777000000000003e-05 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013046+0000", 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8867999999999999e-05 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.008 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121398 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 833536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994790783999999, 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057212333999999997, 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121398 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.009 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955961+0000", 2024-09-18T05:15:46.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955970+0000", 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6759999999999996e-06 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955981+0000", 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0706999999999999e-05 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955986+0000", 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0719999999999999e-06 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013067+0000", 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057081595999999998 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013111+0000", 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3331999999999998e-05 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013174+0000", 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3323000000000003e-05 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121399 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.994761772, 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057281034000000002, 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.013 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121399 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955990+0000", 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955993+0000", 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955999+0000", 2024-09-18T05:15:46.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4699999999999999e-06 2024-09-18T05:15:46.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.956004+0000", 2024-09-18T05:15:46.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:15:46.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013194+0000", 2024-09-18T05:15:46.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057189503000000003 2024-09-18T05:15:46.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013233+0000", 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9082000000000003e-05 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013272+0000", 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9014000000000003e-05 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121415 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.991929536000001, 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023800999999998, 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121415 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958825+0000", 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.835e-06 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958831+0000", 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.088e-06 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958842+0000", 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0916e-05 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014771+0000", 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055928731000000002 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014809+0000", 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7713999999999998e-05 2024-09-18T05:15:46.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014847+0000", 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7888e-05 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121416 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 528384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.991904291000001, 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056112120000000001, 2024-09-18T05:15:46.023 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121416 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958850+0000", 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.729e-06 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958858+0000", 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958866+0000", 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2840000000000006e-06 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014866+0000", 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056000419000000003 2024-09-18T05:15:46.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014907+0000", 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0533e-05 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014960+0000", 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3427000000000002e-05 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121417 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 540672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.991880843000001, 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056196533999999999, 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121417 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958871+0000", 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958874+0000", 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.537e-06 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958881+0000", 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1840000000000002e-06 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958886+0000", 2024-09-18T05:15:46.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014981+0000", 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056095036000000001 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015017+0000", 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6732e-05 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015068+0000", 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0855e-05 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121418 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 552960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.991787716000001, 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056223713000000002, 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.032 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121418 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958889+0000", 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999247 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958968+0000", 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8638000000000002e-05 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958990+0000", 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1614e-05 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959004+0000", 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4157e-05 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015088+0000", 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056084547999999998 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015129+0000", 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1048999999999999e-05 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015188+0000", 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8967e-05 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121420 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 577536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.991371992000001, 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056036506999999999, 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121420 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959383+0000", 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3689999999999998e-06 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959390+0000", 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1799999999999999e-06 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959396+0000", 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5330000000000002e-06 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015330+0000", 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055934086000000001 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015369+0000", 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8732000000000001e-05 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015417+0000", 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8241000000000001e-05 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.040 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121421 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 589824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.991351379000001, 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056116280999999997, 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121421 2024-09-18T05:15:46.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959403+0000", 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6989999999999999e-06 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959409+0000", 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1099999999999999e-06 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959414+0000", 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6190000000000002e-06 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015437+0000", 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023252000000003 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015473+0000", 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6086e-05 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015517+0000", 2024-09-18T05:15:46.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4082999999999998e-05 2024-09-18T05:15:46.045 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.045 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.045 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.045 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.045 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.045 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:46.047 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:46.047 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:46.039+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:46.148 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:46.139+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:46.221 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:46.221 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:46.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:46.249 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:46.242+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:46.350 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:46.343+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:46.406 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:46.407 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:46.407 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:46.420 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:46.446 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:46.465 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:46.459+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:46.551 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:46.546+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:102332 3.10 3:0b2ae2d1:::rbd_data.118b62cc3496.000000000000001a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.463807553999999, 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.065837997999999995, 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.595 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102332 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126923+0000", 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126935+0000", 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1970000000000001e-05 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126960+0000", 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4888999999999998e-05 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126980+0000", 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0642999999999999e-05 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127082+0000", 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101118 2024-09-18T05:15:46.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127332+0000", 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000250771 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.140319+0000", 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012987115 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192666+0000", 2024-09-18T05:15:46.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052346629999999998 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192681+0000", 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4769e-05 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192726+0000", 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4925000000000001e-05 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192763+0000", 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7141000000000002e-05 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121156 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2064384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.699429711000001, 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038247947999999997, 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.601 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121156 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891302+0000", 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891314+0000", 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1557e-05 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891321+0000", 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7619999999999998e-06 2024-09-18T05:15:46.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891325+0000", 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6600000000000003e-06 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929365+0000", 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038039942 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929467+0000", 2024-09-18T05:15:46.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101191 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929551+0000", 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4220000000000003e-05 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121157 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2076672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.699402572, 2024-09-18T05:15:46.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038423377000000002, 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121157 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891332+0000", 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:46.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891338+0000", 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9800000000000003e-06 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891342+0000", 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3470000000000001e-06 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929593+0000", 2024-09-18T05:15:46.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038250926999999997 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929674+0000", 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0976999999999994e-05 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929753+0000", 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8948000000000004e-05 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.609 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121158 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2088960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.699385951, 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818722, 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121158 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.610 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891346+0000", 2024-09-18T05:15:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891349+0000", 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5050000000000002e-06 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891355+0000", 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4370000000000004e-06 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891365+0000", 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7520000000000008e-06 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929862+0000", 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038497177 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930078+0000", 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000215992 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930165+0000", 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7243000000000005e-05 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121271 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1906688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686323111, 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038405050000000003, 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.614 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121271 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904416+0000", 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0160000000000003e-06 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904423+0000", 2024-09-18T05:15:46.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9890000000000003e-06 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904428+0000", 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6890000000000003e-06 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942670+0000", 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038242653000000001 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942752+0000", 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2140999999999998e-05 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942814+0000", 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2101999999999996e-05 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121272 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1918976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:46.618 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.68629554, 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038493807999999997, 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121272 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904439+0000", 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3870000000000002e-06 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904445+0000", 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0240000000000003e-06 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904450+0000", 2024-09-18T05:15:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9400000000000001e-06 2024-09-18T05:15:46.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942846+0000", 2024-09-18T05:15:46.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038395692000000002 2024-09-18T05:15:46.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942889+0000", 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3659000000000003e-05 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942931+0000", 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1470000000000001e-05 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121273 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1931264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.623 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686278191, 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038620175, 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121273 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904456+0000", 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3360000000000002e-06 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904462+0000", 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7289999999999997e-06 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904472+0000", 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0020999999999999e-05 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942960+0000", 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038488306999999999 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943002+0000", 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2089999999999999e-05 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943075+0000", 2024-09-18T05:15:46.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2092e-05 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121274 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1943552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686247751, 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818021000000001, 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.628 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121274 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904484+0000", 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904487+0000", 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904494+0000", 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0940000000000002e-06 2024-09-18T05:15:46.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904499+0000", 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.933e-06 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943121+0000", 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038622507 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943208+0000", 2024-09-18T05:15:46.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6397999999999995e-05 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943303+0000", 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4895000000000005e-05 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121275 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1955840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686229461, 2024-09-18T05:15:46.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039005943000000001, 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121275 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904505+0000", 2024-09-18T05:15:46.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904511+0000", 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0190000000000003e-06 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904516+0000", 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9200000000000003e-06 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943351+0000", 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038834425999999998 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943430+0000", 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9505000000000005e-05 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943509+0000", 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121276 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1968128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686212064999999, 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039192704000000002, 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.637 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121276 2024-09-18T05:15:46.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.638 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:46.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904523+0000", 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5179999999999999e-06 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904529+0000", 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4860000000000002e-06 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904533+0000", 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2390000000000004e-06 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943554+0000", 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039020332999999997 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943634+0000", 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0673000000000005e-05 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943713+0000", 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8858999999999998e-05 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121277 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1980416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686194742000001, 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039321828000000003, 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121277 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:46.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904537+0000", 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904544+0000", 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8990000000000004e-06 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904551+0000", 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3940000000000001e-06 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904556+0000", 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1200000000000001e-06 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943770+0000", 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039214514999999998 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943816+0000", 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5371999999999999e-05 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943860+0000", 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3875999999999998e-05 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.646 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121278 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1992704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686172118000002, 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039412773999999998, 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121278 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904563+0000", 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5000000000000002e-06 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904569+0000", 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.224e-06 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904574+0000", 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8659999999999997e-06 2024-09-18T05:15:46.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943890+0000", 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039316027000000003 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943931+0000", 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1137000000000003e-05 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943973+0000", 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2416999999999997e-05 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121279 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2004992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686154643999998, 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039512600000000002, 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.652 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121279 2024-09-18T05:15:46.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.652 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:46.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.653 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:46.654 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904580+0000", 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3640000000000002e-06 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904587+0000", 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6719999999999998e-06 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904591+0000", 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5549999999999996e-06 2024-09-18T05:15:46.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944001+0000", 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039410387999999998 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944046+0000", 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4626000000000003e-05 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944090+0000", 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4351000000000003e-05 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121280 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2017280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686136777000002, 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039608457999999999, 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.658 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121280 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904595+0000", 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904598+0000", 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4549999999999998e-06 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904604+0000", 2024-09-18T05:15:46.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904609+0000", 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7949999999999998e-06 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944120+0000", 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039511211999999997 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944161+0000", 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0766000000000002e-05 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944204+0000", 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3234e-05 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121281 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2029568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686119102999999, 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039699867999999999, 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121281 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904615+0000", 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.305e-06 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904622+0000", 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4320000000000004e-06 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904627+0000", 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.729e-06 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944231+0000", 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039604749000000002 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944270+0000", 2024-09-18T05:15:46.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8531000000000001e-05 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944313+0000", 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3479000000000002e-05 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121282 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2041856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686080236999999, 2024-09-18T05:15:46.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039764847999999998, 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121282 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904655+0000", 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8219999999999998e-06 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904661+0000", 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8539999999999999e-06 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904677+0000", 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5488000000000001e-05 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944340+0000", 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039663588999999999 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944380+0000", 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9548999999999997e-05 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944417+0000", 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7138000000000003e-05 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.671 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121283 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2054144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686050568999999, 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039840091000000001, 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.672 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121283 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904689+0000", 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7190000000000001e-06 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904696+0000", 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6529999999999997e-06 2024-09-18T05:15:46.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904701+0000", 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.101e-06 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944443+0000", 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039741601000000001 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944483+0000", 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0138000000000001e-05 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944522+0000", 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9289000000000003e-05 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121284 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2066432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:46.676 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.686027433, 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039925616999999997, 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121284 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904707+0000", 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.616e-06 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904714+0000", 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.161e-06 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904718+0000", 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8389999999999997e-06 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944553+0000", 2024-09-18T05:15:46.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039834596 2024-09-18T05:15:46.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944591+0000", 2024-09-18T05:15:46.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-18T05:15:46.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944631+0000", 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9526000000000001e-05 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121285 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2078720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.68600927, 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040039444, 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.681 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121285 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:46.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904726+0000", 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6630000000000002e-06 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904732+0000", 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6069999999999996e-06 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904737+0000", 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9609999999999996e-06 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944658+0000", 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039920421999999997 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944696+0000", 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8395000000000001e-05 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944763+0000", 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6761999999999995e-05 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.685 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121286 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2091008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.685990287999999, 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040212352999999999, 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121286 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:46.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904744+0000", 2024-09-18T05:15:46.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904751+0000", 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7689999999999999e-06 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904756+0000", 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5959999999999997e-06 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944796+0000", 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040040048000000002 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944883+0000", 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7268999999999994e-05 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944955+0000", 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1505000000000001e-05 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.689 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.690 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.690 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:46.690 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:46.690 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:46.691 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:46.647+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:46.691 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:46.691 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:46.692 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:46.692 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:46.692 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:46.692 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:46.693 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:46.702 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:46.702 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:46.724 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:46.725 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:46.728 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:46.729 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:46.754 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:46.751+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:46.818 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:46.818 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:46.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:46.855 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:46.847+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:46.956 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:46.955+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:46.959 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:46.959 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:46.973 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:47.058 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:47.055+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:47.093 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:47.094 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:47.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:47.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:15:47.202 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:47.198+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:47.251 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:47.251 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:47.259 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:47.251+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:47.268 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:47.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:47.354+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:47.428 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:47.428 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:47.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:47.461 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:47.455+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:47.563 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:47.555+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:47.610 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:47.611 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:47.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:47.663 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:47.659+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:47.764 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:47.763+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:47.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:47.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:47.858+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:47.894 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:47.894 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:47.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:47.994 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:47.990+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:48.067 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:48.063+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:48.077 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:48.080 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:48.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:15:48.168 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:48.162+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:48.233 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:48.233 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:48.248 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:48.292 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:48.287+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:48.367 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:48.367 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:48.369 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:48.363+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:48.381 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:48.470 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:48.466+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:48.551 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:48.551 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:48.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:48.612 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:48.611+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:48.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:48.666+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:48.683 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [2] live_osds: [0, 1, 3, 4, 5, 7, 6] 2024-09-18T05:15:48.684 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-18T05:15:48.684 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T05:15:48.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-18T05:15:48.686 INFO:tasks.ceph.osd.2:Started 2024-09-18T05:15:48.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:48.688 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:48.688 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:48.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:48.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:48.792 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:48.791+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:no valid command found; 10 closest matches: 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:0 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:1 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:2 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:abort 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:assert 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:config diff 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:config diff get 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:config get 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:config help [] 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:config set ... 2024-09-18T05:15:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:admin_socket: invalid command 2024-09-18T05:15:48.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T05:15:48.810 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-18T05:15:48.865 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:48.866 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:48.873 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:48.874 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:48.874 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:48.867+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:48.880 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:48.890 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:48.890 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:48.890 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:48.906 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:48.924 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:48.942 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:48.943 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:48.960 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:48.961 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:48.975 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:48.971+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:48.980 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:48.980 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:48.986 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:48.987 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:49.049 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384860713999998, 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:15:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384793795999997, 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:15:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384705285999999, 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:15:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384654729999994, 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:15:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384591615000005, 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:15:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:15:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384544695000002, 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:15:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:15:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384490815999996, 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:15:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384443683000001, 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:15:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384396061000004, 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384273239999999, 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:15:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:15:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384191909999998, 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:15:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:15:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384120667000005, 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:15:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:15:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:15:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.384070456000003, 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:15:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:15:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.383993262000004, 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:15:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:15:49.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:15:49.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:15:49.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:15:49.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.383943392000006, 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:15:49.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.118 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.383868820999993, 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.119 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:15:49.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:15:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:15:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.383803043, 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:15:49.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:15:49.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:15:49.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:15:49.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:15:49.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.128 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.129 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.129 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:49.129 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.383756007000002, 2024-09-18T05:15:49.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:15:49.129 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.129 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:15:49.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:15:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.133 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.134 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.134 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.134 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:49.134 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.383693914000006, 2024-09-18T05:15:49.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:15:49.134 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.134 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:15:49.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.383647534999994, 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.139 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:15:49.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:15:49.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:15:49.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:15:49.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:15:49.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:15:49.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:15:49.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:15:49.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:15:49.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:15:49.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.144 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.144 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.145 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:49.146 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:49.147 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:49.142+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:49.247 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:49.243+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:49.312 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:49.306+0000 7fe5b77b57c0 -1 Falling back to public interface 2024-09-18T05:15:49.326 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:49.326 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:49.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:49.384 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:49.383+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:49.450 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:49.446+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:49.505 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:49.506 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:49.520 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:49.564 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:49.563+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:49.640 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121386 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 686080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681374472999998, 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056108969000000002, 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.641 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.642 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.642 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.642 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.642 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121386 2024-09-18T05:15:49.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.642 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955696+0000", 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0874e-05 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955703+0000", 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3189999999999997e-06 2024-09-18T05:15:49.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955708+0000", 2024-09-18T05:15:49.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0429999999999998e-06 2024-09-18T05:15:49.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011705+0000", 2024-09-18T05:15:49.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055996870999999997 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011743+0000", 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7895000000000002e-05 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011794+0000", 2024-09-18T05:15:49.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1307999999999997e-05 2024-09-18T05:15:49.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.647 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.647 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121387 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 698368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.647 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:49.647 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.68134689, 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056181659000000002, 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121387 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955712+0000", 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955715+0000", 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3760000000000002e-06 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955721+0000", 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2589999999999997e-06 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955725+0000", 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4009999999999999e-06 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011813+0000", 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056088051999999999 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011848+0000", 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4847e-05 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011894+0000", 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121388 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681329978000001, 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056271570999999999, 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.652 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121388 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955729+0000", 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955731+0000", 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2019999999999998e-06 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955737+0000", 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9139999999999996e-06 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955751+0000", 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3311e-05 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011914+0000", 2024-09-18T05:15:49.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163594999999997 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011952+0000", 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7834999999999999e-05 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012001+0000", 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9084e-05 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.656 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121389 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 722944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681303847999999, 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056345279999999998, 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.657 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121389 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955755+0000", 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955759+0000", 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3850000000000002e-06 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955766+0000", 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8499999999999996e-06 2024-09-18T05:15:49.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955771+0000", 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0170000000000004e-06 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012021+0000", 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056250737000000002 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012057+0000", 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5271000000000002e-05 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012101+0000", 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4403999999999997e-05 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121390 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 735232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:49.661 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681282920000001, 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056430889999999997, 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121390 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955776+0000", 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955779+0000", 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6290000000000002e-06 2024-09-18T05:15:49.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955786+0000", 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.435e-06 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955791+0000", 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7520000000000004e-06 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012120+0000", 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056329443999999999 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012158+0000", 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7925e-05 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012208+0000", 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9301000000000001e-05 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.665 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121391 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 747520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681251459999999, 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056498934000000001, 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121391 2024-09-18T05:15:49.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955811+0000", 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9560000000000002e-06 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955818+0000", 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3339999999999996e-06 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955823+0000", 2024-09-18T05:15:49.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2839999999999997e-06 2024-09-18T05:15:49.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012227+0000", 2024-09-18T05:15:49.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056403880000000003 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012262+0000", 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4618e-05 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012307+0000", 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5413e-05 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121392 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681231623999999, 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056582623999999998, 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121392 2024-09-18T05:15:49.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955830+0000", 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999998e-06 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955837+0000", 2024-09-18T05:15:49.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955842+0000", 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6770000000000003e-06 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012326+0000", 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056483691000000003 2024-09-18T05:15:49.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012363+0000", 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7024999999999999e-05 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012411+0000", 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7845e-05 2024-09-18T05:15:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121393 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 772096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681213203999999, 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056662902000000001, 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.676 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121393 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955848+0000", 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2350000000000002e-06 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955855+0000", 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0500000000000003e-06 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955860+0000", 2024-09-18T05:15:49.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8080000000000004e-06 2024-09-18T05:15:49.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012430+0000", 2024-09-18T05:15:49.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056570047999999998 2024-09-18T05:15:49.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012465+0000", 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4718000000000002e-05 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012509+0000", 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4418000000000001e-05 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.681 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121394 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 784384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.682 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:49.682 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681195312, 2024-09-18T05:15:49.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056750383000000001, 2024-09-18T05:15:49.682 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.682 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.682 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.682 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.682 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.682 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121394 2024-09-18T05:15:49.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.683 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:49.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:49.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:15:49.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955866+0000", 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955873+0000", 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4810000000000003e-06 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955878+0000", 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8500000000000002e-06 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012529+0000", 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056651708000000002 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012567+0000", 2024-09-18T05:15:49.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7642000000000003e-05 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012615+0000", 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7811e-05 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121395 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681177944000002, 2024-09-18T05:15:49.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056832344999999999, 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121395 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955881+0000", 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955884+0000", 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3240000000000001e-06 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955890+0000", 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0909999999999998e-06 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955894+0000", 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012635+0000", 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056740087000000002 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012670+0000", 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5123999999999998e-05 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012714+0000", 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4384000000000001e-05 2024-09-18T05:15:49.691 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121396 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 808960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681145470000001, 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057018234000000001, 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.692 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121396 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955917+0000", 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0979999999999998e-06 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955930+0000", 2024-09-18T05:15:49.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3552e-05 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955936+0000", 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7309999999999998e-06 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012733+0000", 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056797146999999999 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012770+0000", 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7239e-05 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012932+0000", 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016205000000000001 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121397 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 821248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681118813000001, 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057105428999999999, 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121397 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955940+0000", 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955943+0000", 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7439999999999999e-06 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955950+0000", 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8129999999999998e-06 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955957+0000", 2024-09-18T05:15:49.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1849999999999998e-06 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012953+0000", 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056995559000000001 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012987+0000", 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4777000000000003e-05 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013046+0000", 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8867999999999999e-05 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121398 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 833536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681097936, 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057212333999999997, 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121398 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:15:49.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955961+0000", 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955970+0000", 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6759999999999996e-06 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955981+0000", 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0706999999999999e-05 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955986+0000", 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0719999999999999e-06 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013067+0000", 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057081595999999998 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013111+0000", 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3331999999999998e-05 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013174+0000", 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3323000000000003e-05 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121399 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.705 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.681068924000002, 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057281034000000002, 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121399 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955990+0000", 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955993+0000", 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955999+0000", 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4699999999999999e-06 2024-09-18T05:15:49.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.956004+0000", 2024-09-18T05:15:49.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:15:49.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013194+0000", 2024-09-18T05:15:49.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057189503000000003 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013233+0000", 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9082000000000003e-05 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013272+0000", 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9014000000000003e-05 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121415 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.678236687999998, 2024-09-18T05:15:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023800999999998, 2024-09-18T05:15:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121415 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:49.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:15:49.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958825+0000", 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.835e-06 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958831+0000", 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.088e-06 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958842+0000", 2024-09-18T05:15:49.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0916e-05 2024-09-18T05:15:49.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014771+0000", 2024-09-18T05:15:49.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055928731000000002 2024-09-18T05:15:49.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014809+0000", 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7713999999999998e-05 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014847+0000", 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7888e-05 2024-09-18T05:15:49.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121416 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 528384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.678211442999999, 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056112120000000001, 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.717 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121416 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:49.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:15:49.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958850+0000", 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.729e-06 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958858+0000", 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958866+0000", 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2840000000000006e-06 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014866+0000", 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056000419000000003 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014907+0000", 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0533e-05 2024-09-18T05:15:49.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014960+0000", 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3427000000000002e-05 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121417 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 540672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.678187995000002, 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056196533999999999, 2024-09-18T05:15:49.722 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121417 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:49.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958871+0000", 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958874+0000", 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.537e-06 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958881+0000", 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1840000000000002e-06 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958886+0000", 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014981+0000", 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056095036000000001 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015017+0000", 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6732e-05 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015068+0000", 2024-09-18T05:15:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0855e-05 2024-09-18T05:15:49.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.727 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.727 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121418 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 552960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.727 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:49.727 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.678094867999999, 2024-09-18T05:15:49.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056223713000000002, 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121418 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:49.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958889+0000", 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999247 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958968+0000", 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8638000000000002e-05 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958990+0000", 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1614e-05 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959004+0000", 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4157e-05 2024-09-18T05:15:49.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015088+0000", 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056084547999999998 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015129+0000", 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1048999999999999e-05 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015188+0000", 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8967e-05 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121420 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 577536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.677679143999999, 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056036506999999999, 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121420 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:49.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959383+0000", 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3689999999999998e-06 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959390+0000", 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1799999999999999e-06 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959396+0000", 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5330000000000002e-06 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015330+0000", 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055934086000000001 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015369+0000", 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8732000000000001e-05 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015417+0000", 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8241000000000001e-05 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121421 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 589824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.677658530999999, 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056116280999999997, 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:49.737 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121421 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959403+0000", 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6989999999999999e-06 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959409+0000", 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1099999999999999e-06 2024-09-18T05:15:49.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959414+0000", 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6190000000000002e-06 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015437+0000", 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023252000000003 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015473+0000", 2024-09-18T05:15:49.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6086e-05 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015517+0000", 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4082999999999998e-05 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:49.741 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:49.742 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:49.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:49.744 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:49.739+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:49.844 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:49.838+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:49.911 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:49.911 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:49.930 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:49.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:49.938+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:50.046 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:50.046 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:50.046 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:50.046 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:50.046 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:50.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:50.042+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:50.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:50.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:50.142+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:50.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:15:50.188 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:50.188 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:50.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:50.188 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:50.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.188 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:102332 3.10 3:0b2ae2d1:::rbd_data.118b62cc3496.000000000000001a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.057899134000003, 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.065837997999999995, 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102332 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.189 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:50.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126923+0000", 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126935+0000", 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1970000000000001e-05 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126960+0000", 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4888999999999998e-05 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126980+0000", 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0642999999999999e-05 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127082+0000", 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101118 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127332+0000", 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000250771 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:15:50.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.140319+0000", 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012987115 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192666+0000", 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052346629999999998 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192681+0000", 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4769e-05 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:50.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192726+0000", 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4925000000000001e-05 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192763+0000", 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7141000000000002e-05 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121156 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2064384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:50.195 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.293521291000001, 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038247947999999997, 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121156 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:50.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891302+0000", 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891314+0000", 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1557e-05 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891321+0000", 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7619999999999998e-06 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891325+0000", 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6600000000000003e-06 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929365+0000", 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038039942 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929467+0000", 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101191 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929551+0000", 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4220000000000003e-05 2024-09-18T05:15:50.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121157 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2076672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.293494152000001, 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038423377000000002, 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121157 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891332+0000", 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891338+0000", 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9800000000000003e-06 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891342+0000", 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3470000000000001e-06 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929593+0000", 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038250926999999997 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929674+0000", 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0976999999999994e-05 2024-09-18T05:15:50.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929753+0000", 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8948000000000004e-05 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121158 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2088960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.293477531000001, 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818722, 2024-09-18T05:15:50.204 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121158 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891346+0000", 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891349+0000", 2024-09-18T05:15:50.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5050000000000002e-06 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891355+0000", 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4370000000000004e-06 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891365+0000", 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7520000000000008e-06 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929862+0000", 2024-09-18T05:15:50.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038497177 2024-09-18T05:15:50.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930078+0000", 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000215992 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930165+0000", 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7243000000000005e-05 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121271 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1906688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280414691000001, 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038405050000000003, 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121271 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904416+0000", 2024-09-18T05:15:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0160000000000003e-06 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904423+0000", 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9890000000000003e-06 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904428+0000", 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6890000000000003e-06 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942670+0000", 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038242653000000001 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942752+0000", 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2140999999999998e-05 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942814+0000", 2024-09-18T05:15:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2101999999999996e-05 2024-09-18T05:15:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121272 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1918976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.28038712, 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038493807999999997, 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121272 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904439+0000", 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3870000000000002e-06 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904445+0000", 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0240000000000003e-06 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904450+0000", 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9400000000000001e-06 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942846+0000", 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038395692000000002 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942889+0000", 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3659000000000003e-05 2024-09-18T05:15:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942931+0000", 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1470000000000001e-05 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121273 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1931264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280369771, 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038620175, 2024-09-18T05:15:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121273 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904456+0000", 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3360000000000002e-06 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904462+0000", 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7289999999999997e-06 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904472+0000", 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0020999999999999e-05 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942960+0000", 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038488306999999999 2024-09-18T05:15:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943002+0000", 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2089999999999999e-05 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943075+0000", 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2092e-05 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121274 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1943552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280339331, 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818021000000001, 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121274 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.225 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904484+0000", 2024-09-18T05:15:50.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904487+0000", 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904494+0000", 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0940000000000002e-06 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904499+0000", 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.933e-06 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943121+0000", 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038622507 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943208+0000", 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6397999999999995e-05 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943303+0000", 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4895000000000005e-05 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121275 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1955840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280321041000001, 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039005943000000001, 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121275 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:50.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904505+0000", 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904511+0000", 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0190000000000003e-06 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904516+0000", 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9200000000000003e-06 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943351+0000", 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038834425999999998 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943430+0000", 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9505000000000005e-05 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943509+0000", 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.234 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121276 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1968128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.234 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:50.234 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280303645, 2024-09-18T05:15:50.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039192704000000002, 2024-09-18T05:15:50.234 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121276 2024-09-18T05:15:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904523+0000", 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5179999999999999e-06 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904529+0000", 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4860000000000002e-06 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904533+0000", 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2390000000000004e-06 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943554+0000", 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039020332999999997 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943634+0000", 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0673000000000005e-05 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943713+0000", 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8858999999999998e-05 2024-09-18T05:15:50.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121277 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1980416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280286321999998, 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039321828000000003, 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.240 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121277 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904537+0000", 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904544+0000", 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8990000000000004e-06 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904551+0000", 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3940000000000001e-06 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904556+0000", 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1200000000000001e-06 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943770+0000", 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039214514999999998 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943816+0000", 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5371999999999999e-05 2024-09-18T05:15:50.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943860+0000", 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3875999999999998e-05 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121278 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1992704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280263697999999, 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039412773999999998, 2024-09-18T05:15:50.244 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121278 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904563+0000", 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5000000000000002e-06 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904569+0000", 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.224e-06 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904574+0000", 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8659999999999997e-06 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943890+0000", 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039316027000000003 2024-09-18T05:15:50.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943931+0000", 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1137000000000003e-05 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943973+0000", 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2416999999999997e-05 2024-09-18T05:15:50.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.249 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.249 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121279 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2004992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280246223999999, 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039512600000000002, 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121279 2024-09-18T05:15:50.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904580+0000", 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3640000000000002e-06 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904587+0000", 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6719999999999998e-06 2024-09-18T05:15:50.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904591+0000", 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5549999999999996e-06 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944001+0000", 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039410387999999998 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944046+0000", 2024-09-18T05:15:50.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4626000000000003e-05 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944090+0000", 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4351000000000003e-05 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121280 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2017280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280228356999999, 2024-09-18T05:15:50.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039608457999999999, 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121280 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904595+0000", 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904598+0000", 2024-09-18T05:15:50.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4549999999999998e-06 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904604+0000", 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904609+0000", 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7949999999999998e-06 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944120+0000", 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039511211999999997 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944161+0000", 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0766000000000002e-05 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944204+0000", 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3234e-05 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121281 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2029568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280210683, 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039699867999999999, 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121281 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.259 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:50.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904615+0000", 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.305e-06 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904622+0000", 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4320000000000004e-06 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904627+0000", 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.729e-06 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944231+0000", 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039604749000000002 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944270+0000", 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8531000000000001e-05 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944313+0000", 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3479000000000002e-05 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121282 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2041856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280171816999999, 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039764847999999998, 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.263 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121282 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:50.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904655+0000", 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8219999999999998e-06 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904661+0000", 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8539999999999999e-06 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904677+0000", 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5488000000000001e-05 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944340+0000", 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039663588999999999 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944380+0000", 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9548999999999997e-05 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944417+0000", 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7138000000000003e-05 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121283 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2054144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.267 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280142149, 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039840091000000001, 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121283 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904689+0000", 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7190000000000001e-06 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904696+0000", 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6529999999999997e-06 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904701+0000", 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.101e-06 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944443+0000", 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039741601000000001 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944483+0000", 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0138000000000001e-05 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944522+0000", 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9289000000000003e-05 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.271 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121284 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2066432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280119013, 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039925616999999997, 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.272 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121284 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904707+0000", 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.616e-06 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904714+0000", 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.161e-06 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904718+0000", 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8389999999999997e-06 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944553+0000", 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039834596 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944591+0000", 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-18T05:15:50.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944631+0000", 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9526000000000001e-05 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121285 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2078720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.28010085, 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040039444, 2024-09-18T05:15:50.276 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121285 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904726+0000", 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6630000000000002e-06 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904732+0000", 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6069999999999996e-06 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904737+0000", 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9609999999999996e-06 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944658+0000", 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039920421999999997 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944696+0000", 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8395000000000001e-05 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944763+0000", 2024-09-18T05:15:50.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6761999999999995e-05 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121286 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2091008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.280081868, 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040212352999999999, 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:50.281 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121286 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:50.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904744+0000", 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904751+0000", 2024-09-18T05:15:50.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7689999999999999e-06 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904756+0000", 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5959999999999997e-06 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944796+0000", 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040040048000000002 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:50.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944883+0000", 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7268999999999994e-05 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944955+0000", 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1505000000000001e-05 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:50.285 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:50.287 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:50.283+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:50.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:50.388 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:50.387+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:50.418 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:50.418 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:50.418 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:50.418 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:50.433 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:50.489 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:50.487+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:50.557 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:50.557 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:50.557 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:50.557 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:50.557 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:50.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:50.590 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:50.587+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:50.691 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:50.687+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:50.699 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:50.699 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:50.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:50.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:50.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.700 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55853 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8142848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.700 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:50.700 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056776654000004, 2024-09-18T05:15:50.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052962084999999999, 2024-09-18T05:15:50.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.700 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55853 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636950+0000", 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636957+0000", 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:50.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636994+0000", 2024-09-18T05:15:50.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6879999999999999e-05 2024-09-18T05:15:50.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637005+0000", 2024-09-18T05:15:50.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1430000000000001e-05 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689750+0000", 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052744345999999998 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689837+0000", 2024-09-18T05:15:50.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7581000000000001e-05 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689913+0000", 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5797999999999995e-05 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55854 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8159232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056712309000005, 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053068918, 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55854 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.706 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637014+0000", 2024-09-18T05:15:50.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:50.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637020+0000", 2024-09-18T05:15:50.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5149999999999997e-06 2024-09-18T05:15:50.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637034+0000", 2024-09-18T05:15:50.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4696e-05 2024-09-18T05:15:50.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637045+0000", 2024-09-18T05:15:50.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0334e-05 2024-09-18T05:15:50.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689962+0000", 2024-09-18T05:15:50.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052916773 2024-09-18T05:15:50.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690024+0000", 2024-09-18T05:15:50.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2009999999999998e-05 2024-09-18T05:15:50.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690084+0000", 2024-09-18T05:15:50.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0485000000000001e-05 2024-09-18T05:15:50.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.713 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.713 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55855 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.714 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:50.714 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056671743999999, 2024-09-18T05:15:50.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053239090000000003, 2024-09-18T05:15:50.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55855 2024-09-18T05:15:50.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.715 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:50.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:50.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637055+0000", 2024-09-18T05:15:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637060+0000", 2024-09-18T05:15:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9139999999999999e-06 2024-09-18T05:15:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637080+0000", 2024-09-18T05:15:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9873000000000001e-05 2024-09-18T05:15:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637091+0000", 2024-09-18T05:15:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0852999999999999e-05 2024-09-18T05:15:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690124+0000", 2024-09-18T05:15:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053033736999999997 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690217+0000", 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2263999999999996e-05 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690295+0000", 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8193000000000002e-05 2024-09-18T05:15:50.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55856 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056626575999999, 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053363617000000002, 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55856 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637100+0000", 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637106+0000", 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637120+0000", 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4885999999999999e-05 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637131+0000", 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.064e-05 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690344+0000", 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053212832000000002 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690404+0000", 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0516999999999997e-05 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690465+0000", 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0132e-05 2024-09-18T05:15:50.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55857 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056586808000006, 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053529896, 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55857 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637140+0000", 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637145+0000", 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637158+0000", 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3465999999999999e-05 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637168+0000", 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4919999999999999e-06 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690506+0000", 2024-09-18T05:15:50.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053337801999999997 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690595+0000", 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8925000000000007e-05 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690671+0000", 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5983999999999996e-05 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.731 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55858 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8224768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056549493000006, 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053665767000000003, 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.732 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55858 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637177+0000", 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637182+0000", 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.028e-06 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637197+0000", 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4341999999999999e-05 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637207+0000", 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0345e-05 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690719+0000", 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053511982 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690783+0000", 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3683999999999995e-05 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690844+0000", 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1116000000000002e-05 2024-09-18T05:15:50.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55859 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8241152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056511352000001, 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053835149999999998, 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55859 2024-09-18T05:15:50.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.738 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:50.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637215+0000", 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:50.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637221+0000", 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4879999999999998e-06 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637239+0000", 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7665000000000001e-05 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637252+0000", 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3735e-05 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690887+0000", 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053635163 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690977+0000", 2024-09-18T05:15:50.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9452999999999999e-05 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691051+0000", 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4374000000000003e-05 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55860 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:50.742 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056439936999993, 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053934739000000002, 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55860 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:50.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637287+0000", 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637293+0000", 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637309+0000", 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6214000000000001e-05 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637322+0000", 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2413e-05 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691101+0000", 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053779456000000003 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691164+0000", 2024-09-18T05:15:50.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2199000000000005e-05 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691222+0000", 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8758999999999998e-05 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55861 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8273920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056397478999997, 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054100101999999997, 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55861 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.748 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:50.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637329+0000", 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637333+0000", 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2619999999999999e-06 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637340+0000", 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5279999999999998e-06 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637347+0000", 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691264+0000", 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916886999999997 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691353+0000", 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9560000000000003e-05 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691430+0000", 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6715e-05 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55862 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8290304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056362534000002, 2024-09-18T05:15:50.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054235677000000003, 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55862 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:50.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:50.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637364+0000", 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637368+0000", 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637378+0000", 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0545e-05 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637384+0000", 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.592e-06 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691479+0000", 2024-09-18T05:15:50.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054095022 2024-09-18T05:15:50.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691540+0000", 2024-09-18T05:15:50.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0958999999999997e-05 2024-09-18T05:15:50.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691601+0000", 2024-09-18T05:15:50.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0976e-05 2024-09-18T05:15:50.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.759 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55863 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8306688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.056338586999999, 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054421542000000003, 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55863 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637388+0000", 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637391+0000", 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637398+0000", 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8249999999999999e-06 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637403+0000", 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3879999999999999e-06 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691642+0000", 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054238572999999998 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691732+0000", 2024-09-18T05:15:50.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0413000000000003e-05 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691810+0000", 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8079999999999998e-05 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55864 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:50.764 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.055652381000002, 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053905402999999998, 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55864 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637413+0000", 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9993382 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638082+0000", 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066932099999999996 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638103+0000", 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638115+0000", 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2935000000000001e-05 2024-09-18T05:15:50.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691859+0000", 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053743055999999997 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691920+0000", 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1087999999999995e-05 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691980+0000", 2024-09-18T05:15:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0853999999999997e-05 2024-09-18T05:15:50.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.769 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.769 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55865 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8339456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.055599912999995, 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054056874999999997, 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55865 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638127+0000", 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638133+0000", 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7869999999999998e-06 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638146+0000", 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3030000000000001e-05 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638156+0000", 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0523000000000001e-05 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692022+0000", 2024-09-18T05:15:50.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053866149000000002 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692109+0000", 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6428000000000007e-05 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692184+0000", 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5760999999999995e-05 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55936 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7413760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.053068245000006, 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052856933000000002, 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55936 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640661+0000", 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3479999999999998e-06 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640672+0000", 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0424999999999999e-05 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640677+0000", 2024-09-18T05:15:50.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693392+0000", 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052714446999999998 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693456+0000", 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4426999999999998e-05 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693516+0000", 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0154e-05 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55937 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7430144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.053045664999999, 2024-09-18T05:15:50.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053045085999999998, 2024-09-18T05:15:50.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55937 2024-09-18T05:15:50.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.781 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:50.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640681+0000", 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640685+0000", 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0799999999999999e-06 2024-09-18T05:15:50.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640700+0000", 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4768e-05 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640707+0000", 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.81e-06 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693559+0000", 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052852022999999998 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693648+0000", 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8908999999999999e-05 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693727+0000", 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9123999999999997e-05 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55938 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7446528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:50.785 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.053015610000003, 2024-09-18T05:15:50.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053184652999999998, 2024-09-18T05:15:50.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55938 2024-09-18T05:15:50.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.787 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:50.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:50.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640711+0000", 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640714+0000", 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0070000000000002e-06 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640721+0000", 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640728+0000", 2024-09-18T05:15:50.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6479999999999997e-06 2024-09-18T05:15:50.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693775+0000", 2024-09-18T05:15:50.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047086 2024-09-18T05:15:50.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693836+0000", 2024-09-18T05:15:50.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1513999999999994e-05 2024-09-18T05:15:50.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693897+0000", 2024-09-18T05:15:50.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0315000000000001e-05 2024-09-18T05:15:50.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.792 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.793 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55939 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7462912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.793 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:50.793 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.052991911999996, 2024-09-18T05:15:50.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369857999999999, 2024-09-18T05:15:50.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.794 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55939 2024-09-18T05:15:50.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.794 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:50.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640735+0000", 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640739+0000", 2024-09-18T05:15:50.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-06 2024-09-18T05:15:50.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640750+0000", 2024-09-18T05:15:50.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0668e-05 2024-09-18T05:15:50.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640755+0000", 2024-09-18T05:15:50.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4299999999999997e-06 2024-09-18T05:15:50.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693938+0000", 2024-09-18T05:15:50.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053182462 2024-09-18T05:15:50.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694028+0000", 2024-09-18T05:15:50.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0781999999999999e-05 2024-09-18T05:15:50.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694105+0000", 2024-09-18T05:15:50.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049e-05 2024-09-18T05:15:50.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.799 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.799 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55940 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7479296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.052967662, 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053517447000000003, 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55940 2024-09-18T05:15:50.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640759+0000", 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640769+0000", 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4730000000000006e-06 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640779+0000", 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9899999999999992e-06 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640784+0000", 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694154+0000", 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369648999999998 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694217+0000", 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2540999999999996e-05 2024-09-18T05:15:50.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694277+0000", 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0671999999999998e-05 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77660 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2347008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.587967714000001, 2024-09-18T05:15:50.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052901814999999998, 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77660 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105759+0000", 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105764+0000", 2024-09-18T05:15:50.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.403e-06 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105776+0000", 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2371000000000001e-05 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105785+0000", 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3670000000000003e-06 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158517+0000", 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052731497000000002 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158584+0000", 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7282999999999999e-05 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158662+0000", 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7488000000000001e-05 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77702 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2109440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.587934437000001, 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047159000000003, 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77702 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:50.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105792+0000", 2024-09-18T05:15:50.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:50.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:50.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105797+0000", 2024-09-18T05:15:50.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1779999999999996e-06 2024-09-18T05:15:50.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:50.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105809+0000", 2024-09-18T05:15:50.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2295e-05 2024-09-18T05:15:50.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105818+0000", 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4040000000000001e-06 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158692+0000", 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052873766000000003 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:50.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158760+0000", 2024-09-18T05:15:50.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8422000000000003e-05 2024-09-18T05:15:50.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:50.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:50.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:50.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158840+0000", 2024-09-18T05:15:50.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9769000000000001e-05 2024-09-18T05:15:50.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:50.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:50.815 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:50.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:50.817 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:50.815+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:50.918 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:50.914+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:50.949 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:50.949 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:50.949 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:50.949 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:50.965 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:50.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:51.019 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:51.015+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:51.120 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:51.119+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:51.133 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:51.133 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:51.133 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:51.133 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:51.133 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:51.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:51.159 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:51.159 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:51.167 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:15:51.185 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:51.186 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:51.186 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:51.206 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:51.206 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:51.221 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:51.219+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:51.227 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:51.227 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:51.249 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:51.249 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:51.273 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:51.273 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:51.287 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:51.287 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:51.307 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:51.308 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:51.308 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:51.312 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:51.313 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:51.358 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:51.354+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:51.422 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:51.419+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:51.440 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:51.440 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:51.453 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:51.542 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:51.538+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:51.624 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:51.618+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:51.625 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:51.625 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:51.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:51.726 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:51.723+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:51.810 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:51.811 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:51.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:51.827 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:51.822+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:51.928 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:51.922+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:51.958 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:51.958 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:51.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:52.029 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:52.027+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:52.090 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:52.090 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:52.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:52.148 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:52.147+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:52.230 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:52.227+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:52.275 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:52.275 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:52.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:52.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:52.326+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:52.432 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:52.426+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:52.462 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:52.462 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:52.476 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:52.533 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:52.526+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:52.599 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:52.599 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:52.613 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:52.633 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:52.626+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:52.734 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:52.730+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:52.737 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:52.737 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:52.751 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:52.835 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:52.831+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:52.873 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:52.874 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:52.889 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:52.976 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:52.975+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:53.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:53.034+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:53.055 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:53.055 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:53.069 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:53.139 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:53.134+0000 7fe5b77b57c0 -1 osd.2 100 log_to_monitors true 2024-09-18T05:15:53.160 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:53.159+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:53.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:15:53.206 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:53.202+0000 7fe5ab58d640 -1 osd.2 122 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T05:15:53.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:53.234+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:53.252 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:53.252 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:53.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:53.313 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:53.356 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:53.355+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:53.438 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:53.438 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:53.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:53.434+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:53.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:53.460 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:53.460 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:53.478 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:53.479 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:53.479 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-18T05:15:53.496 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:53.513 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:53.513 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:53.531 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:53.531 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:53.543 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:53.539+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:53.549 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:53.549 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:53.568 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:53.569 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:53.572 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T05:15:53.573 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T05:15:53.621 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:53.621 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:53.621 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:53.621 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:53.621 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:53.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:53.643 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:53.638+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:53.745 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:53.743+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:53.802 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:53.802 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:15:53.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:15:53.802 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:15:53.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.802 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:102332 3.10 3:0b2ae2d1:::rbd_data.118b62cc3496.000000000000001a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.671082323, 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.065837997999999995, 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102332 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126923+0000", 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126935+0000", 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1970000000000001e-05 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126960+0000", 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4888999999999998e-05 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126980+0000", 2024-09-18T05:15:53.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0642999999999999e-05 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127082+0000", 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101118 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127332+0000", 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000250771 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:15:53.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.140319+0000", 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012987115 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192666+0000", 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052346629999999998 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192681+0000", 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4769e-05 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192726+0000", 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4925000000000001e-05 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192763+0000", 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7141000000000002e-05 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121156 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2064384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.808 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.906704479999998, 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038247947999999997, 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121156 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:53.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891302+0000", 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891314+0000", 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1557e-05 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891321+0000", 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7619999999999998e-06 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891325+0000", 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6600000000000003e-06 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929365+0000", 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038039942 2024-09-18T05:15:53.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929467+0000", 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101191 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929551+0000", 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4220000000000003e-05 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121157 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2076672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.906677340999998, 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038423377000000002, 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121157 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:53.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891332+0000", 2024-09-18T05:15:53.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891338+0000", 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9800000000000003e-06 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891342+0000", 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3470000000000001e-06 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929593+0000", 2024-09-18T05:15:53.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038250926999999997 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929674+0000", 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0976999999999994e-05 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929753+0000", 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8948000000000004e-05 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121158 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2088960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.906660720000001, 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818722, 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121158 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.817 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891346+0000", 2024-09-18T05:15:53.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891349+0000", 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5050000000000002e-06 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891355+0000", 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4370000000000004e-06 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891365+0000", 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7520000000000008e-06 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929862+0000", 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038497177 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930078+0000", 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000215992 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930165+0000", 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7243000000000005e-05 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121271 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1906688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893597880000002, 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038405050000000003, 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.821 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121271 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904416+0000", 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0160000000000003e-06 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904423+0000", 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9890000000000003e-06 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904428+0000", 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6890000000000003e-06 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942670+0000", 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038242653000000001 2024-09-18T05:15:53.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942752+0000", 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2140999999999998e-05 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942814+0000", 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2101999999999996e-05 2024-09-18T05:15:53.825 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121272 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1918976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893570309000001, 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038493807999999997, 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.826 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.828 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.828 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.828 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121272 2024-09-18T05:15:53.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.828 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:15:53.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904439+0000", 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3870000000000002e-06 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904445+0000", 2024-09-18T05:15:53.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0240000000000003e-06 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904450+0000", 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9400000000000001e-06 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942846+0000", 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038395692000000002 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942889+0000", 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3659000000000003e-05 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942931+0000", 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1470000000000001e-05 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121273 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1931264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893552960000001, 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038620175, 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.833 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121273 2024-09-18T05:15:53.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.834 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:53.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904456+0000", 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3360000000000002e-06 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904462+0000", 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7289999999999997e-06 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904472+0000", 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0020999999999999e-05 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942960+0000", 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038488306999999999 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943002+0000", 2024-09-18T05:15:53.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2089999999999999e-05 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943075+0000", 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2092e-05 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121274 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1943552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893522520000001, 2024-09-18T05:15:53.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818021000000001, 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121274 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904484+0000", 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904487+0000", 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904494+0000", 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0940000000000002e-06 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904499+0000", 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.933e-06 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943121+0000", 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038622507 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943208+0000", 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6397999999999995e-05 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943303+0000", 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4895000000000005e-05 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.842 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121275 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1955840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893504230000001, 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039005943000000001, 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121275 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.843 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:53.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:53.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904505+0000", 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-18T05:15:53.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904511+0000", 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0190000000000003e-06 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904516+0000", 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9200000000000003e-06 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943351+0000", 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038834425999999998 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943430+0000", 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9505000000000005e-05 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943509+0000", 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121276 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1968128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893486834000001, 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039192704000000002, 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121276 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904523+0000", 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5179999999999999e-06 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904529+0000", 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4860000000000002e-06 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904533+0000", 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2390000000000004e-06 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943554+0000", 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039020332999999997 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943634+0000", 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0673000000000005e-05 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943713+0000", 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8858999999999998e-05 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121277 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1980416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893469510999999, 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039321828000000003, 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121277 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904537+0000", 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904544+0000", 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8990000000000004e-06 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904551+0000", 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3940000000000001e-06 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904556+0000", 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1200000000000001e-06 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943770+0000", 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039214514999999998 2024-09-18T05:15:53.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943816+0000", 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5371999999999999e-05 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943860+0000", 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3875999999999998e-05 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121278 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1992704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893446887, 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039412773999999998, 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.857 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121278 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904563+0000", 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5000000000000002e-06 2024-09-18T05:15:53.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904569+0000", 2024-09-18T05:15:53.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.224e-06 2024-09-18T05:15:53.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904574+0000", 2024-09-18T05:15:53.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8659999999999997e-06 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943890+0000", 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039316027000000003 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943931+0000", 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1137000000000003e-05 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943973+0000", 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2416999999999997e-05 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121279 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2004992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893429413, 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039512600000000002, 2024-09-18T05:15:53.862 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121279 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904580+0000", 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3640000000000002e-06 2024-09-18T05:15:53.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904587+0000", 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6719999999999998e-06 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904591+0000", 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5549999999999996e-06 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944001+0000", 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039410387999999998 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944046+0000", 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4626000000000003e-05 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944090+0000", 2024-09-18T05:15:53.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4351000000000003e-05 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121280 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2017280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893411545999999, 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039608457999999999, 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.867 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121280 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904595+0000", 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904598+0000", 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4549999999999998e-06 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904604+0000", 2024-09-18T05:15:53.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:15:53.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904609+0000", 2024-09-18T05:15:53.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7949999999999998e-06 2024-09-18T05:15:53.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944120+0000", 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039511211999999997 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944161+0000", 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0766000000000002e-05 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944204+0000", 2024-09-18T05:15:53.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3234e-05 2024-09-18T05:15:53.872 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.872 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.872 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.872 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121281 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2029568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.872 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893393872000001, 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039699867999999999, 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121281 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:53.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904615+0000", 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.305e-06 2024-09-18T05:15:53.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904622+0000", 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4320000000000004e-06 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904627+0000", 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.729e-06 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944231+0000", 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039604749000000002 2024-09-18T05:15:53.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944270+0000", 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8531000000000001e-05 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944313+0000", 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3479000000000002e-05 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121282 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2041856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893355006, 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039764847999999998, 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121282 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.877 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904655+0000", 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8219999999999998e-06 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904661+0000", 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8539999999999999e-06 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904677+0000", 2024-09-18T05:15:53.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5488000000000001e-05 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944340+0000", 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039663588999999999 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944380+0000", 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9548999999999997e-05 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944417+0000", 2024-09-18T05:15:53.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7138000000000003e-05 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121283 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2054144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893325338, 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039840091000000001, 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121283 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904689+0000", 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7190000000000001e-06 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904696+0000", 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6529999999999997e-06 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904701+0000", 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.101e-06 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944443+0000", 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039741601000000001 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944483+0000", 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0138000000000001e-05 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944522+0000", 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9289000000000003e-05 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.885 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121284 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2066432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893302202000001, 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039925616999999997, 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121284 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904707+0000", 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.616e-06 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904714+0000", 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.161e-06 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904718+0000", 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8389999999999997e-06 2024-09-18T05:15:53.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944553+0000", 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039834596 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944591+0000", 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944631+0000", 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9526000000000001e-05 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121285 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2078720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893284039000001, 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040039444, 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.890 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121285 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904726+0000", 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6630000000000002e-06 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904732+0000", 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6069999999999996e-06 2024-09-18T05:15:53.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904737+0000", 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9609999999999996e-06 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944658+0000", 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039920421999999997 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944696+0000", 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8395000000000001e-05 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944763+0000", 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6761999999999995e-05 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121286 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2091008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.893265057000001, 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040212352999999999, 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121286 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.895 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:15:53.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904744+0000", 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904751+0000", 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7689999999999999e-06 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904756+0000", 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5959999999999997e-06 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944796+0000", 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040040048000000002 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944883+0000", 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7268999999999994e-05 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944955+0000", 2024-09-18T05:15:53.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1505000000000001e-05 2024-09-18T05:15:53.900 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.900 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.900 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.900 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:15:53.900 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:15:53.900 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:53.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:53.903 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:53.899+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:53.903 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:54.003 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:53.999+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:54.028 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:54.029 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:54.029 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:54.029 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:54.036 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:54.036 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:54.036 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:54.036 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:54.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-18T05:15:54.053 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:54.104 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:54.099+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:15:54.204 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:54.198+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:54.247 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:54.247 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:54.247 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:54.247 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:54.247 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:54.262 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:54.306 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:54.302+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:54.406 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:54.403+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55853 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8142848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788654878000003, 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052962084999999999, 2024-09-18T05:15:54.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55853 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636950+0000", 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636957+0000", 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636994+0000", 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6879999999999999e-05 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637005+0000", 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1430000000000001e-05 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689750+0000", 2024-09-18T05:15:54.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052744345999999998 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689837+0000", 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7581000000000001e-05 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689913+0000", 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5797999999999995e-05 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55854 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8159232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788590533000004, 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053068918, 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55854 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637014+0000", 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637020+0000", 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5149999999999997e-06 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637034+0000", 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4696e-05 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637045+0000", 2024-09-18T05:15:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0334e-05 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689962+0000", 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052916773 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690024+0000", 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2009999999999998e-05 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690084+0000", 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0485000000000001e-05 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55855 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788549967999998, 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053239090000000003, 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55855 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637055+0000", 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637060+0000", 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9139999999999999e-06 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637080+0000", 2024-09-18T05:15:54.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9873000000000001e-05 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637091+0000", 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0852999999999999e-05 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690124+0000", 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053033736999999997 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690217+0000", 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2263999999999996e-05 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690295+0000", 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8193000000000002e-05 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55856 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.442 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788504799999998, 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053363617000000002, 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55856 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637100+0000", 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637106+0000", 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637120+0000", 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4885999999999999e-05 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637131+0000", 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.064e-05 2024-09-18T05:15:54.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690344+0000", 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053212832000000002 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690404+0000", 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0516999999999997e-05 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690465+0000", 2024-09-18T05:15:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0132e-05 2024-09-18T05:15:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55857 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788465032000005, 2024-09-18T05:15:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053529896, 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55857 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637140+0000", 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637145+0000", 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637158+0000", 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3465999999999999e-05 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637168+0000", 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4919999999999999e-06 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690506+0000", 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053337801999999997 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690595+0000", 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8925000000000007e-05 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690671+0000", 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5983999999999996e-05 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.451 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55858 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8224768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788427717000005, 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053665767000000003, 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.452 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55858 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637177+0000", 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637182+0000", 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.028e-06 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637197+0000", 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4341999999999999e-05 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637207+0000", 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0345e-05 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690719+0000", 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053511982 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690783+0000", 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3683999999999995e-05 2024-09-18T05:15:54.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690844+0000", 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1116000000000002e-05 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55859 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8241152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788389576, 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053835149999999998, 2024-09-18T05:15:54.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55859 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637215+0000", 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637221+0000", 2024-09-18T05:15:54.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4879999999999998e-06 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637239+0000", 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7665000000000001e-05 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637252+0000", 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3735e-05 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690887+0000", 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053635163 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690977+0000", 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9452999999999999e-05 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691051+0000", 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4374000000000003e-05 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55860 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788318161000007, 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053934739000000002, 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55860 2024-09-18T05:15:54.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637287+0000", 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637293+0000", 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637309+0000", 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6214000000000001e-05 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637322+0000", 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2413e-05 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691101+0000", 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053779456000000003 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691164+0000", 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2199000000000005e-05 2024-09-18T05:15:54.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691222+0000", 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8758999999999998e-05 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55861 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8273920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788275702999996, 2024-09-18T05:15:54.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054100101999999997, 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55861 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637329+0000", 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637333+0000", 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2619999999999999e-06 2024-09-18T05:15:54.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637340+0000", 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5279999999999998e-06 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637347+0000", 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691264+0000", 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916886999999997 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691353+0000", 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9560000000000003e-05 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691430+0000", 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6715e-05 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55862 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8290304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788240758000001, 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054235677000000003, 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55862 2024-09-18T05:15:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637364+0000", 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637368+0000", 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637378+0000", 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0545e-05 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637384+0000", 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.592e-06 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691479+0000", 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054095022 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691540+0000", 2024-09-18T05:15:54.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0958999999999997e-05 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691601+0000", 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0976e-05 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55863 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8306688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:54.474 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.788216810999998, 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054421542000000003, 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55863 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637388+0000", 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637391+0000", 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637398+0000", 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8249999999999999e-06 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637403+0000", 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3879999999999999e-06 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691642+0000", 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054238572999999998 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691732+0000", 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0413000000000003e-05 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691810+0000", 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8079999999999998e-05 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.478 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55864 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.787530605000001, 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053905402999999998, 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55864 2024-09-18T05:15:54.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637413+0000", 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9993382 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638082+0000", 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066932099999999996 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638103+0000", 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638115+0000", 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2935000000000001e-05 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691859+0000", 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053743055999999997 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691920+0000", 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1087999999999995e-05 2024-09-18T05:15:54.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691980+0000", 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0853999999999997e-05 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55865 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8339456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.787478136999994, 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054056874999999997, 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55865 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638127+0000", 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638133+0000", 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7869999999999998e-06 2024-09-18T05:15:54.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638146+0000", 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3030000000000001e-05 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638156+0000", 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0523000000000001e-05 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692022+0000", 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053866149000000002 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692109+0000", 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6428000000000007e-05 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692184+0000", 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5760999999999995e-05 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55936 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7413760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.784946469000005, 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052856933000000002, 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55936 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:54.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640661+0000", 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3479999999999998e-06 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640672+0000", 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0424999999999999e-05 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640677+0000", 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693392+0000", 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052714446999999998 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693456+0000", 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4426999999999998e-05 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693516+0000", 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0154e-05 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55937 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7430144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.784923888999998, 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053045085999999998, 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55937 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640681+0000", 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640685+0000", 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0799999999999999e-06 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640700+0000", 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4768e-05 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640707+0000", 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.81e-06 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693559+0000", 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052852022999999998 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693648+0000", 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8908999999999999e-05 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693727+0000", 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9123999999999997e-05 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.496 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55938 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7446528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.784893834000002, 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053184652999999998, 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55938 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640711+0000", 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640714+0000", 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0070000000000002e-06 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640721+0000", 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640728+0000", 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6479999999999997e-06 2024-09-18T05:15:54.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693775+0000", 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047086 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693836+0000", 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1513999999999994e-05 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693897+0000", 2024-09-18T05:15:54.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0315000000000001e-05 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55939 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7462912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.784870135999995, 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369857999999999, 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.501 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55939 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640735+0000", 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640739+0000", 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-06 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640750+0000", 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0668e-05 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640755+0000", 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4299999999999997e-06 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693938+0000", 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053182462 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694028+0000", 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0781999999999999e-05 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694105+0000", 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049e-05 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.505 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55940 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7479296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.784845885999999, 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053517447000000003, 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55940 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640759+0000", 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640769+0000", 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4730000000000006e-06 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640779+0000", 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9899999999999992e-06 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640784+0000", 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:15:54.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694154+0000", 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369648999999998 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694217+0000", 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2540999999999996e-05 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694277+0000", 2024-09-18T05:15:54.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0671999999999998e-05 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77660 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2347008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.319845938, 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052901814999999998, 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.510 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77660 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105759+0000", 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105764+0000", 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.403e-06 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105776+0000", 2024-09-18T05:15:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2371000000000001e-05 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105785+0000", 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3670000000000003e-06 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158517+0000", 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052731497000000002 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158584+0000", 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7282999999999999e-05 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158662+0000", 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7488000000000001e-05 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77702 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2109440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.319812661, 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047159000000003, 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77702 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105792+0000", 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105797+0000", 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1779999999999996e-06 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105809+0000", 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2295e-05 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105818+0000", 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4040000000000001e-06 2024-09-18T05:15:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158692+0000", 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052873766000000003 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158760+0000", 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8422000000000003e-05 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158840+0000", 2024-09-18T05:15:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9769000000000001e-05 2024-09-18T05:15:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:54.519 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:54.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:54.521 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:54.514+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:54.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:54.614+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:54.692 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:54.706 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:54.722 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:54.719+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:54.822 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:54.819+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:54.878 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:54.878 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:54.878 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:54.878 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:54.879 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:54.894 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:54.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:54.934+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77168 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2203648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.932115400000001, 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049653801999999997, 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77168 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087448+0000", 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087454+0000", 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2539999999999998e-06 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087471+0000", 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6912999999999999e-05 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087484+0000", 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.131161+0000", 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.043676751999999999 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.134176+0000", 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030155300000000002 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137103+0000", 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029268459999999999 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.030 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77182 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2289664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.030 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:55.030 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.931260850999998, 2024-09-18T05:15:55.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048114297, 2024-09-18T05:15:55.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77182 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088303+0000", 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088309+0000", 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5969999999999997e-06 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088330+0000", 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1339999999999999e-05 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088365+0000", 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5036000000000001e-05 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136187+0000", 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047821474000000003 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136288+0000", 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010091599999999999 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136418+0000", 2024-09-18T05:15:55.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013007700000000001 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77183 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2330624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.931186951000001, 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048282688999999997, 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77183 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088377+0000", 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088383+0000", 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9029999999999998e-06 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088404+0000", 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996999999999999e-05 2024-09-18T05:15:55.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088420+0000", 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5353e-05 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136450+0000", 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048030394999999997 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136554+0000", 2024-09-18T05:15:55.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103442 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136660+0000", 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010664500000000001 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77188 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2129920~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.930785960999998, 2024-09-18T05:15:55.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048117532999999997, 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77188 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:55.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088778+0000", 2024-09-18T05:15:55.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088784+0000", 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8000000000000001e-06 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088802+0000", 2024-09-18T05:15:55.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:15:55.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088835+0000", 2024-09-18T05:15:55.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2846999999999999e-05 2024-09-18T05:15:55.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136693+0000", 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047858165000000001 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136783+0000", 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9862000000000001e-05 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136896+0000", 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112792 2024-09-18T05:15:55.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77190 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2170880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.930621236999997, 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048251255, 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.046 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77190 2024-09-18T05:15:55.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.046 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:55.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:55.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088942+0000", 2024-09-18T05:15:55.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:55.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088973+0000", 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0737000000000001e-05 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088996+0000", 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3013000000000001e-05 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089023+0000", 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7183e-05 2024-09-18T05:15:55.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136930+0000", 2024-09-18T05:15:55.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047907155 2024-09-18T05:15:55.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137033+0000", 2024-09-18T05:15:55.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103205 2024-09-18T05:15:55.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137195+0000", 2024-09-18T05:15:55.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016126899999999999 2024-09-18T05:15:55.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.054 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.055 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77192 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2211840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.055 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:55.055 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.930473571, 2024-09-18T05:15:55.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048391998999999998, 2024-09-18T05:15:55.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.055 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77192 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:55.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089090+0000", 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089096+0000", 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089113+0000", 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6379999999999999e-05 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089130+0000", 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7730000000000001e-05 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137239+0000", 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048108962999999998 2024-09-18T05:15:55.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137342+0000", 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010229399999999999 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137483+0000", 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141235 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77193 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2252800~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.930422106999998, 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048619480999999999, 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77193 2024-09-18T05:15:55.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.063 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:55.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089141+0000", 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089158+0000", 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6362999999999999e-05 2024-09-18T05:15:55.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089178+0000", 2024-09-18T05:15:55.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0469999999999999e-05 2024-09-18T05:15:55.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089192+0000", 2024-09-18T05:15:55.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4204e-05 2024-09-18T05:15:55.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137535+0000", 2024-09-18T05:15:55.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048342382000000003 2024-09-18T05:15:55.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137639+0000", 2024-09-18T05:15:55.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104042 2024-09-18T05:15:55.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137762+0000", 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012304699999999999 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77194 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2293760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:55.070 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.930358331000001, 2024-09-18T05:15:55.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048842564999999998, 2024-09-18T05:15:55.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77194 2024-09-18T05:15:55.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.071 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089205+0000", 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089212+0000", 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5100000000000004e-06 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089229+0000", 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7263000000000001e-05 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089242+0000", 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3027000000000001e-05 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137800+0000", 2024-09-18T05:15:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048558220999999999 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137928+0000", 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128183 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138049+0000", 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120387 2024-09-18T05:15:55.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77195 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2334720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.930311091, 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049100602, 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77195 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089252+0000", 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089258+0000", 2024-09-18T05:15:55.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089276+0000", 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.719e-05 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089291+0000", 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5347000000000001e-05 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138091+0000", 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048800518000000001 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138223+0000", 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131889 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138354+0000", 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013071099999999999 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77202 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2134016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.929885208000002, 2024-09-18T05:15:55.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048921765999999998, 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77202 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089677+0000", 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:55.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089695+0000", 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.804e-05 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089735+0000", 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0080000000000003e-05 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089748+0000", 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2493e-05 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138392+0000", 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048644219000000002 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138489+0000", 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6836999999999995e-05 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138601+0000", 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112494 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77203 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2174976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.929807967999999, 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049108851000000002, 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77203 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:55.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089756+0000", 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089761+0000", 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1000000000000003e-06 2024-09-18T05:15:55.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089770+0000", 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999999e-06 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089777+0000", 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138641+0000", 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048863453000000001 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138737+0000", 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5828000000000005e-05 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138865+0000", 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128804 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77204 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2215936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.929781245000001, 2024-09-18T05:15:55.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049349094000000003, 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77204 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:55.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089786+0000", 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4529999999999998e-06 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089795+0000", 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4130000000000006e-06 2024-09-18T05:15:55.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089801+0000", 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8600000000000004e-06 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138903+0000", 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049101643 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139001+0000", 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7707000000000005e-05 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139132+0000", 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013160099999999999 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77205 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2256896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.929757355, 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049589756999999998, 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77205 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.098 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089825+0000", 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8340000000000001e-05 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089842+0000", 2024-09-18T05:15:55.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6606999999999999e-05 2024-09-18T05:15:55.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089854+0000", 2024-09-18T05:15:55.101 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:55.018+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:55.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.292e-05 2024-09-18T05:15:55.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139170+0000", 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049315335000000002 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139269+0000", 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9339000000000006e-05 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139397+0000", 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127806 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77206 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2297856~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.929697851999997, 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049792218999999999, 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77206 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089866+0000", 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089872+0000", 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9599999999999997e-06 2024-09-18T05:15:55.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089888+0000", 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-05 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089920+0000", 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890000000000001e-05 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139435+0000", 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049514916999999999 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139530+0000", 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4847999999999997e-05 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139659+0000", 2024-09-18T05:15:55.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012879999999999999 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77207 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2338816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.929625852000001, 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04998259, 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.109 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77207 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089937+0000", 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089944+0000", 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089963+0000", 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8623000000000001e-05 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089976+0000", 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3203999999999999e-05 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139698+0000", 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049722211000000002 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139796+0000", 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7200000000000004e-05 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139921+0000", 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012560499999999999 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104467 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.752273152000001, 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63367687500000003, 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104467 2024-09-18T05:15:55.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267289+0000", 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267300+0000", 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0382e-05 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267326+0000", 2024-09-18T05:15:55.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5850000000000002e-05 2024-09-18T05:15:55.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267339+0000", 2024-09-18T05:15:55.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3754000000000001e-05 2024-09-18T05:15:55.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267425+0000", 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5544999999999995e-05 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267444+0000", 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8947999999999999e-05 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900405+0000", 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63296088699999997 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900624+0000", 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219466 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900968+0000", 2024-09-18T05:15:55.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034406500000000001 2024-09-18T05:15:55.120 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.120 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.120 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.120 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104468 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:55.120 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:55.120 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.752180973999998, 2024-09-18T05:15:55.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63418863999999997, 2024-09-18T05:15:55.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.121 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.121 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.121 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.121 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104468 2024-09-18T05:15:55.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267382+0000", 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267390+0000", 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.028e-06 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267406+0000", 2024-09-18T05:15:55.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5446000000000001e-05 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267419+0000", 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3514e-05 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8612e-05 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267503+0000", 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4714e-05 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901334+0000", 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.633831747 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901437+0000", 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010287499999999999 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901572+0000", 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013484799999999999 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104469 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 2359296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.752134454, 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63443118099999996, 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104469 2024-09-18T05:15:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267429+0000", 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267435+0000", 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2100000000000001e-06 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267447+0000", 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2532e-05 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267457+0000", 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0010000000000001e-05 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267545+0000", 2024-09-18T05:15:55.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7627999999999995e-05 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267559+0000", 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3963e-05 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901627+0000", 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63406880399999999 2024-09-18T05:15:55.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901723+0000", 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5629000000000002e-05 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901861+0000", 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013816499999999999 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.132 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104470 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 3211264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.752076129999999, 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.634540459, 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.133 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104470 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267493+0000", 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5280000000000003e-06 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267509+0000", 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5517999999999999e-05 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267518+0000", 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7030000000000001e-06 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267607+0000", 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9202000000000004e-05 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267620+0000", 2024-09-18T05:15:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2612999999999999e-05 2024-09-18T05:15:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901913+0000", 2024-09-18T05:15:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63429272599999997 2024-09-18T05:15:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901965+0000", 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2391e-05 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902029+0000", 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3626000000000004e-05 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104471 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.752025191000001, 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63472597500000005, 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104471 2024-09-18T05:15:55.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:55.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267544+0000", 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2379999999999997e-06 2024-09-18T05:15:55.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267557+0000", 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3020000000000001e-05 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267566+0000", 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.38e-06 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267658+0000", 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1852000000000001e-05 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267670+0000", 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.224e-05 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902059+0000", 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63438875900000002 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902124+0000", 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5374000000000001e-05 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902265+0000", 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140922 2024-09-18T05:15:55.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.146 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.146 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.146 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:55.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:55.148 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:55.142+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2024-09-18T05:15:55.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-18T05:15:55.248 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:55.247+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:55.317 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:55.317 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:55.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:129708 3.c 3:327a4b30:::rbd_object_map.118bc9d4fe24:head [call lock.lock in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-18T05:15:55.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:55.313246+0000", 2024-09-18T05:15:55.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.001619344, 2024-09-18T05:15:55.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016458429999999999, 2024-09-18T05:15:55.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "waiting for sub ops", 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 129708 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.313246+0000", 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.313246+0000", 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.313245+0000", 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.313253+0000", 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6760000000000007e-06 2024-09-18T05:15:55.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.313265+0000", 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2286999999999999e-05 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.313271+0000", 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0460000000000002e-06 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.313332+0000", 2024-09-18T05:15:55.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0816999999999997e-05 2024-09-18T05:15:55.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.313435+0000", 2024-09-18T05:15:55.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010344900000000001 2024-09-18T05:15:55.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-18T05:15:55.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.313628+0000", 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000192819 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.314327+0000", 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069858599999999996 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 1 2024-09-18T05:15:55.322 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:55.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:55.350 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:55.347+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:55.451 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:55.446+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:55.461 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:55.461 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:55.461 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:55.461 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:55.461 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:55.476 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:55.562 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:55.558+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:55.573 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.72432281099999, 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:55.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.72429186799999, 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:15:55.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:15:55.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.724266304, 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:15:55.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.724241588, 2024-09-18T05:15:55.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:55.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:15:55.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:15:55.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:15:55.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:15:55.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:15:55.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.72421535399999, 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:15:55.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.724186445, 2024-09-18T05:15:55.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:55.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:55.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:15:55.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:55.667 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.724162615, 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:55.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:15:55.671 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.672 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.672 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.672 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:55.672 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.724138139, 2024-09-18T05:15:55.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:15:55.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.72402034, 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:15:55.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:15:55.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.721028385, 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.685 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.720950323, 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:55.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:15:55.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:15:55.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:15:55.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.720919036, 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.691 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:15:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:55.695 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.720893023, 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:15:55.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:15:55.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.72086525, 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:15:55.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:15:55.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:55.704 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.72084018699999, 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.720815157, 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:15:55.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:15:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.716690829, 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:15:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.716670284, 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:15:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:15:55.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:55.722 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 123.716650602, 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:55.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.448579155000004, 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:15:55.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:55.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:15:55.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:55.733 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:55.735 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:55.735 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:55.730+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:55.835 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:55.830+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:55.865 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:55.865 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:55.865 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:55.865 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:55.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:15:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:55.936 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:55.935+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:55.943 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:55.943 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-18T05:15:56.002 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:56.003 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:56.003 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:15:56.003 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:15:56.003 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:56.013 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:56.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:15:56.037 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:56.030+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:56.042 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:56.071 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:56.097 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:56.097 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:56.124 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:56.138 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:56.135+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:56.186 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:56.186 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:56.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:15:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2024-09-18T05:15:56.226 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:15:56.236 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-18T05:15:56.244 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:56.243+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:56.339 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:56.334+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:56.377 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:56.377 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:56.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:15:56.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:56.434+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:56.514 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:56.514 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:56.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:15:56.542 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:56.538+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:56.643 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:56.638+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:56.644 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:56.644 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:56.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:15:56.744 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:56.738+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:56.776 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:56.776 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:56.790 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:15:56.845 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:15:56.838+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:15:56.907 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:56.908 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:56.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:15:56.946 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:56.942+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:57.045 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:57.045 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:57.047 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:57.043+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:57.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:15:57.147 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:57.142+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2024-09-18T05:15:57.223 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:15:57.235 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:57.235 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:57.248 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:57.242+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:57.256 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:15:57.268 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-18T05:15:57.349 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:57.347+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:57.379 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:57.380 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:57.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:15:57.449 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:57.446+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:57.551 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:57.551 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:57.551 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:57.546+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:57.565 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:15:57.652 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:57.646+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:57.692 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:57.692 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:57.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:15:57.752 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:57.751+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:57.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:57.846+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:57.876 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:57.876 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:57.889 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:15:57.955 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:57.951+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:58.056 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:58.050+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:58.058 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:58.058 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:58.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:15:58.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:15:58.158 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:58.154+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:58.248 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.3 to 1 (10000) 2024-09-18T05:15:58.253 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:15:58.253 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:15:58.257 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:15:58.255+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:15:58.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:15:58.273 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-18T05:15:58.309 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:15:58.310 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:15:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:15:58.326 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:15:58.342 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:15:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:15:58.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:58.354+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:15:58.360 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:15:58.380 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:15:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:15:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:15:58.399 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:15:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:15:58.419 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:15:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:58.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:15:58.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:15:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:15:58.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:58.498+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:58.553 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:58.553 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:58.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:58.553 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:58.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.553 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55853 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8142848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912814178999994, 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052962084999999999, 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55853 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636951+0000", 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636950+0000", 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636957+0000", 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.636994+0000", 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6879999999999999e-05 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637005+0000", 2024-09-18T05:15:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1430000000000001e-05 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689750+0000", 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052744345999999998 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689837+0000", 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7581000000000001e-05 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689913+0000", 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5797999999999995e-05 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55854 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8159232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912749833999996, 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053068918, 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55854 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637015+0000", 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637014+0000", 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637020+0000", 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5149999999999997e-06 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637034+0000", 2024-09-18T05:15:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4696e-05 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637045+0000", 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0334e-05 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.689962+0000", 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052916773 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690024+0000", 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2009999999999998e-05 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690084+0000", 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0485000000000001e-05 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55855 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912709269000004, 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053239090000000003, 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55855 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637056+0000", 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637055+0000", 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637060+0000", 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9139999999999999e-06 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637080+0000", 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9873000000000001e-05 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637091+0000", 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0852999999999999e-05 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690124+0000", 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053033736999999997 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690217+0000", 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2263999999999996e-05 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690295+0000", 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8193000000000002e-05 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55856 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912664101000004, 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053363617000000002, 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55856 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637101+0000", 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637100+0000", 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637106+0000", 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.429e-06 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637120+0000", 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4885999999999999e-05 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637131+0000", 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.064e-05 2024-09-18T05:15:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690344+0000", 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053212832000000002 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690404+0000", 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0516999999999997e-05 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690465+0000", 2024-09-18T05:15:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0132e-05 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55857 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912624332999997, 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053529896, 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55857 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637141+0000", 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637140+0000", 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637145+0000", 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9339999999999997e-06 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637158+0000", 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3465999999999999e-05 2024-09-18T05:15:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637168+0000", 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4919999999999999e-06 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690506+0000", 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053337801999999997 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690595+0000", 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8925000000000007e-05 2024-09-18T05:15:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690671+0000", 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5983999999999996e-05 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55858 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8224768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912587017999996, 2024-09-18T05:15:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053665767000000003, 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55858 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637178+0000", 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637177+0000", 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637182+0000", 2024-09-18T05:15:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.028e-06 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637197+0000", 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4341999999999999e-05 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637207+0000", 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0345e-05 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690719+0000", 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053511982 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690783+0000", 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3683999999999995e-05 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690844+0000", 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1116000000000002e-05 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55859 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8241152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912548877000006, 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053835149999999998, 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55859 2024-09-18T05:15:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637216+0000", 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637215+0000", 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637221+0000", 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4879999999999998e-06 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637239+0000", 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7665000000000001e-05 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637252+0000", 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3735e-05 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690887+0000", 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053635163 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.690977+0000", 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9452999999999999e-05 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691051+0000", 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4374000000000003e-05 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55860 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912477461999998, 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053934739000000002, 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55860 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637288+0000", 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637287+0000", 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637293+0000", 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637309+0000", 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6214000000000001e-05 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637322+0000", 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2413e-05 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691101+0000", 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053779456000000003 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691164+0000", 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2199000000000005e-05 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691222+0000", 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8758999999999998e-05 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55861 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8273920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912435004000002, 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054100101999999997, 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55861 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637330+0000", 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637329+0000", 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637333+0000", 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2619999999999999e-06 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637340+0000", 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5279999999999998e-06 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637347+0000", 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6730000000000003e-06 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691264+0000", 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053916886999999997 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691353+0000", 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9560000000000003e-05 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691430+0000", 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6715e-05 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55862 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8290304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912400059000007, 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054235677000000003, 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55862 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637365+0000", 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637364+0000", 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637368+0000", 2024-09-18T05:15:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637378+0000", 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0545e-05 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637384+0000", 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.592e-06 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691479+0000", 2024-09-18T05:15:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054095022 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691540+0000", 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0958999999999997e-05 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691601+0000", 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0976e-05 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55863 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8306688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.912376112000004, 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054421542000000003, 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55863 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637389+0000", 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637388+0000", 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637391+0000", 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7429999999999998e-06 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637398+0000", 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8249999999999999e-06 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637403+0000", 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3879999999999999e-06 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691642+0000", 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054238572999999998 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691732+0000", 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0413000000000003e-05 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691810+0000", 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8079999999999998e-05 2024-09-18T05:15:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55864 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.911689906000007, 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053905402999999998, 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55864 2024-09-18T05:15:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638075+0000", 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.637413+0000", 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9993382 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638082+0000", 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066932099999999996 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638103+0000", 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0149999999999999e-05 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638115+0000", 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2935000000000001e-05 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691859+0000", 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053743055999999997 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691920+0000", 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1087999999999995e-05 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.691980+0000", 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0853999999999997e-05 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55865 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 8339456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.911637438, 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.054056874999999997, 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55865 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638128+0000", 2024-09-18T05:15:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638127+0000", 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638133+0000", 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7869999999999998e-06 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638146+0000", 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3030000000000001e-05 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.638156+0000", 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0523000000000001e-05 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692022+0000", 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053866149000000002 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692109+0000", 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6428000000000007e-05 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.692184+0000", 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5760999999999995e-05 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55936 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7413760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.909105769999996, 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052856933000000002, 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55936 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640659+0000", 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640661+0000", 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3479999999999998e-06 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640672+0000", 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0424999999999999e-05 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640677+0000", 2024-09-18T05:15:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5799999999999999e-06 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693392+0000", 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052714446999999998 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693456+0000", 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4426999999999998e-05 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693516+0000", 2024-09-18T05:15:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0154e-05 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55937 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7430144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.909083190000004, 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053045085999999998, 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55937 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640682+0000", 2024-09-18T05:15:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640681+0000", 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640685+0000", 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0799999999999999e-06 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640700+0000", 2024-09-18T05:15:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4768e-05 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640707+0000", 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.81e-06 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693559+0000", 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052852022999999998 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693648+0000", 2024-09-18T05:15:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8908999999999999e-05 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693727+0000", 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9123999999999997e-05 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55938 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7446528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.909053134999994, 2024-09-18T05:15:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053184652999999998, 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55938 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640712+0000", 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640711+0000", 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640714+0000", 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0070000000000002e-06 2024-09-18T05:15:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640721+0000", 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6830000000000002e-06 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640728+0000", 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6479999999999997e-06 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693775+0000", 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047086 2024-09-18T05:15:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693836+0000", 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1513999999999994e-05 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693897+0000", 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0315000000000001e-05 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55939 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7462912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.909029437000001, 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369857999999999, 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55939 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640736+0000", 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640735+0000", 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640739+0000", 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2400000000000001e-06 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640750+0000", 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0668e-05 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640755+0000", 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4299999999999997e-06 2024-09-18T05:15:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.693938+0000", 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053182462 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694028+0000", 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0781999999999999e-05 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694105+0000", 2024-09-18T05:15:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7049e-05 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:55940 3.6 3:607724ac:::rbd_data.118bb0a76c29.0000000000000000:1a [read 7479296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.909005187000005, 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053517447000000003, 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 55940 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640760+0000", 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640759+0000", 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640769+0000", 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4730000000000006e-06 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640779+0000", 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9899999999999992e-06 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.640784+0000", 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5770000000000001e-06 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694154+0000", 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053369648999999998 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694217+0000", 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2540999999999996e-05 2024-09-18T05:15:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:38.694277+0000", 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0671999999999998e-05 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77660 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2347008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.444005238999999, 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052901814999999998, 2024-09-18T05:15:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77660 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105760+0000", 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105759+0000", 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105764+0000", 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.403e-06 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105776+0000", 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2371000000000001e-05 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105785+0000", 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3670000000000003e-06 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158517+0000", 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052731497000000002 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158584+0000", 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7282999999999999e-05 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158662+0000", 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7488000000000001e-05 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77702 3.17 3:eb6eabd8:::rbd_data.118beb272ca1.000000000000000c:22 [read 2109440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.443971961999999, 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.053047159000000003, 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77702 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105793+0000", 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105792+0000", 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105797+0000", 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1779999999999996e-06 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105809+0000", 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2295e-05 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.105818+0000", 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4040000000000001e-06 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158692+0000", 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052873766000000003 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158760+0000", 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8422000000000003e-05 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.158840+0000", 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9769000000000001e-05 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:58.642 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:58.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:15:58.644 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:58.639+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:58.744 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:58.738+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:58.812 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:58.812 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:58.812 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:58.813 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:58.827 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:15:58.870 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:58.866+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:58.946 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:58.943+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:58.989 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:58.989 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:58.990 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:58.990 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:58.990 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:59.004 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:15:59.047 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:59.043+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77168 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2203648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.040181441999998, 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049653801999999997, 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77168 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087448+0000", 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087454+0000", 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2539999999999998e-06 2024-09-18T05:15:59.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087471+0000", 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6912999999999999e-05 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087484+0000", 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.131161+0000", 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.043676751999999999 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.134176+0000", 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030155300000000002 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137103+0000", 2024-09-18T05:15:59.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029268459999999999 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77182 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2289664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.039326893000002, 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048114297, 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77182 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088303+0000", 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088309+0000", 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5969999999999997e-06 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088330+0000", 2024-09-18T05:15:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1339999999999999e-05 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088365+0000", 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5036000000000001e-05 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136187+0000", 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047821474000000003 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136288+0000", 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010091599999999999 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136418+0000", 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013007700000000001 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77183 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2330624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.039252992999998, 2024-09-18T05:15:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048282688999999997, 2024-09-18T05:15:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77183 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088377+0000", 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088383+0000", 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9029999999999998e-06 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088404+0000", 2024-09-18T05:15:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996999999999999e-05 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088420+0000", 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5353e-05 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136450+0000", 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048030394999999997 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136554+0000", 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103442 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136660+0000", 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010664500000000001 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77188 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2129920~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.038852003000002, 2024-09-18T05:15:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048117532999999997, 2024-09-18T05:15:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77188 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088778+0000", 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088784+0000", 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8000000000000001e-06 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088802+0000", 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088835+0000", 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2846999999999999e-05 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136693+0000", 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047858165000000001 2024-09-18T05:15:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136783+0000", 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9862000000000001e-05 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136896+0000", 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112792 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77190 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2170880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.038687279000001, 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048251255, 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77190 2024-09-18T05:15:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088942+0000", 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088973+0000", 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0737000000000001e-05 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088996+0000", 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3013000000000001e-05 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089023+0000", 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7183e-05 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136930+0000", 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047907155 2024-09-18T05:15:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137033+0000", 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103205 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137195+0000", 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016126899999999999 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77192 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2211840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.038539612999998, 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048391998999999998, 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77192 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089090+0000", 2024-09-18T05:15:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089096+0000", 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089113+0000", 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6379999999999999e-05 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089130+0000", 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7730000000000001e-05 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137239+0000", 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048108962999999998 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137342+0000", 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010229399999999999 2024-09-18T05:15:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137483+0000", 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141235 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77193 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2252800~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.038488149000003, 2024-09-18T05:15:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048619480999999999, 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77193 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:15:59.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089141+0000", 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089158+0000", 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6362999999999999e-05 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089178+0000", 2024-09-18T05:15:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0469999999999999e-05 2024-09-18T05:15:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089192+0000", 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4204e-05 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137535+0000", 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048342382000000003 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137639+0000", 2024-09-18T05:15:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104042 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137762+0000", 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012304699999999999 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77194 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2293760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.038424372999998, 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048842564999999998, 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77194 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089205+0000", 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089212+0000", 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5100000000000004e-06 2024-09-18T05:15:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089229+0000", 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7263000000000001e-05 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089242+0000", 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3027000000000001e-05 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137800+0000", 2024-09-18T05:15:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048558220999999999 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137928+0000", 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128183 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138049+0000", 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120387 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77195 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2334720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.038377132999997, 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049100602, 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77195 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089252+0000", 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089258+0000", 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089276+0000", 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.719e-05 2024-09-18T05:15:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089291+0000", 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5347000000000001e-05 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138091+0000", 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048800518000000001 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138223+0000", 2024-09-18T05:15:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131889 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138354+0000", 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013071099999999999 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77202 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2134016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.037951249999999, 2024-09-18T05:15:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048921765999999998, 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77202 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089677+0000", 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089695+0000", 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.804e-05 2024-09-18T05:15:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089735+0000", 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0080000000000003e-05 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089748+0000", 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2493e-05 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138392+0000", 2024-09-18T05:15:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048644219000000002 2024-09-18T05:15:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138489+0000", 2024-09-18T05:15:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6836999999999995e-05 2024-09-18T05:15:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138601+0000", 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112494 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77203 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2174976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.037874010000003, 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049108851000000002, 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77203 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089756+0000", 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089761+0000", 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1000000000000003e-06 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089770+0000", 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999999e-06 2024-09-18T05:15:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089777+0000", 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138641+0000", 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048863453000000001 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138737+0000", 2024-09-18T05:15:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5828000000000005e-05 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138865+0000", 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128804 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77204 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2215936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.037847286999998, 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049349094000000003, 2024-09-18T05:15:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77204 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089786+0000", 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4529999999999998e-06 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089795+0000", 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4130000000000006e-06 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089801+0000", 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8600000000000004e-06 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138903+0000", 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049101643 2024-09-18T05:15:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139001+0000", 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7707000000000005e-05 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139132+0000", 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013160099999999999 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77205 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2256896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.037823396999997, 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049589756999999998, 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77205 2024-09-18T05:15:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089825+0000", 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8340000000000001e-05 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089842+0000", 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6606999999999999e-05 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089854+0000", 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.292e-05 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139170+0000", 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049315335000000002 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139269+0000", 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9339000000000006e-05 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139397+0000", 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127806 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77206 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2297856~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.037763894000001, 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049792218999999999, 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77206 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089866+0000", 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089872+0000", 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9599999999999997e-06 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089888+0000", 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-05 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089920+0000", 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890000000000001e-05 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139435+0000", 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049514916999999999 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139530+0000", 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4847999999999997e-05 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139659+0000", 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012879999999999999 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77207 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2338816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.037691893999998, 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04998259, 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77207 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089937+0000", 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089944+0000", 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089963+0000", 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8623000000000001e-05 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089976+0000", 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3203999999999999e-05 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139698+0000", 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049722211000000002 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139796+0000", 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7200000000000004e-05 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139921+0000", 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012560499999999999 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104467 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.860339193999998, 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63367687500000003, 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104467 2024-09-18T05:15:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267289+0000", 2024-09-18T05:15:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267300+0000", 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0382e-05 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267326+0000", 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5850000000000002e-05 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267339+0000", 2024-09-18T05:15:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3754000000000001e-05 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267425+0000", 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5544999999999995e-05 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267444+0000", 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8947999999999999e-05 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900405+0000", 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63296088699999997 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900624+0000", 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219466 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900968+0000", 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034406500000000001 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104468 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.860247016000002, 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63418863999999997, 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104468 2024-09-18T05:15:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267382+0000", 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267390+0000", 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.028e-06 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267406+0000", 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5446000000000001e-05 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267419+0000", 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3514e-05 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8612e-05 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267503+0000", 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4714e-05 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901334+0000", 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.633831747 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901437+0000", 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010287499999999999 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901572+0000", 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013484799999999999 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104469 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 2359296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.860200495999997, 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63443118099999996, 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104469 2024-09-18T05:15:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267429+0000", 2024-09-18T05:15:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267435+0000", 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2100000000000001e-06 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267447+0000", 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2532e-05 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267457+0000", 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0010000000000001e-05 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267545+0000", 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7627999999999995e-05 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267559+0000", 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3963e-05 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901627+0000", 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63406880399999999 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901723+0000", 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5629000000000002e-05 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901861+0000", 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013816499999999999 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104470 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 3211264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.860142172000003, 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.634540459, 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104470 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267493+0000", 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5280000000000003e-06 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267509+0000", 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5517999999999999e-05 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267518+0000", 2024-09-18T05:15:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7030000000000001e-06 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267607+0000", 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9202000000000004e-05 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267620+0000", 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2612999999999999e-05 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901913+0000", 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63429272599999997 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901965+0000", 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2391e-05 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902029+0000", 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3626000000000004e-05 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104471 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.860091232999999, 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63472597500000005, 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104471 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267544+0000", 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2379999999999997e-06 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267557+0000", 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3020000000000001e-05 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267566+0000", 2024-09-18T05:15:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.38e-06 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267658+0000", 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1852000000000001e-05 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267670+0000", 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.224e-05 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902059+0000", 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63438875900000002 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902124+0000", 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5374000000000001e-05 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902265+0000", 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140922 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.230 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:59.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:15:59.232 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:59.226+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:59.253 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.4 to 1 (10000) 2024-09-18T05:15:59.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:15:59.277 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-18T05:15:59.332 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:15:59.331+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:15:59.376 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:59.377 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:59.377 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:15:59.377 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:59.394 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:15:59.433 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:15:59.431+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:15:59.533 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:15:59.531+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:15:59.560 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:59.560 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:15:59.560 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:15:59.560 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:15:59.560 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:59.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:15:59.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:15:59.630+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:15:59.704 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:15:59.704 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:15:59.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:15:59.704 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:15:59.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.705 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:59.705 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.789908836, 2024-09-18T05:15:59.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:15:59.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.789877893, 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:15:59.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:15:59.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:15:59.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:15:59.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:15:59.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:15:59.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:15:59.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:15:59.715 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.715 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.715 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.715 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.789852329, 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.716 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:15:59.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.789827613, 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.720 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:15:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:15:59.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.789801379, 2024-09-18T05:15:59.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:15:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:15:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.78977247, 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:15:59.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.78974864, 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:15:59.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.78972416400001, 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:15:59.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:15:59.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:15:59.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:15:59.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.789606365, 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.748 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.749 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.749 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:59.749 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.78661441, 2024-09-18T05:15:59.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:15:59.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:15:59.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.786536348, 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:15:59.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:15:59.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:15:59.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:15:59.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:15:59.762 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.762 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.786505061, 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:15:59.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.767 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.768 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.768 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.768 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:59.768 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.786479048, 2024-09-18T05:15:59.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:15:59.768 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:15:59.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.786451275, 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:15:59.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:15:59.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:15:59.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:15:59.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:15:59.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.78642621199999, 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.78640118200001, 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:59.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:15:59.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:15:59.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.787 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.787 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.787 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:59.787 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.782276854, 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:59.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:15:59.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.782256309, 2024-09-18T05:15:59.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:15:59.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:15:59.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:15:59.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 127.782236627, 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:15:59.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:15:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 76.514165180000006, 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:15:59.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:15:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:15:59.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:15:59.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:15:59.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:15:59.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:15:59.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:15:59.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:15:59.808 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:15:59.809 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:15:59.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:15:59.810 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:15:59.806+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:15:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:15:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.5 to 1 (10000) 2024-09-18T05:15:59.910 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:15:59.906+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:15:59.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-18T05:15:59.950 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:15:59.951 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:15:59.951 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:15:59.951 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:15:59.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:16:00.018 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:00.014+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:00.109 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:00.109 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:00.109 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:00.109 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:00.109 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:00.112 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:00.111+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:00.126 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:16:00.213 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:00.211+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:00.293 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:00.293 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:00.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:00.293 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:00.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.293 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.293 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:00.293 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540792359999998, 2024-09-18T05:16:00.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:16:00.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:00.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:16:00.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:16:00.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.298 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.54078337, 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:16:00.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540774403, 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:16:00.307 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540765620000002, 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.308 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.309 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.309 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:16:00.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.309 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:00.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:16:00.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540756844000001, 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:16:00.313 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:16:00.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:16:00.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540746552000002, 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.318 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:16:00.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540732665, 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:16:00.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540723458999999, 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:16:00.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:16:00.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:16:00.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:16:00.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540714760999997, 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.333 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:16:00.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:16:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:16:00.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:16:00.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:16:00.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540705696000003, 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.338 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.342 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.343 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.343 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:00.343 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540682338000003, 2024-09-18T05:16:00.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:16:00.343 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:16:00.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:16:00.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540672673000003, 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.348 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:00.353 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540646316, 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:00.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:16:00.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:16:00.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540632784000003, 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.359 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:00.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:16:00.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540621332999997, 2024-09-18T05:16:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:16:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:16:00.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540611851999998, 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.368 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:00.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:00.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:16:00.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:00.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540601770000002, 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.376 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.377 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:16:00.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.377 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:00.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:16:00.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:00.381 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540592682000003, 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:00.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:16:00.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540583124999998, 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.386 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:16:00.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:16:00.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.540574304000003, 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:00.391 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:16:00.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:00.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:00.395 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:00.397 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:16:00.397 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:00.395+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:00.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:16:00.497 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:00.495+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:00.568 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:00.568 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:00.568 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:00.568 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:00.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:16:00.598 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:00.594+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:00.609 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:00.609 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:00.625 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:00.626 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:00.641 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:00.642 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:00.657 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:00.657 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:00.677 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:00.677 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:00.698 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:00.695+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:00.717 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:00.718 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:00.735 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:00.735 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:00.748 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:00.748 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:00.762 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:16:00.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:00.798+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:00.900 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.6 to 1 (10000) 2024-09-18T05:16:00.903 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:00.899+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:00.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-18T05:16:00.936 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:00.936 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:00.952 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:16:01.014 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:01.010+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:01.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:01.098+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:01.123 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:01.123 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:01.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:16:01.203 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:01.199+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:01.261 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:01.261 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:01.275 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:16:01.304 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:01.298+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:01.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:01.402+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:01.437 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:01.438 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:01.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:16:01.506 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:01.502+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:01.577 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:01.577 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:01.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:16:01.607 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:01.602+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:01.708 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:01.702+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:01.712 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:01.712 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:01.726 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:16:01.809 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:01.806+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:01.843 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:01.843 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:01.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:16:01.898 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.7 to 1 (10000) 2024-09-18T05:16:01.909 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:01.906+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:01.927 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-18T05:16:01.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:16:01.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:16:02.003 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:02.003 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:02.020 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:16:02.020 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:02.014+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:02.114 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:02.110+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:02.186 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:02.186 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:02.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:16:02.212 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:02.210+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:02.280 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:16:02.298 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-18T05:16:01.892460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":676727708,"num_objects":1105,"num_object_clones":276,"num_object_copies":2210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":554,"num_read":176866,"num_read_kb":916863,"num_write":21001,"num_write_kb":365641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":19007930,"num_keys_recovered":109,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17618,"ondisk_log_size":17618,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":391684,"kb_used_data":37760,"kb_used_omap":29,"kb_used_meta":353762,"kb_avail":754583036,"statfs":{"total":773094113280,"available":772693028864,"internally_reserved":0,"allocated":38666240,"data_stored":286290061,"data_compressed":17113266,"data_compressed_allocated":17473536,"data_compressed_original":272617027,"omap_allocated":29988,"internal_metadata":362253020},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10229070,"num_objects":-10,"num_object_clones":-4,"num_object_copies":-20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10,"num_whiteouts":-4,"num_read":246,"num_read_kb":212,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.657873"},"pg_stats":[{"pgid":"3.1f","version":"126'652","reported_seq":2616,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.233185+0000","last_change":"2024-09-18T05:15:57.233185+0000","last_active":"2024-09-18T05:15:57.233185+0000","last_peered":"2024-09-18T05:15:57.233185+0000","last_clean":"2024-09-18T05:15:57.233185+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:15:57.233185+0000","last_undegraded":"2024-09-18T05:15:57.233185+0000","last_fullsized":"2024-09-18T05:15:57.233185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0096302950000000005,"stat_sum":{"num_bytes":20625454,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":4058,"num_read_kb":20138,"num_write":873,"num_write_kb":9320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1e","version":"125'1371","reported_seq":6566,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.224328+0000","last_change":"2024-09-18T05:15:57.224328+0000","last_active":"2024-09-18T05:15:57.224328+0000","last_peered":"2024-09-18T05:15:57.224328+0000","last_clean":"2024-09-18T05:15:57.224328+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:15:57.224328+0000","last_undegraded":"2024-09-18T05:15:57.224328+0000","last_fullsized":"2024-09-18T05:15:57.224328+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1371,"log_dups_size":0,"ondisk_log_size":1371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0072432149999999999,"stat_sum":{"num_bytes":27749403,"num_objects":36,"num_object_clones":6,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":20,"num_read":11105,"num_read_kb":29015,"num_write":2165,"num_write_kb":10708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1d","version":"126'464","reported_seq":2453,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.243784+0000","last_change":"2024-09-18T05:15:57.246485+0000","last_active":"2024-09-18T05:15:57.243784+0000","last_peered":"2024-09-18T05:15:57.243784+0000","last_clean":"2024-09-18T05:15:57.243784+0000","last_became_active":"2024-09-18T05:14:56.215359+0000","last_became_peered":"2024-09-18T05:14:56.215359+0000","last_unstale":"2024-09-18T05:15:57.243784+0000","last_undegraded":"2024-09-18T05:15:57.243784+0000","last_fullsized":"2024-09-18T05:15:57.243784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:17:42.290269+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.020907096999999999,"stat_sum":{"num_bytes":9875585,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":22,"num_read":3379,"num_read_kb":19980,"num_write":482,"num_write_kb":11303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1c","version":"126'841","reported_seq":4308,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.385976+0000","last_change":"2024-09-18T05:15:57.241396+0000","last_active":"2024-09-18T05:15:57.385976+0000","last_peered":"2024-09-18T05:15:57.385976+0000","last_clean":"2024-09-18T05:15:57.385976+0000","last_became_active":"2024-09-18T05:14:56.212214+0000","last_became_peered":"2024-09-18T05:14:56.212214+0000","last_unstale":"2024-09-18T05:15:57.385976+0000","last_undegraded":"2024-09-18T05:15:57.385976+0000","last_fullsized":"2024-09-18T05:15:57.385976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:41.658356+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.015970496000000001,"stat_sum":{"num_bytes":26312856,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":19,"num_read":6744,"num_read_kb":32640,"num_write":1116,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1b","version":"126'374","reported_seq":2324,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.248486+0000","last_change":"2024-09-18T05:15:57.248486+0000","last_active":"2024-09-18T05:15:57.248486+0000","last_peered":"2024-09-18T05:15:57.248486+0000","last_clean":"2024-09-18T05:15:57.248486+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:15:57.248486+0000","last_undegraded":"2024-09-18T05:15:57.248486+0000","last_fullsized":"2024-09-18T05:15:57.248486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.024532393,"stat_sum":{"num_bytes":26274353,"num_objects":39,"num_object_clones":11,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":22,"num_read":2719,"num_read_kb":17097,"num_write":358,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1a","version":"126'405","reported_seq":6059,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.404550+0000","last_change":"2024-09-18T05:15:57.233101+0000","last_active":"2024-09-18T05:15:57.404550+0000","last_peered":"2024-09-18T05:15:57.404550+0000","last_clean":"2024-09-18T05:15:57.404550+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:15:57.404550+0000","last_undegraded":"2024-09-18T05:15:57.404550+0000","last_fullsized":"2024-09-18T05:15:57.404550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0076472789999999999,"stat_sum":{"num_bytes":16078552,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":13,"num_read":5770,"num_read_kb":45619,"num_write":409,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.19","version":"126'493","reported_seq":5456,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.231493+0000","last_change":"2024-09-18T05:15:57.231493+0000","last_active":"2024-09-18T05:15:57.231493+0000","last_peered":"2024-09-18T05:15:57.231493+0000","last_clean":"2024-09-18T05:15:57.231493+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:15:57.231493+0000","last_undegraded":"2024-09-18T05:15:57.231493+0000","last_fullsized":"2024-09-18T05:15:57.231493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0051095170000000001,"stat_sum":{"num_bytes":30307704,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":7849,"num_read_kb":20409,"num_write":454,"num_write_kb":15035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.18","version":"126'821","reported_seq":2537,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.340955+0000","last_change":"2024-09-18T05:15:57.223783+0000","last_active":"2024-09-18T05:15:57.340955+0000","last_peered":"2024-09-18T05:15:57.340955+0000","last_clean":"2024-09-18T05:15:57.340955+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:15:57.340955+0000","last_undegraded":"2024-09-18T05:15:57.340955+0000","last_fullsized":"2024-09-18T05:15:57.340955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0069553999999999996,"stat_sum":{"num_bytes":24172070,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":20,"num_read":4159,"num_read_kb":22318,"num_write":1160,"num_write_kb":9141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.17","version":"126'530","reported_seq":6947,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.242948+0000","last_change":"2024-09-18T05:15:57.243285+0000","last_active":"2024-09-18T05:15:57.242948+0000","last_peered":"2024-09-18T05:15:57.242948+0000","last_clean":"2024-09-18T05:15:57.242948+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:15:57.242948+0000","last_undegraded":"2024-09-18T05:15:57.242948+0000","last_fullsized":"2024-09-18T05:15:57.242948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.019510564000000001,"stat_sum":{"num_bytes":24288012,"num_objects":37,"num_object_clones":13,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":19,"num_read":8102,"num_read_kb":32863,"num_write":449,"num_write_kb":10643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.16","version":"123'578","reported_seq":8006,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.223038+0000","last_change":"2024-09-18T05:15:57.223038+0000","last_active":"2024-09-18T05:15:57.223038+0000","last_peered":"2024-09-18T05:15:57.223038+0000","last_clean":"2024-09-18T05:15:57.223038+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:15:57.223038+0000","last_undegraded":"2024-09-18T05:15:57.223038+0000","last_fullsized":"2024-09-18T05:15:57.223038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055413399999999996,"stat_sum":{"num_bytes":35652137,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":19,"num_read":9215,"num_read_kb":47684,"num_write":624,"num_write_kb":15042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.15","version":"126'699","reported_seq":6784,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.319874+0000","last_change":"2024-09-18T05:15:57.235643+0000","last_active":"2024-09-18T05:15:57.319874+0000","last_peered":"2024-09-18T05:15:57.319874+0000","last_clean":"2024-09-18T05:15:57.319874+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:15:57.319874+0000","last_undegraded":"2024-09-18T05:15:57.319874+0000","last_fullsized":"2024-09-18T05:15:57.319874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.018139552,"stat_sum":{"num_bytes":42590976,"num_objects":44,"num_object_clones":13,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":19,"num_read":7996,"num_read_kb":49123,"num_write":1013,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.14","version":"126'375","reported_seq":2134,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.318465+0000","last_change":"2024-09-18T05:15:57.258228+0000","last_active":"2024-09-18T05:15:57.318465+0000","last_peered":"2024-09-18T05:15:57.318465+0000","last_clean":"2024-09-18T05:15:57.318465+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:15:57.318465+0000","last_undegraded":"2024-09-18T05:15:57.318465+0000","last_fullsized":"2024-09-18T05:15:57.318465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.032402056999999998,"stat_sum":{"num_bytes":18242033,"num_objects":37,"num_object_clones":8,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":2052,"num_read_kb":19658,"num_write":403,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.246463+0000","last_change":"2024-09-18T05:15:55.214834+0000","last_active":"2024-09-18T05:15:57.246463+0000","last_peered":"2024-09-18T05:15:57.246463+0000","last_clean":"2024-09-18T05:15:57.246463+0000","last_became_active":"2024-09-18T05:15:55.213947+0000","last_became_peered":"2024-09-18T05:15:55.213947+0000","last_unstale":"2024-09-18T05:15:57.246463+0000","last_undegraded":"2024-09-18T05:15:57.246463+0000","last_fullsized":"2024-09-18T05:15:57.246463+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:23.379787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"126'527","reported_seq":3521,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.335713+0000","last_change":"2024-09-18T05:15:57.239277+0000","last_active":"2024-09-18T05:15:57.335713+0000","last_peered":"2024-09-18T05:15:57.335713+0000","last_clean":"2024-09-18T05:15:57.335713+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:15:57.335713+0000","last_undegraded":"2024-09-18T05:15:57.335713+0000","last_fullsized":"2024-09-18T05:15:57.335713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.015619624,"stat_sum":{"num_bytes":18792135,"num_objects":28,"num_object_clones":6,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":16,"num_read":4560,"num_read_kb":29216,"num_write":664,"num_write_kb":13076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.307059+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:15:56.307059+0000","last_peered":"2024-09-18T05:15:56.307059+0000","last_clean":"2024-09-18T05:15:56.307059+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:15:56.307059+0000","last_undegraded":"2024-09-18T05:15:56.307059+0000","last_fullsized":"2024-09-18T05:15:56.307059+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"124'473","reported_seq":2681,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.236770+0000","last_change":"2024-09-18T05:15:57.236770+0000","last_active":"2024-09-18T05:15:57.236770+0000","last_peered":"2024-09-18T05:15:57.236770+0000","last_clean":"2024-09-18T05:15:57.236770+0000","last_became_active":"2024-09-18T05:13:45.882587+0000","last_became_peered":"2024-09-18T05:13:45.882587+0000","last_unstale":"2024-09-18T05:15:57.236770+0000","last_undegraded":"2024-09-18T05:15:57.236770+0000","last_fullsized":"2024-09-18T05:15:57.236770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:27:19.084581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018887101,"stat_sum":{"num_bytes":29398597,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":3402,"num_read_kb":32978,"num_write":574,"num_write_kb":10107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.309368+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:15:56.309368+0000","last_peered":"2024-09-18T05:15:56.309368+0000","last_clean":"2024-09-18T05:15:56.309368+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:15:56.309368+0000","last_undegraded":"2024-09-18T05:15:56.309368+0000","last_fullsized":"2024-09-18T05:15:56.309368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"126'387","reported_seq":5853,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.242177+0000","last_change":"2024-09-18T05:15:57.242177+0000","last_active":"2024-09-18T05:15:57.242177+0000","last_peered":"2024-09-18T05:15:57.242177+0000","last_clean":"2024-09-18T05:15:57.242177+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:15:57.242177+0000","last_undegraded":"2024-09-18T05:15:57.242177+0000","last_fullsized":"2024-09-18T05:15:57.242177+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:46.818280+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.015127885000000001,"stat_sum":{"num_bytes":31638481,"num_objects":32,"num_object_clones":5,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":15,"num_read":6526,"num_read_kb":27661,"num_write":412,"num_write_kb":9090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.307375+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:15:56.307375+0000","last_peered":"2024-09-18T05:15:56.307375+0000","last_clean":"2024-09-18T05:15:56.307375+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:15:56.307375+0000","last_undegraded":"2024-09-18T05:15:56.307375+0000","last_fullsized":"2024-09-18T05:15:56.307375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"126'428","reported_seq":5870,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.431280+0000","last_change":"2024-09-18T05:15:57.226875+0000","last_active":"2024-09-18T05:15:57.431280+0000","last_peered":"2024-09-18T05:15:57.431280+0000","last_clean":"2024-09-18T05:15:57.431280+0000","last_became_active":"2024-09-18T05:14:56.206206+0000","last_became_peered":"2024-09-18T05:14:56.206206+0000","last_unstale":"2024-09-18T05:15:57.431280+0000","last_undegraded":"2024-09-18T05:15:57.431280+0000","last_fullsized":"2024-09-18T05:15:57.431280+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:21.659467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096762610000000002,"stat_sum":{"num_bytes":13098884,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":18,"num_read":5834,"num_read_kb":39781,"num_write":437,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.3","version":"126'1054","reported_seq":4662,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.338171+0000","last_change":"2024-09-18T05:15:57.256775+0000","last_active":"2024-09-18T05:15:57.338171+0000","last_peered":"2024-09-18T05:15:57.338171+0000","last_clean":"2024-09-18T05:15:57.338171+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:15:57.338171+0000","last_undegraded":"2024-09-18T05:15:57.338171+0000","last_fullsized":"2024-09-18T05:15:57.338171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.031005069,"stat_sum":{"num_bytes":31572252,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":15,"num_read":6745,"num_read_kb":44150,"num_write":1363,"num_write_kb":19997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.2","version":"21'2","reported_seq":76,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.307083+0000","last_change":"2024-09-18T05:14:56.205729+0000","last_active":"2024-09-18T05:15:56.307083+0000","last_peered":"2024-09-18T05:15:56.307083+0000","last_clean":"2024-09-18T05:15:56.307083+0000","last_became_active":"2024-09-18T05:14:56.205340+0000","last_became_peered":"2024-09-18T05:14:56.205340+0000","last_unstale":"2024-09-18T05:15:56.307083+0000","last_undegraded":"2024-09-18T05:15:56.307083+0000","last_fullsized":"2024-09-18T05:15:56.307083+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:02:33.068329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"126'407","reported_seq":4582,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.330705+0000","last_change":"2024-09-18T05:15:57.237820+0000","last_active":"2024-09-18T05:15:57.330705+0000","last_peered":"2024-09-18T05:15:57.330705+0000","last_clean":"2024-09-18T05:15:57.330705+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:15:57.330705+0000","last_undegraded":"2024-09-18T05:15:57.330705+0000","last_fullsized":"2024-09-18T05:15:57.330705+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:12.320367+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011126802,"stat_sum":{"num_bytes":14467608,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":4850,"num_read_kb":21771,"num_write":377,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.217921+0000","last_change":"2024-09-18T05:15:55.216600+0000","last_active":"2024-09-18T05:15:57.217921+0000","last_peered":"2024-09-18T05:15:57.217921+0000","last_clean":"2024-09-18T05:15:57.217921+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:15:57.217921+0000","last_undegraded":"2024-09-18T05:15:57.217921+0000","last_fullsized":"2024-09-18T05:15:57.217921+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:42:31.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"126'328","reported_seq":2091,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.427884+0000","last_change":"2024-09-18T05:15:57.234359+0000","last_active":"2024-09-18T05:15:57.427884+0000","last_peered":"2024-09-18T05:15:57.427884+0000","last_clean":"2024-09-18T05:15:57.427884+0000","last_became_active":"2024-09-18T05:15:05.291649+0000","last_became_peered":"2024-09-18T05:15:05.291649+0000","last_unstale":"2024-09-18T05:15:57.427884+0000","last_undegraded":"2024-09-18T05:15:57.427884+0000","last_fullsized":"2024-09-18T05:15:57.427884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:59.933767+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011027288999999999,"stat_sum":{"num_bytes":5216089,"num_objects":33,"num_object_clones":10,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":17,"num_read":2104,"num_read_kb":5482,"num_write":348,"num_write_kb":5247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1107330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.309202+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:15:56.309202+0000","last_peered":"2024-09-18T05:15:56.309202+0000","last_clean":"2024-09-18T05:15:56.309202+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:15:56.309202+0000","last_undegraded":"2024-09-18T05:15:56.309202+0000","last_fullsized":"2024-09-18T05:15:56.309202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"126'529","reported_seq":4786,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.379303+0000","last_change":"2024-09-18T05:15:57.248656+0000","last_active":"2024-09-18T05:15:57.379303+0000","last_peered":"2024-09-18T05:15:57.379303+0000","last_clean":"2024-09-18T05:15:57.379303+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:15:57.379303+0000","last_undegraded":"2024-09-18T05:15:57.379303+0000","last_fullsized":"2024-09-18T05:15:57.379303+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:22:34.025479+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.022280362000000001,"stat_sum":{"num_bytes":30673317,"num_objects":31,"num_object_clones":7,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":14,"num_read":7044,"num_read_kb":38379,"num_write":530,"num_write_kb":10736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.3","version":"19'1","reported_seq":30,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.218076+0000","last_change":"2024-09-18T05:15:55.218072+0000","last_active":"2024-09-18T05:15:57.218076+0000","last_peered":"2024-09-18T05:15:57.218076+0000","last_clean":"2024-09-18T05:15:57.218076+0000","last_became_active":"2024-09-18T05:15:55.217766+0000","last_became_peered":"2024-09-18T05:15:55.217766+0000","last_unstale":"2024-09-18T05:15:57.218076+0000","last_undegraded":"2024-09-18T05:15:57.218076+0000","last_fullsized":"2024-09-18T05:15:57.218076+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:22:23.860200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":269,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.309291+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:15:56.309291+0000","last_peered":"2024-09-18T05:15:56.309291+0000","last_clean":"2024-09-18T05:15:56.309291+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:15:56.309291+0000","last_undegraded":"2024-09-18T05:15:56.309291+0000","last_fullsized":"2024-09-18T05:15:56.309291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"126'362","reported_seq":4902,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.391291+0000","last_change":"2024-09-18T05:15:57.236984+0000","last_active":"2024-09-18T05:15:57.391291+0000","last_peered":"2024-09-18T05:15:57.391291+0000","last_clean":"2024-09-18T05:15:57.391291+0000","last_became_active":"2024-09-18T05:15:05.292062+0000","last_became_peered":"2024-09-18T05:15:05.292062+0000","last_unstale":"2024-09-18T05:15:57.391291+0000","last_undegraded":"2024-09-18T05:15:57.391291+0000","last_fullsized":"2024-09-18T05:15:57.391291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:41:13.640268+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.010399659,"stat_sum":{"num_bytes":13333085,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":15,"num_read":6061,"num_read_kb":42276,"num_write":334,"num_write_kb":15919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":8331478,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.9","version":"126'268","reported_seq":4012,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.319449+0000","last_change":"2024-09-18T05:15:57.253034+0000","last_active":"2024-09-18T05:15:57.319449+0000","last_peered":"2024-09-18T05:15:57.319449+0000","last_clean":"2024-09-18T05:15:57.319449+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:15:57.319449+0000","last_undegraded":"2024-09-18T05:15:57.319449+0000","last_fullsized":"2024-09-18T05:15:57.319449+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:06:43.114897+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.027478361,"stat_sum":{"num_bytes":28614627,"num_objects":32,"num_object_clones":12,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":16,"num_read":3697,"num_read_kb":33449,"num_write":288,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.a","version":"126'599","reported_seq":2566,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-18T05:15:58.248591+0000","last_change":"2024-09-18T05:15:58.249152+0000","last_active":"2024-09-18T05:15:58.248591+0000","last_peered":"2024-09-18T05:15:58.248591+0000","last_clean":"2024-09-18T05:15:58.248591+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:15:58.248591+0000","last_undegraded":"2024-09-18T05:15:58.248591+0000","last_fullsized":"2024-09-18T05:15:58.248591+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091194599999999996,"stat_sum":{"num_bytes":9712143,"num_objects":26,"num_object_clones":6,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":13,"num_read":3568,"num_read_kb":18366,"num_write":730,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"18","length":"1a"}]},{"pgid":"3.b","version":"126'274","reported_seq":3205,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.320405+0000","last_change":"2024-09-18T05:15:57.236415+0000","last_active":"2024-09-18T05:15:57.320405+0000","last_peered":"2024-09-18T05:15:57.320405+0000","last_clean":"2024-09-18T05:15:57.320405+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:15:57.320405+0000","last_undegraded":"2024-09-18T05:15:57.320405+0000","last_fullsized":"2024-09-18T05:15:57.320405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.019308021000000002,"stat_sum":{"num_bytes":8695692,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":15,"num_read":2826,"num_read_kb":19519,"num_write":250,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.c","version":"126'447","reported_seq":5047,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.226286+0000","last_change":"2024-09-18T05:15:57.226286+0000","last_active":"2024-09-18T05:15:57.226286+0000","last_peered":"2024-09-18T05:15:57.226286+0000","last_clean":"2024-09-18T05:15:57.226286+0000","last_became_active":"2024-09-18T05:14:56.206142+0000","last_became_peered":"2024-09-18T05:14:56.206142+0000","last_unstale":"2024-09-18T05:15:57.226286+0000","last_undegraded":"2024-09-18T05:15:57.226286+0000","last_fullsized":"2024-09-18T05:15:57.226286+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:17:28.830425+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0092884890000000005,"stat_sum":{"num_bytes":20669291,"num_objects":32,"num_object_clones":10,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":18,"num_read":5187,"num_read_kb":29961,"num_write":516,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.d","version":"126'359","reported_seq":3398,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.431265+0000","last_change":"2024-09-18T05:15:57.235639+0000","last_active":"2024-09-18T05:15:57.431265+0000","last_peered":"2024-09-18T05:15:57.431265+0000","last_clean":"2024-09-18T05:15:57.431265+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:15:57.431265+0000","last_undegraded":"2024-09-18T05:15:57.431265+0000","last_fullsized":"2024-09-18T05:15:57.431265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.018110576,"stat_sum":{"num_bytes":8506884,"num_objects":24,"num_object_clones":5,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":10,"num_read":3839,"num_read_kb":17119,"num_write":356,"num_write_kb":12996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.e","version":"122'512","reported_seq":5556,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.354066+0000","last_change":"2024-09-18T05:15:57.228586+0000","last_active":"2024-09-18T05:15:57.354066+0000","last_peered":"2024-09-18T05:15:57.354066+0000","last_clean":"2024-09-18T05:15:57.354066+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:15:57.354066+0000","last_undegraded":"2024-09-18T05:15:57.354066+0000","last_fullsized":"2024-09-18T05:15:57.354066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011181147000000001,"stat_sum":{"num_bytes":37641762,"num_objects":57,"num_object_clones":14,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":34,"num_read":6544,"num_read_kb":34395,"num_write":542,"num_write_kb":4806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.f","version":"126'514","reported_seq":8809,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.236977+0000","last_change":"2024-09-18T05:15:57.237253+0000","last_active":"2024-09-18T05:15:57.236977+0000","last_peered":"2024-09-18T05:15:57.236977+0000","last_clean":"2024-09-18T05:15:57.236977+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:15:57.236977+0000","last_undegraded":"2024-09-18T05:15:57.236977+0000","last_fullsized":"2024-09-18T05:15:57.236977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.019777784999999999,"stat_sum":{"num_bytes":12393517,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":17,"num_read":9510,"num_read_kb":40428,"num_write":534,"num_write_kb":18331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.10","version":"126'613","reported_seq":3761,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-18T05:15:58.248441+0000","last_change":"2024-09-18T05:15:58.248930+0000","last_active":"2024-09-18T05:15:58.248441+0000","last_peered":"2024-09-18T05:15:58.248441+0000","last_clean":"2024-09-18T05:15:58.248441+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:15:58.248441+0000","last_undegraded":"2024-09-18T05:15:58.248441+0000","last_fullsized":"2024-09-18T05:15:58.248441+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079537499999999997,"stat_sum":{"num_bytes":29415686,"num_objects":32,"num_object_clones":6,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":17,"num_read":6800,"num_read_kb":30722,"num_write":729,"num_write_kb":9597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"18","length":"1a"}]},{"pgid":"3.11","version":"126'430","reported_seq":3654,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.228403+0000","last_change":"2024-09-18T05:15:57.228403+0000","last_active":"2024-09-18T05:15:57.228403+0000","last_peered":"2024-09-18T05:15:57.228403+0000","last_clean":"2024-09-18T05:15:57.228403+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:15:57.228403+0000","last_undegraded":"2024-09-18T05:15:57.228403+0000","last_fullsized":"2024-09-18T05:15:57.228403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0099601399999999993,"stat_sum":{"num_bytes":18657218,"num_objects":19,"num_object_clones":3,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":10,"num_read":4545,"num_read_kb":16351,"num_write":459,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.12","version":"126'595","reported_seq":2614,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.404546+0000","last_change":"2024-09-18T05:15:57.248649+0000","last_active":"2024-09-18T05:15:57.404546+0000","last_peered":"2024-09-18T05:15:57.404546+0000","last_clean":"2024-09-18T05:15:57.404546+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:15:57.404546+0000","last_undegraded":"2024-09-18T05:15:57.404546+0000","last_fullsized":"2024-09-18T05:15:57.404546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.024491533999999999,"stat_sum":{"num_bytes":4763206,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":17,"num_read":4441,"num_read_kb":15663,"num_write":692,"num_write_kb":7877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.13","version":"126'789","reported_seq":2886,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.228429+0000","last_change":"2024-09-18T05:15:57.228429+0000","last_active":"2024-09-18T05:15:57.228429+0000","last_peered":"2024-09-18T05:15:57.228429+0000","last_clean":"2024-09-18T05:15:57.228429+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:15:57.228429+0000","last_undegraded":"2024-09-18T05:15:57.228429+0000","last_fullsized":"2024-09-18T05:15:57.228429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.010055242000000001,"stat_sum":{"num_bytes":6707712,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":21,"num_read":5519,"num_read_kb":22552,"num_write":1199,"num_write_kb":8974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":676137321,"num_objects":1101,"num_object_clones":276,"num_object_copies":2202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1101,"num_whiteouts":554,"num_read":176750,"num_read_kb":916763,"num_write":20840,"num_write_kb":363223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":19007930,"num_keys_recovered":109,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25321472,"data_stored":273185322,"data_compressed":16672558,"data_compressed_allocated":16977920,"data_compressed_original":265936451,"omap_allocated":6486,"internal_metadata":0},"log_size":17498,"ondisk_log_size":17498,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54892,"kb_used_data":5724,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316948,"statfs":{"total":96636764160,"available":96580554752,"internally_reserved":0,"allocated":5861376,"data_stored":46139854,"data_compressed":2794609,"data_compressed_allocated":2871296,"data_compressed_original":44079789,"omap_allocated":1589,"internal_metadata":50330059},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.85999999999999999,"15min":0.88800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1519999999999999,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.143},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0489999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.92100000000000004,"15min":0.93899999999999995},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7030000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.89700000000000002,"15min":0.92900000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97399999999999998,"5min":1.583,"15min":1.583},"last":0.745}]},{"osd":2,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.073,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.008,"15min":1.036},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2070000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.2929999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.86199999999999999,"15min":0.86699999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.823,"5min":1.925,"15min":1.925},"last":1.099},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.04,"15min":1.0589999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.232,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.0589999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.0580000000000001,"15min":1.097},"min":{"1min":0.46100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.522,"5min":3.488,"15min":3.488},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.92600000000000005,"15min":0.95099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1910000000000001,"5min":2.512,"15min":2.512},"last":1.248}]},{"osd":5,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.1399999999999999,"15min":1.173},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.1539999999999999,"5min":3.069,"15min":3.069},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.1100000000000001,"15min":1.131},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":1.04}]},{"osd":6,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.452}]}]},{"osd":6,"up_from":61,"seq":261993005073,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34848,"kb_used_data":2508,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94336992,"statfs":{"total":96636764160,"available":96601079808,"internally_reserved":0,"allocated":2568192,"data_stored":11434616,"data_compressed":623292,"data_compressed_allocated":708608,"data_compressed_original":10442709,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.96199999999999997}]},{"osd":1,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.036}]},{"osd":5,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.214}]},{"osd":7,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.1639999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":5952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":6094848,"data_stored":47530373,"data_compressed":3054437,"data_compressed_allocated":3149824,"data_compressed_original":45651134,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3080000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1020000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.80700000000000005,"15min":0.82799999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.77300000000000002}]},{"osd":3,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.143,"5min":1.502,"15min":1.502},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90200000000000002,"15min":0.91400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2549999999999999,"5min":1.804,"15min":1.804},"last":0.73699999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.84799999999999998,"15min":0.81000000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.2350000000000003,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.871,"15min":0.873},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.274,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.84299999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.95499999999999996}]},{"osd":7,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.998,"5min":0.99199999999999999,"15min":0.99099999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.98399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59716,"kb_used_data":6456,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94312124,"statfs":{"total":96636764160,"available":96575614976,"internally_reserved":0,"allocated":6610944,"data_stored":54748440,"data_compressed":3441432,"data_compressed_allocated":3551232,"data_compressed_original":52755291,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.84799999999999998,"15min":0.875},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.198,"5min":2.827,"15min":2.827},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.91500000000000004}]},{"osd":1,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1060000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93300000000000005,"15min":0.96799999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0669999999999999,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.80700000000000005}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1859999999999999,"5min":1.365,"15min":1.365},"last":0.56100000000000005}]},{"osd":3,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.012,"5min":1.133,"15min":1.133},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93400000000000005,"15min":0.92500000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.282,"5min":4.282,"15min":4.282},"last":0.748}]},{"osd":5,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.77000000000000002}]},{"osd":6,"last update":"Wed Sep 18 05:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85799999999999998}]},{"osd":7,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.84699999999999998,"15min":0.83899999999999997},"min":{"1min":0.45900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.873,"5min":0.997,"15min":1.018},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80296,"kb_used_data":4888,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94291544,"statfs":{"total":96636764160,"available":96554541056,"internally_reserved":0,"allocated":5005312,"data_stored":36893257,"data_compressed":1943441,"data_compressed_allocated":2039808,"data_compressed_original":34855149,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.623,"15min":0.63500000000000001},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.98199999999999998,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.997}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":1.149},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82899999999999996,"15min":0.84499999999999997},"min":{"1min":0.46899999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1679999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.92000000000000004,"15min":0.93799999999999994},"min":{"1min":0.48199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.294,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.85199999999999998,"15min":0.86699999999999999},"min":{"1min":0.50900000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.133,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.89900000000000002,"15min":0.91900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3220000000000001,"5min":1.373,"15min":1.373},"last":0.71499999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.89400000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.995,"15min":1.0189999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2809999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.04},{"interface":"front","average":{"1min":0.85899999999999999,"5min":1.0309999999999999,"15min":1.0600000000000001},"min":{"1min":0.57099999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.321,"5min":2.722,"15min":2.722},"last":0.96599999999999997}]}]},{"osd":2,"up_from":123,"seq":528280977410,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30524,"kb_used_data":2284,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341316,"statfs":{"total":96636764160,"available":96605507584,"internally_reserved":0,"allocated":2338816,"data_stored":11039992,"data_compressed":614504,"data_compressed_allocated":454656,"data_compressed_original":9961472,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31256,"kb_used_data":4228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340584,"statfs":{"total":96636764160,"available":96604758016,"internally_reserved":0,"allocated":4329472,"data_stored":35297506,"data_compressed":2208995,"data_compressed_allocated":1974272,"data_compressed_original":33732212,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":0.83499999999999996,"15min":0.72899999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":17.597000000000001,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.85199999999999998}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.3879999999999999,"5min":0.85999999999999999,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":0.58299999999999996}]},{"osd":3,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":0.94999999999999996,"15min":0.84799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":17.638999999999999,"5min":17.638999999999999,"15min":17.638999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.8420000000000001,"5min":0.97699999999999998,"15min":0.83299999999999996},"min":{"1min":0.35099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":19.489999999999998,"5min":19.489999999999998,"15min":19.489999999999998},"last":1.1970000000000001}]},{"osd":4,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.095},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.85199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.91500000000000004,"15min":0.91300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.577,"5min":1.762,"15min":1.762},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.7070000000000001,"5min":1.167,"15min":1.077},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":14.198,"5min":14.198,"15min":14.198},"last":0.99399999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:42 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.671},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.75800000000000001}]},{"osd":7,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.1850000000000001,"15min":1.1020000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":14.234,"5min":14.234,"15min":14.234},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0209999999999999,"15min":1.0269999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.496}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63084,"kb_used_data":5720,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94308756,"statfs":{"total":96636764160,"available":96572166144,"internally_reserved":0,"allocated":5857280,"data_stored":43206023,"data_compressed":2432556,"data_compressed_allocated":2723840,"data_compressed_original":41139271,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.3380000000000001,"5min":1.829,"15min":1.829},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.274,"5min":2.25,"15min":2.25},"last":0.53100000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.22}]},{"osd":3,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72899999999999998,"15min":0.747},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.2589999999999999,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.63},{"interface":"front","average":{"1min":1,"5min":0.82599999999999996,"15min":0.79700000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":9.4220000000000006,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.72199999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.85599999999999998,"15min":0.879},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.042,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.93700000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.3140000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":1.0109999999999999}]},{"osd":5,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.47099999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9690000000000003,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.878},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.99199999999999999,"15min":1.0229999999999999},"min":{"1min":0.57799999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3069999999999999,"5min":1.911,"15min":1.911},"last":0.98799999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.93899999999999995}]},{"osd":7,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.98599999999999999,"15min":1.014},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.343,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0669999999999999,"15min":1.073},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.1080000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3932160,"data_stored":40305115,"data_compressed":2302948,"data_compressed_allocated":2572288,"data_compressed_original":39189575,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2818048,"data_stored":34580158,"data_compressed":2208995,"data_compressed_allocated":1974272,"data_compressed_original":33732212,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":10322663,"data_compressed":614504,"data_compressed_allocated":454656,"data_compressed_original":9961472,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3497984,"data_stored":36175928,"data_compressed":1943441,"data_compressed_allocated":2039808,"data_compressed_original":34855149,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4677632,"data_stored":51124229,"data_compressed":3257458,"data_compressed_allocated":3358720,"data_compressed_original":50047835,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4403200,"data_stored":46587903,"data_compressed":3050719,"data_compressed_allocated":3137536,"data_compressed_original":45577406,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":10710952,"data_compressed":623292,"data_compressed_allocated":708608,"data_compressed_original":10442709,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4112384,"data_stored":43378374,"data_compressed":2671201,"data_compressed_allocated":2732032,"data_compressed_original":42130093,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:16:02.302 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:16:02.346 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:02.342+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:02.370 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:02.371 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:02.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:16:02.430 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:02.426+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:02.515 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:02.510+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:02.550 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:02.550 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:02.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:16:02.616 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:02.614+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:02.642 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:16:02.659 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-18T05:16:02.591663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":676727708,"num_objects":1105,"num_object_clones":276,"num_object_copies":2210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":554,"num_read":176866,"num_read_kb":916863,"num_write":21001,"num_write_kb":365641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":19007930,"num_keys_recovered":109,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17618,"ondisk_log_size":17618,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":391684,"kb_used_data":37760,"kb_used_omap":29,"kb_used_meta":353762,"kb_avail":754583036,"statfs":{"total":773094113280,"available":772693028864,"internally_reserved":0,"allocated":38666240,"data_stored":286290061,"data_compressed":17113266,"data_compressed_allocated":17473536,"data_compressed_original":272617027,"omap_allocated":29988,"internal_metadata":362253020},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10229070,"num_objects":-10,"num_object_clones":-4,"num_object_copies":-20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10,"num_whiteouts":-4,"num_read":246,"num_read_kb":212,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001059"},"pg_stats":[{"pgid":"3.1f","version":"126'652","reported_seq":2616,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.233185+0000","last_change":"2024-09-18T05:15:57.233185+0000","last_active":"2024-09-18T05:15:57.233185+0000","last_peered":"2024-09-18T05:15:57.233185+0000","last_clean":"2024-09-18T05:15:57.233185+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:15:57.233185+0000","last_undegraded":"2024-09-18T05:15:57.233185+0000","last_fullsized":"2024-09-18T05:15:57.233185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0096302950000000005,"stat_sum":{"num_bytes":20625454,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":4058,"num_read_kb":20138,"num_write":873,"num_write_kb":9320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1e","version":"125'1371","reported_seq":6566,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.224328+0000","last_change":"2024-09-18T05:15:57.224328+0000","last_active":"2024-09-18T05:15:57.224328+0000","last_peered":"2024-09-18T05:15:57.224328+0000","last_clean":"2024-09-18T05:15:57.224328+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:15:57.224328+0000","last_undegraded":"2024-09-18T05:15:57.224328+0000","last_fullsized":"2024-09-18T05:15:57.224328+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1371,"log_dups_size":0,"ondisk_log_size":1371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0072432149999999999,"stat_sum":{"num_bytes":27749403,"num_objects":36,"num_object_clones":6,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":20,"num_read":11105,"num_read_kb":29015,"num_write":2165,"num_write_kb":10708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1d","version":"126'464","reported_seq":2453,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.243784+0000","last_change":"2024-09-18T05:15:57.246485+0000","last_active":"2024-09-18T05:15:57.243784+0000","last_peered":"2024-09-18T05:15:57.243784+0000","last_clean":"2024-09-18T05:15:57.243784+0000","last_became_active":"2024-09-18T05:14:56.215359+0000","last_became_peered":"2024-09-18T05:14:56.215359+0000","last_unstale":"2024-09-18T05:15:57.243784+0000","last_undegraded":"2024-09-18T05:15:57.243784+0000","last_fullsized":"2024-09-18T05:15:57.243784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:17:42.290269+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.020907096999999999,"stat_sum":{"num_bytes":9875585,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":22,"num_read":3379,"num_read_kb":19980,"num_write":482,"num_write_kb":11303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1c","version":"126'841","reported_seq":4308,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.385976+0000","last_change":"2024-09-18T05:15:57.241396+0000","last_active":"2024-09-18T05:15:57.385976+0000","last_peered":"2024-09-18T05:15:57.385976+0000","last_clean":"2024-09-18T05:15:57.385976+0000","last_became_active":"2024-09-18T05:14:56.212214+0000","last_became_peered":"2024-09-18T05:14:56.212214+0000","last_unstale":"2024-09-18T05:15:57.385976+0000","last_undegraded":"2024-09-18T05:15:57.385976+0000","last_fullsized":"2024-09-18T05:15:57.385976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:41.658356+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.015970496000000001,"stat_sum":{"num_bytes":26312856,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":19,"num_read":6744,"num_read_kb":32640,"num_write":1116,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1b","version":"126'374","reported_seq":2324,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.248486+0000","last_change":"2024-09-18T05:15:57.248486+0000","last_active":"2024-09-18T05:15:57.248486+0000","last_peered":"2024-09-18T05:15:57.248486+0000","last_clean":"2024-09-18T05:15:57.248486+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:15:57.248486+0000","last_undegraded":"2024-09-18T05:15:57.248486+0000","last_fullsized":"2024-09-18T05:15:57.248486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.024532393,"stat_sum":{"num_bytes":26274353,"num_objects":39,"num_object_clones":11,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":22,"num_read":2719,"num_read_kb":17097,"num_write":358,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.1a","version":"126'405","reported_seq":6059,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.404550+0000","last_change":"2024-09-18T05:15:57.233101+0000","last_active":"2024-09-18T05:15:57.404550+0000","last_peered":"2024-09-18T05:15:57.404550+0000","last_clean":"2024-09-18T05:15:57.404550+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:15:57.404550+0000","last_undegraded":"2024-09-18T05:15:57.404550+0000","last_fullsized":"2024-09-18T05:15:57.404550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0076472789999999999,"stat_sum":{"num_bytes":16078552,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":13,"num_read":5770,"num_read_kb":45619,"num_write":409,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.19","version":"126'493","reported_seq":5456,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.231493+0000","last_change":"2024-09-18T05:15:57.231493+0000","last_active":"2024-09-18T05:15:57.231493+0000","last_peered":"2024-09-18T05:15:57.231493+0000","last_clean":"2024-09-18T05:15:57.231493+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:15:57.231493+0000","last_undegraded":"2024-09-18T05:15:57.231493+0000","last_fullsized":"2024-09-18T05:15:57.231493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0051095170000000001,"stat_sum":{"num_bytes":30307704,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":7849,"num_read_kb":20409,"num_write":454,"num_write_kb":15035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.18","version":"126'821","reported_seq":2537,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.340955+0000","last_change":"2024-09-18T05:15:57.223783+0000","last_active":"2024-09-18T05:15:57.340955+0000","last_peered":"2024-09-18T05:15:57.340955+0000","last_clean":"2024-09-18T05:15:57.340955+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:15:57.340955+0000","last_undegraded":"2024-09-18T05:15:57.340955+0000","last_fullsized":"2024-09-18T05:15:57.340955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0069553999999999996,"stat_sum":{"num_bytes":24172070,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":20,"num_read":4159,"num_read_kb":22318,"num_write":1160,"num_write_kb":9141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.17","version":"126'530","reported_seq":6947,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.242948+0000","last_change":"2024-09-18T05:15:57.243285+0000","last_active":"2024-09-18T05:15:57.242948+0000","last_peered":"2024-09-18T05:15:57.242948+0000","last_clean":"2024-09-18T05:15:57.242948+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:15:57.242948+0000","last_undegraded":"2024-09-18T05:15:57.242948+0000","last_fullsized":"2024-09-18T05:15:57.242948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.019510564000000001,"stat_sum":{"num_bytes":24288012,"num_objects":37,"num_object_clones":13,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":19,"num_read":8102,"num_read_kb":32863,"num_write":449,"num_write_kb":10643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.16","version":"123'578","reported_seq":8006,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.223038+0000","last_change":"2024-09-18T05:15:57.223038+0000","last_active":"2024-09-18T05:15:57.223038+0000","last_peered":"2024-09-18T05:15:57.223038+0000","last_clean":"2024-09-18T05:15:57.223038+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:15:57.223038+0000","last_undegraded":"2024-09-18T05:15:57.223038+0000","last_fullsized":"2024-09-18T05:15:57.223038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055413399999999996,"stat_sum":{"num_bytes":35652137,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":19,"num_read":9215,"num_read_kb":47684,"num_write":624,"num_write_kb":15042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.15","version":"126'699","reported_seq":6784,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.319874+0000","last_change":"2024-09-18T05:15:57.235643+0000","last_active":"2024-09-18T05:15:57.319874+0000","last_peered":"2024-09-18T05:15:57.319874+0000","last_clean":"2024-09-18T05:15:57.319874+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:15:57.319874+0000","last_undegraded":"2024-09-18T05:15:57.319874+0000","last_fullsized":"2024-09-18T05:15:57.319874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.018139552,"stat_sum":{"num_bytes":42590976,"num_objects":44,"num_object_clones":13,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":19,"num_read":7996,"num_read_kb":49123,"num_write":1013,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.14","version":"126'375","reported_seq":2134,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.318465+0000","last_change":"2024-09-18T05:15:57.258228+0000","last_active":"2024-09-18T05:15:57.318465+0000","last_peered":"2024-09-18T05:15:57.318465+0000","last_clean":"2024-09-18T05:15:57.318465+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:15:57.318465+0000","last_undegraded":"2024-09-18T05:15:57.318465+0000","last_fullsized":"2024-09-18T05:15:57.318465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.032402056999999998,"stat_sum":{"num_bytes":18242033,"num_objects":37,"num_object_clones":8,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":2052,"num_read_kb":19658,"num_write":403,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.246463+0000","last_change":"2024-09-18T05:15:55.214834+0000","last_active":"2024-09-18T05:15:57.246463+0000","last_peered":"2024-09-18T05:15:57.246463+0000","last_clean":"2024-09-18T05:15:57.246463+0000","last_became_active":"2024-09-18T05:15:55.213947+0000","last_became_peered":"2024-09-18T05:15:55.213947+0000","last_unstale":"2024-09-18T05:15:57.246463+0000","last_undegraded":"2024-09-18T05:15:57.246463+0000","last_fullsized":"2024-09-18T05:15:57.246463+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:23.379787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"126'527","reported_seq":3521,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.335713+0000","last_change":"2024-09-18T05:15:57.239277+0000","last_active":"2024-09-18T05:15:57.335713+0000","last_peered":"2024-09-18T05:15:57.335713+0000","last_clean":"2024-09-18T05:15:57.335713+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:15:57.335713+0000","last_undegraded":"2024-09-18T05:15:57.335713+0000","last_fullsized":"2024-09-18T05:15:57.335713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.015619624,"stat_sum":{"num_bytes":18792135,"num_objects":28,"num_object_clones":6,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":16,"num_read":4560,"num_read_kb":29216,"num_write":664,"num_write_kb":13076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.307059+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:15:56.307059+0000","last_peered":"2024-09-18T05:15:56.307059+0000","last_clean":"2024-09-18T05:15:56.307059+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:15:56.307059+0000","last_undegraded":"2024-09-18T05:15:56.307059+0000","last_fullsized":"2024-09-18T05:15:56.307059+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"124'473","reported_seq":2681,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.236770+0000","last_change":"2024-09-18T05:15:57.236770+0000","last_active":"2024-09-18T05:15:57.236770+0000","last_peered":"2024-09-18T05:15:57.236770+0000","last_clean":"2024-09-18T05:15:57.236770+0000","last_became_active":"2024-09-18T05:13:45.882587+0000","last_became_peered":"2024-09-18T05:13:45.882587+0000","last_unstale":"2024-09-18T05:15:57.236770+0000","last_undegraded":"2024-09-18T05:15:57.236770+0000","last_fullsized":"2024-09-18T05:15:57.236770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:27:19.084581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018887101,"stat_sum":{"num_bytes":29398597,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":3402,"num_read_kb":32978,"num_write":574,"num_write_kb":10107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.309368+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:15:56.309368+0000","last_peered":"2024-09-18T05:15:56.309368+0000","last_clean":"2024-09-18T05:15:56.309368+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:15:56.309368+0000","last_undegraded":"2024-09-18T05:15:56.309368+0000","last_fullsized":"2024-09-18T05:15:56.309368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"126'387","reported_seq":5853,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.242177+0000","last_change":"2024-09-18T05:15:57.242177+0000","last_active":"2024-09-18T05:15:57.242177+0000","last_peered":"2024-09-18T05:15:57.242177+0000","last_clean":"2024-09-18T05:15:57.242177+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:15:57.242177+0000","last_undegraded":"2024-09-18T05:15:57.242177+0000","last_fullsized":"2024-09-18T05:15:57.242177+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:46.818280+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.015127885000000001,"stat_sum":{"num_bytes":31638481,"num_objects":32,"num_object_clones":5,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":15,"num_read":6526,"num_read_kb":27661,"num_write":412,"num_write_kb":9090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.307375+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:15:56.307375+0000","last_peered":"2024-09-18T05:15:56.307375+0000","last_clean":"2024-09-18T05:15:56.307375+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:15:56.307375+0000","last_undegraded":"2024-09-18T05:15:56.307375+0000","last_fullsized":"2024-09-18T05:15:56.307375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"126'428","reported_seq":5870,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.431280+0000","last_change":"2024-09-18T05:15:57.226875+0000","last_active":"2024-09-18T05:15:57.431280+0000","last_peered":"2024-09-18T05:15:57.431280+0000","last_clean":"2024-09-18T05:15:57.431280+0000","last_became_active":"2024-09-18T05:14:56.206206+0000","last_became_peered":"2024-09-18T05:14:56.206206+0000","last_unstale":"2024-09-18T05:15:57.431280+0000","last_undegraded":"2024-09-18T05:15:57.431280+0000","last_fullsized":"2024-09-18T05:15:57.431280+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:21.659467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096762610000000002,"stat_sum":{"num_bytes":13098884,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":18,"num_read":5834,"num_read_kb":39781,"num_write":437,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.3","version":"126'1054","reported_seq":4662,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.338171+0000","last_change":"2024-09-18T05:15:57.256775+0000","last_active":"2024-09-18T05:15:57.338171+0000","last_peered":"2024-09-18T05:15:57.338171+0000","last_clean":"2024-09-18T05:15:57.338171+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:15:57.338171+0000","last_undegraded":"2024-09-18T05:15:57.338171+0000","last_fullsized":"2024-09-18T05:15:57.338171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.031005069,"stat_sum":{"num_bytes":31572252,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":15,"num_read":6745,"num_read_kb":44150,"num_write":1363,"num_write_kb":19997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.2","version":"21'2","reported_seq":76,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.307083+0000","last_change":"2024-09-18T05:14:56.205729+0000","last_active":"2024-09-18T05:15:56.307083+0000","last_peered":"2024-09-18T05:15:56.307083+0000","last_clean":"2024-09-18T05:15:56.307083+0000","last_became_active":"2024-09-18T05:14:56.205340+0000","last_became_peered":"2024-09-18T05:14:56.205340+0000","last_unstale":"2024-09-18T05:15:56.307083+0000","last_undegraded":"2024-09-18T05:15:56.307083+0000","last_fullsized":"2024-09-18T05:15:56.307083+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:02:33.068329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"126'407","reported_seq":4582,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.330705+0000","last_change":"2024-09-18T05:15:57.237820+0000","last_active":"2024-09-18T05:15:57.330705+0000","last_peered":"2024-09-18T05:15:57.330705+0000","last_clean":"2024-09-18T05:15:57.330705+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:15:57.330705+0000","last_undegraded":"2024-09-18T05:15:57.330705+0000","last_fullsized":"2024-09-18T05:15:57.330705+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:12.320367+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011126802,"stat_sum":{"num_bytes":14467608,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":4850,"num_read_kb":21771,"num_write":377,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.217921+0000","last_change":"2024-09-18T05:15:55.216600+0000","last_active":"2024-09-18T05:15:57.217921+0000","last_peered":"2024-09-18T05:15:57.217921+0000","last_clean":"2024-09-18T05:15:57.217921+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:15:57.217921+0000","last_undegraded":"2024-09-18T05:15:57.217921+0000","last_fullsized":"2024-09-18T05:15:57.217921+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:42:31.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"126'328","reported_seq":2091,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.427884+0000","last_change":"2024-09-18T05:15:57.234359+0000","last_active":"2024-09-18T05:15:57.427884+0000","last_peered":"2024-09-18T05:15:57.427884+0000","last_clean":"2024-09-18T05:15:57.427884+0000","last_became_active":"2024-09-18T05:15:05.291649+0000","last_became_peered":"2024-09-18T05:15:05.291649+0000","last_unstale":"2024-09-18T05:15:57.427884+0000","last_undegraded":"2024-09-18T05:15:57.427884+0000","last_fullsized":"2024-09-18T05:15:57.427884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:59.933767+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011027288999999999,"stat_sum":{"num_bytes":5216089,"num_objects":33,"num_object_clones":10,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":17,"num_read":2104,"num_read_kb":5482,"num_write":348,"num_write_kb":5247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1107330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.309202+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:15:56.309202+0000","last_peered":"2024-09-18T05:15:56.309202+0000","last_clean":"2024-09-18T05:15:56.309202+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:15:56.309202+0000","last_undegraded":"2024-09-18T05:15:56.309202+0000","last_fullsized":"2024-09-18T05:15:56.309202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"126'529","reported_seq":4786,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.379303+0000","last_change":"2024-09-18T05:15:57.248656+0000","last_active":"2024-09-18T05:15:57.379303+0000","last_peered":"2024-09-18T05:15:57.379303+0000","last_clean":"2024-09-18T05:15:57.379303+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:15:57.379303+0000","last_undegraded":"2024-09-18T05:15:57.379303+0000","last_fullsized":"2024-09-18T05:15:57.379303+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:22:34.025479+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.022280362000000001,"stat_sum":{"num_bytes":30673317,"num_objects":31,"num_object_clones":7,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":14,"num_read":7044,"num_read_kb":38379,"num_write":530,"num_write_kb":10736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"2.3","version":"19'1","reported_seq":30,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.218076+0000","last_change":"2024-09-18T05:15:55.218072+0000","last_active":"2024-09-18T05:15:57.218076+0000","last_peered":"2024-09-18T05:15:57.218076+0000","last_clean":"2024-09-18T05:15:57.218076+0000","last_became_active":"2024-09-18T05:15:55.217766+0000","last_became_peered":"2024-09-18T05:15:55.217766+0000","last_unstale":"2024-09-18T05:15:57.218076+0000","last_undegraded":"2024-09-18T05:15:57.218076+0000","last_fullsized":"2024-09-18T05:15:57.218076+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:22:23.860200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":269,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-18T05:15:56.309291+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:15:56.309291+0000","last_peered":"2024-09-18T05:15:56.309291+0000","last_clean":"2024-09-18T05:15:56.309291+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:15:56.309291+0000","last_undegraded":"2024-09-18T05:15:56.309291+0000","last_fullsized":"2024-09-18T05:15:56.309291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"126'362","reported_seq":4902,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.391291+0000","last_change":"2024-09-18T05:15:57.236984+0000","last_active":"2024-09-18T05:15:57.391291+0000","last_peered":"2024-09-18T05:15:57.391291+0000","last_clean":"2024-09-18T05:15:57.391291+0000","last_became_active":"2024-09-18T05:15:05.292062+0000","last_became_peered":"2024-09-18T05:15:05.292062+0000","last_unstale":"2024-09-18T05:15:57.391291+0000","last_undegraded":"2024-09-18T05:15:57.391291+0000","last_fullsized":"2024-09-18T05:15:57.391291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:41:13.640268+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.010399659,"stat_sum":{"num_bytes":13333085,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":15,"num_read":6061,"num_read_kb":42276,"num_write":334,"num_write_kb":15919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":8331478,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.9","version":"126'268","reported_seq":4012,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.319449+0000","last_change":"2024-09-18T05:15:57.253034+0000","last_active":"2024-09-18T05:15:57.319449+0000","last_peered":"2024-09-18T05:15:57.319449+0000","last_clean":"2024-09-18T05:15:57.319449+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:15:57.319449+0000","last_undegraded":"2024-09-18T05:15:57.319449+0000","last_fullsized":"2024-09-18T05:15:57.319449+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:06:43.114897+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.027478361,"stat_sum":{"num_bytes":28614627,"num_objects":32,"num_object_clones":12,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":16,"num_read":3697,"num_read_kb":33449,"num_write":288,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.a","version":"126'599","reported_seq":2566,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-18T05:15:58.248591+0000","last_change":"2024-09-18T05:15:58.249152+0000","last_active":"2024-09-18T05:15:58.248591+0000","last_peered":"2024-09-18T05:15:58.248591+0000","last_clean":"2024-09-18T05:15:58.248591+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:15:58.248591+0000","last_undegraded":"2024-09-18T05:15:58.248591+0000","last_fullsized":"2024-09-18T05:15:58.248591+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091194599999999996,"stat_sum":{"num_bytes":9712143,"num_objects":26,"num_object_clones":6,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":13,"num_read":3568,"num_read_kb":18366,"num_write":730,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"18","length":"1a"}]},{"pgid":"3.b","version":"126'274","reported_seq":3205,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.320405+0000","last_change":"2024-09-18T05:15:57.236415+0000","last_active":"2024-09-18T05:15:57.320405+0000","last_peered":"2024-09-18T05:15:57.320405+0000","last_clean":"2024-09-18T05:15:57.320405+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:15:57.320405+0000","last_undegraded":"2024-09-18T05:15:57.320405+0000","last_fullsized":"2024-09-18T05:15:57.320405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.019308021000000002,"stat_sum":{"num_bytes":8695692,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":15,"num_read":2826,"num_read_kb":19519,"num_write":250,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.c","version":"126'447","reported_seq":5047,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.226286+0000","last_change":"2024-09-18T05:15:57.226286+0000","last_active":"2024-09-18T05:15:57.226286+0000","last_peered":"2024-09-18T05:15:57.226286+0000","last_clean":"2024-09-18T05:15:57.226286+0000","last_became_active":"2024-09-18T05:14:56.206142+0000","last_became_peered":"2024-09-18T05:14:56.206142+0000","last_unstale":"2024-09-18T05:15:57.226286+0000","last_undegraded":"2024-09-18T05:15:57.226286+0000","last_fullsized":"2024-09-18T05:15:57.226286+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:17:28.830425+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0092884890000000005,"stat_sum":{"num_bytes":20669291,"num_objects":32,"num_object_clones":10,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":18,"num_read":5187,"num_read_kb":29961,"num_write":516,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.d","version":"126'359","reported_seq":3398,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.431265+0000","last_change":"2024-09-18T05:15:57.235639+0000","last_active":"2024-09-18T05:15:57.431265+0000","last_peered":"2024-09-18T05:15:57.431265+0000","last_clean":"2024-09-18T05:15:57.431265+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:15:57.431265+0000","last_undegraded":"2024-09-18T05:15:57.431265+0000","last_fullsized":"2024-09-18T05:15:57.431265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.018110576,"stat_sum":{"num_bytes":8506884,"num_objects":24,"num_object_clones":5,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":10,"num_read":3839,"num_read_kb":17119,"num_write":356,"num_write_kb":12996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.e","version":"122'512","reported_seq":5556,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.354066+0000","last_change":"2024-09-18T05:15:57.228586+0000","last_active":"2024-09-18T05:15:57.354066+0000","last_peered":"2024-09-18T05:15:57.354066+0000","last_clean":"2024-09-18T05:15:57.354066+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:15:57.354066+0000","last_undegraded":"2024-09-18T05:15:57.354066+0000","last_fullsized":"2024-09-18T05:15:57.354066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011181147000000001,"stat_sum":{"num_bytes":37641762,"num_objects":57,"num_object_clones":14,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":34,"num_read":6544,"num_read_kb":34395,"num_write":542,"num_write_kb":4806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.f","version":"126'514","reported_seq":8809,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.236977+0000","last_change":"2024-09-18T05:15:57.237253+0000","last_active":"2024-09-18T05:15:57.236977+0000","last_peered":"2024-09-18T05:15:57.236977+0000","last_clean":"2024-09-18T05:15:57.236977+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:15:57.236977+0000","last_undegraded":"2024-09-18T05:15:57.236977+0000","last_fullsized":"2024-09-18T05:15:57.236977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.019777784999999999,"stat_sum":{"num_bytes":12393517,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":17,"num_read":9510,"num_read_kb":40428,"num_write":534,"num_write_kb":18331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.10","version":"126'613","reported_seq":3761,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-18T05:15:58.248441+0000","last_change":"2024-09-18T05:15:58.248930+0000","last_active":"2024-09-18T05:15:58.248441+0000","last_peered":"2024-09-18T05:15:58.248441+0000","last_clean":"2024-09-18T05:15:58.248441+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:15:58.248441+0000","last_undegraded":"2024-09-18T05:15:58.248441+0000","last_fullsized":"2024-09-18T05:15:58.248441+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079537499999999997,"stat_sum":{"num_bytes":29415686,"num_objects":32,"num_object_clones":6,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":17,"num_read":6800,"num_read_kb":30722,"num_write":729,"num_write_kb":9597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"18","length":"1a"}]},{"pgid":"3.11","version":"126'430","reported_seq":3654,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.228403+0000","last_change":"2024-09-18T05:15:57.228403+0000","last_active":"2024-09-18T05:15:57.228403+0000","last_peered":"2024-09-18T05:15:57.228403+0000","last_clean":"2024-09-18T05:15:57.228403+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:15:57.228403+0000","last_undegraded":"2024-09-18T05:15:57.228403+0000","last_fullsized":"2024-09-18T05:15:57.228403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0099601399999999993,"stat_sum":{"num_bytes":18657218,"num_objects":19,"num_object_clones":3,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":10,"num_read":4545,"num_read_kb":16351,"num_write":459,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.12","version":"126'595","reported_seq":2614,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.404546+0000","last_change":"2024-09-18T05:15:57.248649+0000","last_active":"2024-09-18T05:15:57.404546+0000","last_peered":"2024-09-18T05:15:57.404546+0000","last_clean":"2024-09-18T05:15:57.404546+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:15:57.404546+0000","last_undegraded":"2024-09-18T05:15:57.404546+0000","last_fullsized":"2024-09-18T05:15:57.404546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.024491533999999999,"stat_sum":{"num_bytes":4763206,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":17,"num_read":4441,"num_read_kb":15663,"num_write":692,"num_write_kb":7877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"19"}]},{"pgid":"3.13","version":"126'789","reported_seq":2886,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.228429+0000","last_change":"2024-09-18T05:15:57.228429+0000","last_active":"2024-09-18T05:15:57.228429+0000","last_peered":"2024-09-18T05:15:57.228429+0000","last_clean":"2024-09-18T05:15:57.228429+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:15:57.228429+0000","last_undegraded":"2024-09-18T05:15:57.228429+0000","last_fullsized":"2024-09-18T05:15:57.228429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.010055242000000001,"stat_sum":{"num_bytes":6707712,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":21,"num_read":5519,"num_read_kb":22552,"num_write":1199,"num_write_kb":8974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"19","length":"19"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":676137321,"num_objects":1101,"num_object_clones":276,"num_object_copies":2202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1101,"num_whiteouts":554,"num_read":176750,"num_read_kb":916763,"num_write":20840,"num_write_kb":363223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":19007930,"num_keys_recovered":109,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25321472,"data_stored":273185322,"data_compressed":16672558,"data_compressed_allocated":16977920,"data_compressed_original":265936451,"omap_allocated":6486,"internal_metadata":0},"log_size":17498,"ondisk_log_size":17498,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54892,"kb_used_data":5724,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316948,"statfs":{"total":96636764160,"available":96580554752,"internally_reserved":0,"allocated":5861376,"data_stored":46139854,"data_compressed":2794609,"data_compressed_allocated":2871296,"data_compressed_original":44079789,"omap_allocated":1589,"internal_metadata":50330059},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.85999999999999999,"15min":0.88800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1519999999999999,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.143},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0489999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.92100000000000004,"15min":0.93899999999999995},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7030000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.89700000000000002,"15min":0.92900000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97399999999999998,"5min":1.583,"15min":1.583},"last":0.745}]},{"osd":2,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.073,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.008,"15min":1.036},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2070000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.2929999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.86199999999999999,"15min":0.86699999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.823,"5min":1.925,"15min":1.925},"last":1.099},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.04,"15min":1.0589999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.232,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.0589999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.0580000000000001,"15min":1.097},"min":{"1min":0.46100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.522,"5min":3.488,"15min":3.488},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.92600000000000005,"15min":0.95099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1910000000000001,"5min":2.512,"15min":2.512},"last":1.248}]},{"osd":5,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.1399999999999999,"15min":1.173},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.1539999999999999,"5min":3.069,"15min":3.069},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.1100000000000001,"15min":1.131},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":1.04}]},{"osd":6,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.452}]}]},{"osd":6,"up_from":61,"seq":261993005073,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34848,"kb_used_data":2508,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94336992,"statfs":{"total":96636764160,"available":96601079808,"internally_reserved":0,"allocated":2568192,"data_stored":11434616,"data_compressed":623292,"data_compressed_allocated":708608,"data_compressed_original":10442709,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.96199999999999997}]},{"osd":1,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.036}]},{"osd":5,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.214}]},{"osd":7,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.1639999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":5952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":6094848,"data_stored":47530373,"data_compressed":3054437,"data_compressed_allocated":3149824,"data_compressed_original":45651134,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3080000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1020000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.80700000000000005,"15min":0.82799999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.77300000000000002}]},{"osd":3,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.143,"5min":1.502,"15min":1.502},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90200000000000002,"15min":0.91400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2549999999999999,"5min":1.804,"15min":1.804},"last":0.73699999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.84799999999999998,"15min":0.81000000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.2350000000000003,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.871,"15min":0.873},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.274,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.84299999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.95499999999999996}]},{"osd":7,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.998,"5min":0.99199999999999999,"15min":0.99099999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.98399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59716,"kb_used_data":6456,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94312124,"statfs":{"total":96636764160,"available":96575614976,"internally_reserved":0,"allocated":6610944,"data_stored":54748440,"data_compressed":3441432,"data_compressed_allocated":3551232,"data_compressed_original":52755291,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.84799999999999998,"15min":0.875},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.198,"5min":2.827,"15min":2.827},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.91500000000000004}]},{"osd":1,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1060000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93300000000000005,"15min":0.96799999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0669999999999999,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.80700000000000005}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1859999999999999,"5min":1.365,"15min":1.365},"last":0.56100000000000005}]},{"osd":3,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.012,"5min":1.133,"15min":1.133},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93400000000000005,"15min":0.92500000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.282,"5min":4.282,"15min":4.282},"last":0.748}]},{"osd":5,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.77000000000000002}]},{"osd":6,"last update":"Wed Sep 18 05:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85799999999999998}]},{"osd":7,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.84699999999999998,"15min":0.83899999999999997},"min":{"1min":0.45900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.873,"5min":0.997,"15min":1.018},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80296,"kb_used_data":4888,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94291544,"statfs":{"total":96636764160,"available":96554541056,"internally_reserved":0,"allocated":5005312,"data_stored":36893257,"data_compressed":1943441,"data_compressed_allocated":2039808,"data_compressed_original":34855149,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.623,"15min":0.63500000000000001},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.98199999999999998,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.997}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":1.149},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82899999999999996,"15min":0.84499999999999997},"min":{"1min":0.46899999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1679999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.92000000000000004,"15min":0.93799999999999994},"min":{"1min":0.48199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.294,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.85199999999999998,"15min":0.86699999999999999},"min":{"1min":0.50900000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.133,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.89900000000000002,"15min":0.91900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3220000000000001,"5min":1.373,"15min":1.373},"last":0.71499999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.89400000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.995,"15min":1.0189999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2809999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.04},{"interface":"front","average":{"1min":0.85899999999999999,"5min":1.0309999999999999,"15min":1.0600000000000001},"min":{"1min":0.57099999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.321,"5min":2.722,"15min":2.722},"last":0.96599999999999997}]}]},{"osd":2,"up_from":123,"seq":528280977410,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30524,"kb_used_data":2284,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341316,"statfs":{"total":96636764160,"available":96605507584,"internally_reserved":0,"allocated":2338816,"data_stored":11039992,"data_compressed":614504,"data_compressed_allocated":454656,"data_compressed_original":9961472,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31256,"kb_used_data":4228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340584,"statfs":{"total":96636764160,"available":96604758016,"internally_reserved":0,"allocated":4329472,"data_stored":35297506,"data_compressed":2208995,"data_compressed_allocated":1974272,"data_compressed_original":33732212,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":0.83499999999999996,"15min":0.72899999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":17.597000000000001,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.85199999999999998}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.3879999999999999,"5min":0.85999999999999999,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":0.58299999999999996}]},{"osd":3,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":0.94999999999999996,"15min":0.84799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":17.638999999999999,"5min":17.638999999999999,"15min":17.638999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.8420000000000001,"5min":0.97699999999999998,"15min":0.83299999999999996},"min":{"1min":0.35099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":19.489999999999998,"5min":19.489999999999998,"15min":19.489999999999998},"last":1.1970000000000001}]},{"osd":4,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.095},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.85199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.91500000000000004,"15min":0.91300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.577,"5min":1.762,"15min":1.762},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.7070000000000001,"5min":1.167,"15min":1.077},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":14.198,"5min":14.198,"15min":14.198},"last":0.99399999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:42 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.671},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.75800000000000001}]},{"osd":7,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.1850000000000001,"15min":1.1020000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":14.234,"5min":14.234,"15min":14.234},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0209999999999999,"15min":1.0269999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.496}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63084,"kb_used_data":5720,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94308756,"statfs":{"total":96636764160,"available":96572166144,"internally_reserved":0,"allocated":5857280,"data_stored":43206023,"data_compressed":2432556,"data_compressed_allocated":2723840,"data_compressed_original":41139271,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.3380000000000001,"5min":1.829,"15min":1.829},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.274,"5min":2.25,"15min":2.25},"last":0.53100000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.22}]},{"osd":3,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72899999999999998,"15min":0.747},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.2589999999999999,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.63},{"interface":"front","average":{"1min":1,"5min":0.82599999999999996,"15min":0.79700000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":9.4220000000000006,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.72199999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.85599999999999998,"15min":0.879},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.042,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.93700000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.3140000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":1.0109999999999999}]},{"osd":5,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.47099999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9690000000000003,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.878},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.99199999999999999,"15min":1.0229999999999999},"min":{"1min":0.57799999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3069999999999999,"5min":1.911,"15min":1.911},"last":0.98799999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.93899999999999995}]},{"osd":7,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.98599999999999999,"15min":1.014},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.343,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0669999999999999,"15min":1.073},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.1080000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3932160,"data_stored":40305115,"data_compressed":2302948,"data_compressed_allocated":2572288,"data_compressed_original":39189575,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2818048,"data_stored":34580158,"data_compressed":2208995,"data_compressed_allocated":1974272,"data_compressed_original":33732212,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":10322663,"data_compressed":614504,"data_compressed_allocated":454656,"data_compressed_original":9961472,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3497984,"data_stored":36175928,"data_compressed":1943441,"data_compressed_allocated":2039808,"data_compressed_original":34855149,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4677632,"data_stored":51124229,"data_compressed":3257458,"data_compressed_allocated":3358720,"data_compressed_original":50047835,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4403200,"data_stored":46587903,"data_compressed":3050719,"data_compressed_allocated":3137536,"data_compressed_original":45577406,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":10710952,"data_compressed":623292,"data_compressed_allocated":708608,"data_compressed_original":10442709,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4112384,"data_stored":43378374,"data_compressed":2671201,"data_compressed_allocated":2732032,"data_compressed_original":42130093,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:16:02.662 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-18T05:16:02.662 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:16:02.662 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-18T05:16:02.662 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T05:16:02.683 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:02.683 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:02.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:16:02.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:02.734+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:02.755 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:16:02.818 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:02.814+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:02.852 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:02.852 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:02.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:16:02.902 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:16:02.919 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:02.914+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:02.926 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:02.926 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:02.945 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:02.946 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:02.962 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:02.963 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:02.964 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:02.964 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:02.964 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 132, 2024-09-18T05:16:02.964 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "04ac0d2c-34bd-46ad-a307-a4eb23236eb4", 2024-09-18T05:16:02.964 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-18T05:13:15.193498+0000", 2024-09-18T05:16:02.964 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-18T05:16:02.890986+0000", 2024-09-18T05:16:02.964 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-18T05:15:54.176883+0000", 2024-09-18T05:16:02.964 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-18T05:13:18.221936+0000", 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5804032, 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "nodeep-scrub", 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 6, 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T05:16:02.965 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "luminous", 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-18T05:16:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:28.629114+0000", 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-18T05:16:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "17", 2024-09-18T05:16:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:16:02.969 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:16:02.970 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:16:02.970 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:16:02.970 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:16:02.971 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:16:02.972 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-18T05:16:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.904327392578125, 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:34.103981+0000", 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:16:02.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-18T05:16:02.975 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "21", 2024-09-18T05:16:02.976 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 3, 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 21, 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:16:02.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:16:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:16:02.979 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2.9900000095367432, 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2.9900000095367432, 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2.630000114440918, 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2.630000114440918, 2024-09-18T05:16:02.980 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.904327392578125, 2024-09-18T05:16:02.981 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-18T05:16:02.981 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-18T05:16:02.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.981 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:16:02.981 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-18T05:16:02.981 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:44.114945+0000", 2024-09-18T05:16:02.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:16:02.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:16:02.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:16:02.982 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:16:02.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:16:02.982 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:16:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:16:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:16:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:16:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:16:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:16:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:16:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-18T05:16:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "132", 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 77, 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 132, 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:16:02.985 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:16:02.986 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:16:02.987 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.988 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.904327392578125, 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "a2a580f7-2bbc-46c3-b6b5-5a9e93539d27", 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 130, 2024-09-18T05:16:02.990 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.991 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:02.992 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:02.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1558450642", 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1558450642", 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1558450642", 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1558450642", 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.995 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "260da429-e6eb-446b-95a0-dcf4581bb584", 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 129, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:02.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3444575073", 2024-09-18T05:16:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3444575073", 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3444575073", 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3444575073", 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "0cf5d53a-552d-4775-8437-86af3465b1bc", 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:03.001 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 13, 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 100, 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 123, 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 123, 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 101, 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.005 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-18T05:16:03.005 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:03.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:03.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/1738914066", 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/1738914066", 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/1738914066", 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/1738914066", 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:03.007 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "73bc18b6-4972-4164-a294-b6372bcf9f9d", 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:03.008 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 130, 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2024-09-18T05:16:03.009 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2024-09-18T05:16:03.010 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2024-09-18T05:16:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2024-09-18T05:16:03.012 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/3763834627", 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/3763834627", 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/3763834627", 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/3763834627", 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.013 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "536c8ef2-eca6-44b4-a70c-06f191eb5ff1", 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 123, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6800", 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6802", 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6804", 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6806", 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:03.016 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6815", 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6819", 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:03.017 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6809", 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6812", 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6802/1703780253", 2024-09-18T05:16:03.018 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6806/1703780253", 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6819/1703780253", 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6812/1703780253", 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "4341bba4-2913-4352-89d4-36fa18ee39cb", 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:03.019 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 0.234619140625, 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 101, 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6808", 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:03.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6811", 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6813", 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6816", 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6822", 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6823", 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6817", 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:03.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6820", 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6811/3348904742", 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6816/3348904742", 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6823/3348904742", 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6820/3348904742", 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:03.024 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "e47d4aad-9c4b-43a9-9b32-2db463ec2a20", 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 13, 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 47, 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 61, 2024-09-18T05:16:03.025 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 131, 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 48, 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6801", 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6803", 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:03.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6805", 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6807", 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:03.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6818", 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6821", 2024-09-18T05:16:03.028 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6810", 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6814", 2024-09-18T05:16:03.029 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6803/3446120186", 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6807/3446120186", 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6821/3446120186", 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6814/3446120186", 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.030 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "686d275c-e592-44c1-87f9-ac9718f3a112", 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 48, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6824", 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6825", 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6826", 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6827", 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6830", 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6831", 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6828", 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6829", 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6825/1345159853", 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6827/1345159853", 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6831/1345159853", 2024-09-18T05:16:03.035 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6829/1345159853", 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:03.036 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.758535+0000", 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.800715+0000", 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.783374+0000", 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 101 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:03.038 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.779519+0000", 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.893837+0000", 2024-09-18T05:16:03.039 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.776852+0000", 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.040 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.919808+0000", 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 48 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:03.041 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.883599+0000", 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [ 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "3.2", 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: 1, 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: 5 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:03.042 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [ 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "3.f", 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 7, 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 3 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-18T05:16:03.043 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [ 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:16:03.044 INFO:teuthology.orchestra.run.smithi017.stdout: "snaps": [ 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: "begin": 22, 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: "length": 7 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [ 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: "snaps": [ 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: "begin": 22, 2024-09-18T05:16:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: "length": 1 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-18T05:16:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.047 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:03.047 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:03.048 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:03.050 INFO:tasks.thrashosds.thrasher:j is {'epoch': 132, 'fsid': '04ac0d2c-34bd-46ad-a307-a4eb23236eb4', 'created': '2024-09-18T05:13:15.193498+0000', 'modified': '2024-09-18T05:16:02.890986+0000', 'last_up_change': '2024-09-18T05:15:54.176883+0000', 'last_in_change': '2024-09-18T05:13:18.221936+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T05:13:28.629114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.904327392578125, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T05:13:34.103981+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.904327392578125, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T05:13:44.114945+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 77, 'snap_epoch': 132, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.904327392578125, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': 'a2a580f7-2bbc-46c3-b6b5-5a9e93539d27', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1558450642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1558450642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1558450642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1558450642}]}, 'public_addr': '172.21.15.17:6801/1558450642', 'cluster_addr': '172.21.15.17:6803/1558450642', 'heartbeat_back_addr': '172.21.15.17:6807/1558450642', 'heartbeat_front_addr': '172.21.15.17:6805/1558450642', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '260da429-e6eb-446b-95a0-dcf4581bb584', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 129, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3444575073}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3444575073}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3444575073}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3444575073}]}, 'public_addr': '172.21.15.17:6809/3444575073', 'cluster_addr': '172.21.15.17:6811/3444575073', 'heartbeat_back_addr': '172.21.15.17:6815/3444575073', 'heartbeat_front_addr': '172.21.15.17:6813/3444575073', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0cf5d53a-552d-4775-8437-86af3465b1bc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 100, 'up_from': 123, 'up_thru': 123, 'down_at': 101, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 1738914066}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 1738914066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 1738914066}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 1738914066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 1738914066}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 1738914066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 1738914066}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 1738914066}]}, 'public_addr': '172.21.15.17:6817/1738914066', 'cluster_addr': '172.21.15.17:6819/1738914066', 'heartbeat_back_addr': '172.21.15.17:6823/1738914066', 'heartbeat_front_addr': '172.21.15.17:6821/1738914066', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '73bc18b6-4972-4164-a294-b6372bcf9f9d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6824', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6825', 'nonce': 3763834627}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6826', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6827', 'nonce': 3763834627}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6830', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6831', 'nonce': 3763834627}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6828', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6829', 'nonce': 3763834627}]}, 'public_addr': '172.21.15.17:6825/3763834627', 'cluster_addr': '172.21.15.17:6827/3763834627', 'heartbeat_back_addr': '172.21.15.17:6831/3763834627', 'heartbeat_front_addr': '172.21.15.17:6829/3763834627', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '536c8ef2-eca6-44b4-a70c-06f191eb5ff1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 123, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6802', 'nonce': 1703780253}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6806', 'nonce': 1703780253}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6815', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 1703780253}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6809', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6812', 'nonce': 1703780253}]}, 'public_addr': '172.21.15.86:6802/1703780253', 'cluster_addr': '172.21.15.86:6806/1703780253', 'heartbeat_back_addr': '172.21.15.86:6819/1703780253', 'heartbeat_front_addr': '172.21.15.86:6812/1703780253', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4341bba4-2913-4352-89d4-36fa18ee39cb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.234619140625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 3348904742}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6813', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6816', 'nonce': 3348904742}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6823', 'nonce': 3348904742}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6817', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6820', 'nonce': 3348904742}]}, 'public_addr': '172.21.15.86:6811/3348904742', 'cluster_addr': '172.21.15.86:6816/3348904742', 'heartbeat_back_addr': '172.21.15.86:6823/3348904742', 'heartbeat_front_addr': '172.21.15.86:6820/3348904742', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e47d4aad-9c4b-43a9-9b32-2db463ec2a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 47, 'up_from': 61, 'up_thru': 131, 'down_at': 48, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6801', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 3446120186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6805', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 3446120186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 3446120186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6814', 'nonce': 3446120186}]}, 'public_addr': '172.21.15.86:6803/3446120186', 'cluster_addr': '172.21.15.86:6807/3446120186', 'heartbeat_back_addr': '172.21.15.86:6821/3446120186', 'heartbeat_front_addr': '172.21.15.86:6814/3446120186', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '686d275c-e592-44c1-87f9-ac9718f3a112', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 1345159853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6826', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 1345159853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6830', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 1345159853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6829', 'nonce': 1345159853}]}, 'public_addr': '172.21.15.86:6825/1345159853', 'cluster_addr': '172.21.15.86:6827/1345159853', 'heartbeat_back_addr': '172.21.15.86:6831/1345159853', 'heartbeat_front_addr': '172.21.15.86:6829/1345159853', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.758535+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.800715+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.783374+0000', 'dead_epoch': 101}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.779519+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.893837+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.776852+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.919808+0000', 'dead_epoch': 48}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.883599+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.2', 'osds': [1, 5]}], 'pg_upmap_items': [{'pgid': '3.f', 'mappings': [{'from': 7, 'to': 3}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 22, 'length': 7}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 22, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T05:16:03.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:16:03.051 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:03.051 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:16:03.051 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:16:03.051 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:03.052 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:03.052 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:03.053 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:16:03.053 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:03.053 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:03.054 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:03.042+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:03.054 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:03.069 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:03.070 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:03.148 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:03.142+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:16:03.183 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:16:03.184 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:03.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:16:03.250 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:03.246+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:03.351 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:03.346+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:03.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:03.366 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:16:03.368 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.370 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77168 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2203648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.271878376999993, 2024-09-18T05:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049653801999999997, 2024-09-18T05:16:03.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77168 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087449+0000", 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087448+0000", 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087454+0000", 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2539999999999998e-06 2024-09-18T05:16:03.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087471+0000", 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6912999999999999e-05 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.087484+0000", 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2517000000000001e-05 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.131161+0000", 2024-09-18T05:16:03.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.043676751999999999 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.134176+0000", 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030155300000000002 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137103+0000", 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029268459999999999 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77182 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2289664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.271023827999997, 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048114297, 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77182 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088304+0000", 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088303+0000", 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088309+0000", 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5969999999999997e-06 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088330+0000", 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1339999999999999e-05 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088365+0000", 2024-09-18T05:16:03.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5036000000000001e-05 2024-09-18T05:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136187+0000", 2024-09-18T05:16:03.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047821474000000003 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136288+0000", 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010091599999999999 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136418+0000", 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013007700000000001 2024-09-18T05:16:03.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77183 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2330624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.270949927999993, 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048282688999999997, 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77183 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088378+0000", 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088377+0000", 2024-09-18T05:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088383+0000", 2024-09-18T05:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9029999999999998e-06 2024-09-18T05:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088404+0000", 2024-09-18T05:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996999999999999e-05 2024-09-18T05:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088420+0000", 2024-09-18T05:16:03.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5353e-05 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136450+0000", 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048030394999999997 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136554+0000", 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103442 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136660+0000", 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010664500000000001 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77188 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2129920~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.270548938000005, 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048117532999999997, 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.386 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77188 2024-09-18T05:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088779+0000", 2024-09-18T05:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088778+0000", 2024-09-18T05:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088784+0000", 2024-09-18T05:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8000000000000001e-06 2024-09-18T05:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088802+0000", 2024-09-18T05:16:03.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.808e-05 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088835+0000", 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2846999999999999e-05 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136693+0000", 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047858165000000001 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136783+0000", 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9862000000000001e-05 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136896+0000", 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112792 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.392 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77190 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2170880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.270384214000003, 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048251255, 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77190 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088943+0000", 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088942+0000", 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:03.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088973+0000", 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0737000000000001e-05 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.088996+0000", 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3013000000000001e-05 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089023+0000", 2024-09-18T05:16:03.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7183e-05 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.136930+0000", 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.047907155 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137033+0000", 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103205 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137195+0000", 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016126899999999999 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77192 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2211840~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.270236548, 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048391998999999998, 2024-09-18T05:16:03.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77192 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089091+0000", 2024-09-18T05:16:03.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089090+0000", 2024-09-18T05:16:03.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:03.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089096+0000", 2024-09-18T05:16:03.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7769999999999997e-06 2024-09-18T05:16:03.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089113+0000", 2024-09-18T05:16:03.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6379999999999999e-05 2024-09-18T05:16:03.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089130+0000", 2024-09-18T05:16:03.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7730000000000001e-05 2024-09-18T05:16:03.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137239+0000", 2024-09-18T05:16:03.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048108962999999998 2024-09-18T05:16:03.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137342+0000", 2024-09-18T05:16:03.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010229399999999999 2024-09-18T05:16:03.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137483+0000", 2024-09-18T05:16:03.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000141235 2024-09-18T05:16:03.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.404 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.405 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77193 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2252800~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.405 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:16:03.405 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.270185084000005, 2024-09-18T05:16:03.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048619480999999999, 2024-09-18T05:16:03.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77193 2024-09-18T05:16:03.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.407 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:16:03.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089142+0000", 2024-09-18T05:16:03.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089141+0000", 2024-09-18T05:16:03.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089158+0000", 2024-09-18T05:16:03.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6362999999999999e-05 2024-09-18T05:16:03.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089178+0000", 2024-09-18T05:16:03.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0469999999999999e-05 2024-09-18T05:16:03.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089192+0000", 2024-09-18T05:16:03.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4204e-05 2024-09-18T05:16:03.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137535+0000", 2024-09-18T05:16:03.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048342382000000003 2024-09-18T05:16:03.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137639+0000", 2024-09-18T05:16:03.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104042 2024-09-18T05:16:03.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137762+0000", 2024-09-18T05:16:03.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012304699999999999 2024-09-18T05:16:03.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.413 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.414 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77194 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2293760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.414 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:16:03.414 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.270121308, 2024-09-18T05:16:03.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048842564999999998, 2024-09-18T05:16:03.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77194 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089206+0000", 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089205+0000", 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089212+0000", 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5100000000000004e-06 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089229+0000", 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7263000000000001e-05 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089242+0000", 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3027000000000001e-05 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137800+0000", 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048558220999999999 2024-09-18T05:16:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.137928+0000", 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128183 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138049+0000", 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120387 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77195 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2334720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.270074068, 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049100602, 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77195 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089253+0000", 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089252+0000", 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089258+0000", 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0929999999999999e-06 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089276+0000", 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.719e-05 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089291+0000", 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5347000000000001e-05 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138091+0000", 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048800518000000001 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138223+0000", 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000131889 2024-09-18T05:16:03.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138354+0000", 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013071099999999999 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77202 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2134016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:16:03.424 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.269648184999994, 2024-09-18T05:16:03.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048921765999999998, 2024-09-18T05:16:03.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.425 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.425 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.425 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77202 2024-09-18T05:16:03.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.426 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:16:03.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089679+0000", 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089677+0000", 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089695+0000", 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.804e-05 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089735+0000", 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0080000000000003e-05 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089748+0000", 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2493e-05 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138392+0000", 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048644219000000002 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138489+0000", 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6836999999999995e-05 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138601+0000", 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112494 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77203 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2174976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.269570944999998, 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049108851000000002, 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77203 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089757+0000", 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089756+0000", 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089761+0000", 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1000000000000003e-06 2024-09-18T05:16:03.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089770+0000", 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7399999999999999e-06 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089777+0000", 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9299999999999997e-06 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138641+0000", 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048863453000000001 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138737+0000", 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5828000000000005e-05 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138865+0000", 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128804 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77204 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2215936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.269544221999993, 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049349094000000003, 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77204 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:16:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:16:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089783+0000", 2024-09-18T05:16:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089786+0000", 2024-09-18T05:16:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4529999999999998e-06 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089795+0000", 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4130000000000006e-06 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089801+0000", 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8600000000000004e-06 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.138903+0000", 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049101643 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139001+0000", 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7707000000000005e-05 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139132+0000", 2024-09-18T05:16:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013160099999999999 2024-09-18T05:16:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77205 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2256896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:16:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.269520331999999, 2024-09-18T05:16:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049589756999999998, 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77205 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:16:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:16:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089807+0000", 2024-09-18T05:16:03.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:03.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089825+0000", 2024-09-18T05:16:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8340000000000001e-05 2024-09-18T05:16:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089842+0000", 2024-09-18T05:16:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6606999999999999e-05 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089854+0000", 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.292e-05 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139170+0000", 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049315335000000002 2024-09-18T05:16:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139269+0000", 2024-09-18T05:16:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9339000000000006e-05 2024-09-18T05:16:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139397+0000", 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127806 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77206 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2297856~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.269460828999996, 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049792218999999999, 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77206 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:16:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089867+0000", 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089866+0000", 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089872+0000", 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9599999999999997e-06 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089888+0000", 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-05 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089920+0000", 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890000000000001e-05 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139435+0000", 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049514916999999999 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139530+0000", 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4847999999999997e-05 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139659+0000", 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012879999999999999 2024-09-18T05:16:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:77207 3.4 3:243b5c3e:::rbd_data.118beb272ca1.000000000000000a:22 [read 2338816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.269388828999993, 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04998259, 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 77207 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089939+0000", 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089937+0000", 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089944+0000", 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1899999999999998e-06 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089963+0000", 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8623000000000001e-05 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.089976+0000", 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3203999999999999e-05 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139698+0000", 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.049722211000000002 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139796+0000", 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7200000000000004e-05 2024-09-18T05:16:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:59.139921+0000", 2024-09-18T05:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012560499999999999 2024-09-18T05:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104467 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.092036129, 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63367687500000003, 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104467 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267291+0000", 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267289+0000", 2024-09-18T05:16:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267300+0000", 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0382e-05 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267326+0000", 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5850000000000002e-05 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267339+0000", 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3754000000000001e-05 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267425+0000", 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5544999999999995e-05 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267444+0000", 2024-09-18T05:16:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8947999999999999e-05 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900405+0000", 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63296088699999997 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900624+0000", 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219466 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.900968+0000", 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034406500000000001 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104468 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.091943950999998, 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63418863999999997, 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104468 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267384+0000", 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267382+0000", 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267390+0000", 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.028e-06 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267406+0000", 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5446000000000001e-05 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267419+0000", 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3514e-05 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8612e-05 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267503+0000", 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4714e-05 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901334+0000", 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.633831747 2024-09-18T05:16:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901437+0000", 2024-09-18T05:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010287499999999999 2024-09-18T05:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901572+0000", 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013484799999999999 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104469 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 2359296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.091897431, 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63443118099999996, 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104469 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267430+0000", 2024-09-18T05:16:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267429+0000", 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267435+0000", 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2100000000000001e-06 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267447+0000", 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2532e-05 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267457+0000", 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0010000000000001e-05 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267545+0000", 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7627999999999995e-05 2024-09-18T05:16:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267559+0000", 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3963e-05 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901627+0000", 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63406880399999999 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901723+0000", 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5629000000000002e-05 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901861+0000", 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013816499999999999 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104470 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 3211264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:16:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.091839106999998, 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.634540459, 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104470 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267488+0000", 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267493+0000", 2024-09-18T05:16:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5280000000000003e-06 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267509+0000", 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5517999999999999e-05 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267518+0000", 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7030000000000001e-06 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267607+0000", 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9202000000000004e-05 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267620+0000", 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2612999999999999e-05 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901913+0000", 2024-09-18T05:16:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63429272599999997 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.901965+0000", 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2391e-05 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902029+0000", 2024-09-18T05:16:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3626000000000004e-05 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:104471 3.2 3:4631e6e0:::rbd_data.118bbb54c949.0000000000000004:2b [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.091788168000001, 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63472597500000005, 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 104471 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267539+0000", 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267544+0000", 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2379999999999997e-06 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267557+0000", 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3020000000000001e-05 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267566+0000", 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.38e-06 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267658+0000", 2024-09-18T05:16:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1852000000000001e-05 2024-09-18T05:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.267670+0000", 2024-09-18T05:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.224e-05 2024-09-18T05:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902059+0000", 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.63438875900000002 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902124+0000", 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5374000000000001e-05 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:17.902265+0000", 2024-09-18T05:16:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140922 2024-09-18T05:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.486 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:03.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:16:03.488 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-18T05:16:02.894057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":606127560,"num_objects":1077,"num_object_clones":266,"num_object_copies":2154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1077,"num_whiteouts":552,"num_read":177482,"num_read_kb":917387,"num_write":21079,"num_write_kb":365662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":542,"num_bytes_recovered":26896232,"num_keys_recovered":130,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17725,"ondisk_log_size":17725,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":395412,"kb_used_data":37380,"kb_used_omap":29,"kb_used_meta":357858,"kb_avail":754579308,"statfs":{"total":773094113280,"available":772689211392,"internally_reserved":0,"allocated":38277120,"data_stored":290874151,"data_compressed":17365061,"data_compressed_allocated":17588224,"data_compressed_original":277716547,"omap_allocated":29988,"internal_metadata":366447324},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-70600148,"num_objects":-28,"num_object_clones":-10,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":-2,"num_read":616,"num_read_kb":524,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":7888302,"num_keys_recovered":21,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.651270"},"pg_stats":[{"pgid":"3.1f","version":"126'652","reported_seq":2632,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.894612+0000","last_change":"2024-09-18T05:16:00.901891+0000","last_active":"2024-09-18T05:16:01.894612+0000","last_peered":"2024-09-18T05:16:01.894612+0000","last_clean":"2024-09-18T05:16:01.894612+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:16:01.894612+0000","last_undegraded":"2024-09-18T05:16:01.894612+0000","last_fullsized":"2024-09-18T05:16:01.894612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010693670000000001,"stat_sum":{"num_bytes":20625454,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":4062,"num_read_kb":20140,"num_write":873,"num_write_kb":9320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.1e","version":"129'1375","reported_seq":6585,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.900164+0000","last_change":"2024-09-18T05:16:00.900164+0000","last_active":"2024-09-18T05:16:00.900164+0000","last_peered":"2024-09-18T05:16:00.900164+0000","last_clean":"2024-09-18T05:16:00.900164+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:16:00.900164+0000","last_undegraded":"2024-09-18T05:16:00.900164+0000","last_fullsized":"2024-09-18T05:16:00.900164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00608516,"stat_sum":{"num_bytes":17787868,"num_objects":33,"num_object_clones":5,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":20,"num_read":11107,"num_read_kb":29016,"num_write":2167,"num_write_kb":10708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.1d","version":"126'464","reported_seq":2467,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.913220+0000","last_change":"2024-09-18T05:16:00.913220+0000","last_active":"2024-09-18T05:16:00.913220+0000","last_peered":"2024-09-18T05:16:00.913220+0000","last_clean":"2024-09-18T05:16:00.913220+0000","last_became_active":"2024-09-18T05:14:56.215359+0000","last_became_peered":"2024-09-18T05:14:56.215359+0000","last_unstale":"2024-09-18T05:16:00.913220+0000","last_undegraded":"2024-09-18T05:16:00.913220+0000","last_fullsized":"2024-09-18T05:16:00.913220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:17:42.290269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041802109999999996,"stat_sum":{"num_bytes":9875585,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":22,"num_read":3379,"num_read_kb":19980,"num_write":482,"num_write_kb":11303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.1c","version":"130'855","reported_seq":4375,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.933158+0000","last_change":"2024-09-18T05:16:00.912512+0000","last_active":"2024-09-18T05:16:01.933158+0000","last_peered":"2024-09-18T05:16:01.933158+0000","last_clean":"2024-09-18T05:16:01.933158+0000","last_became_active":"2024-09-18T05:14:56.212214+0000","last_became_peered":"2024-09-18T05:14:56.212214+0000","last_unstale":"2024-09-18T05:16:01.933158+0000","last_undegraded":"2024-09-18T05:16:01.933158+0000","last_fullsized":"2024-09-18T05:16:01.933158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:41.658356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003505949,"stat_sum":{"num_bytes":26312821,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":19,"num_read":6862,"num_read_kb":32741,"num_write":1133,"num_write_kb":14771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.1b","version":"126'374","reported_seq":2338,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.904019+0000","last_change":"2024-09-18T05:16:00.904019+0000","last_active":"2024-09-18T05:16:00.904019+0000","last_peered":"2024-09-18T05:16:00.904019+0000","last_clean":"2024-09-18T05:16:00.904019+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:16:00.904019+0000","last_undegraded":"2024-09-18T05:16:00.904019+0000","last_fullsized":"2024-09-18T05:16:00.904019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026769459999999999,"stat_sum":{"num_bytes":26274353,"num_objects":39,"num_object_clones":11,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":22,"num_read":2719,"num_read_kb":17097,"num_write":358,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.1a","version":"129'408","reported_seq":6097,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.944569+0000","last_change":"2024-09-18T05:16:00.909549+0000","last_active":"2024-09-18T05:16:01.944569+0000","last_peered":"2024-09-18T05:16:01.944569+0000","last_clean":"2024-09-18T05:16:01.944569+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:16:01.944569+0000","last_undegraded":"2024-09-18T05:16:01.944569+0000","last_fullsized":"2024-09-18T05:16:01.944569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001021608,"stat_sum":{"num_bytes":6641368,"num_objects":28,"num_object_clones":7,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":13,"num_read":5791,"num_read_kb":45640,"num_write":410,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.19","version":"130'494","reported_seq":5473,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.987566+0000","last_change":"2024-09-18T05:16:00.902887+0000","last_active":"2024-09-18T05:16:00.987566+0000","last_peered":"2024-09-18T05:16:00.987566+0000","last_clean":"2024-09-18T05:16:00.987566+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:16:00.987566+0000","last_undegraded":"2024-09-18T05:16:00.987566+0000","last_fullsized":"2024-09-18T05:16:00.987566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034325599999999999,"stat_sum":{"num_bytes":30307688,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":14,"num_read":7852,"num_read_kb":20410,"num_write":455,"num_write_kb":15035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.18","version":"129'822","reported_seq":2554,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.894073+0000","last_change":"2024-09-18T05:16:00.898131+0000","last_active":"2024-09-18T05:16:01.894073+0000","last_peered":"2024-09-18T05:16:01.894073+0000","last_clean":"2024-09-18T05:16:01.894073+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:16:01.894073+0000","last_undegraded":"2024-09-18T05:16:01.894073+0000","last_fullsized":"2024-09-18T05:16:01.894073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043363170000000001,"stat_sum":{"num_bytes":24172054,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":20,"num_read":4163,"num_read_kb":22320,"num_write":1161,"num_write_kb":9141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.17","version":"126'530","reported_seq":6961,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.901841+0000","last_change":"2024-09-18T05:16:00.901841+0000","last_active":"2024-09-18T05:16:00.901841+0000","last_peered":"2024-09-18T05:16:00.901841+0000","last_clean":"2024-09-18T05:16:00.901841+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:16:00.901841+0000","last_undegraded":"2024-09-18T05:16:00.901841+0000","last_fullsized":"2024-09-18T05:16:00.901841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078044200000000001,"stat_sum":{"num_bytes":24288012,"num_objects":37,"num_object_clones":13,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":19,"num_read":8102,"num_read_kb":32863,"num_write":449,"num_write_kb":10643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.16","version":"131'582","reported_seq":8026,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.975094+0000","last_change":"2024-09-18T05:16:00.896518+0000","last_active":"2024-09-18T05:16:01.975094+0000","last_peered":"2024-09-18T05:16:01.975094+0000","last_clean":"2024-09-18T05:16:01.975094+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:16:01.975094+0000","last_undegraded":"2024-09-18T05:16:01.975094+0000","last_fullsized":"2024-09-18T05:16:01.975094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052867699999999997,"stat_sum":{"num_bytes":26214896,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":19,"num_read":9219,"num_read_kb":47686,"num_write":626,"num_write_kb":15042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.15","version":"130'701","reported_seq":6802,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.907406+0000","last_change":"2024-09-18T05:16:00.906802+0000","last_active":"2024-09-18T05:16:01.907406+0000","last_peered":"2024-09-18T05:16:01.907406+0000","last_clean":"2024-09-18T05:16:01.907406+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:16:01.907406+0000","last_undegraded":"2024-09-18T05:16:01.907406+0000","last_fullsized":"2024-09-18T05:16:01.907406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0076233890000000004,"stat_sum":{"num_bytes":41021918,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":18,"num_read":8000,"num_read_kb":49125,"num_write":1013,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.14","version":"126'375","reported_seq":2150,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.898677+0000","last_change":"2024-09-18T05:16:00.914319+0000","last_active":"2024-09-18T05:16:01.898677+0000","last_peered":"2024-09-18T05:16:01.898677+0000","last_clean":"2024-09-18T05:16:01.898677+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:16:01.898677+0000","last_undegraded":"2024-09-18T05:16:01.898677+0000","last_fullsized":"2024-09-18T05:16:01.898677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029443249999999998,"stat_sum":{"num_bytes":18242033,"num_objects":37,"num_object_clones":8,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":2056,"num_read_kb":19660,"num_write":403,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.246463+0000","last_change":"2024-09-18T05:15:55.214834+0000","last_active":"2024-09-18T05:15:57.246463+0000","last_peered":"2024-09-18T05:15:57.246463+0000","last_clean":"2024-09-18T05:15:57.246463+0000","last_became_active":"2024-09-18T05:15:55.213947+0000","last_became_peered":"2024-09-18T05:15:55.213947+0000","last_unstale":"2024-09-18T05:15:57.246463+0000","last_undegraded":"2024-09-18T05:15:57.246463+0000","last_fullsized":"2024-09-18T05:15:57.246463+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:23.379787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"130'532","reported_seq":3540,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.038045+0000","last_change":"2024-09-18T05:16:00.904172+0000","last_active":"2024-09-18T05:16:01.038045+0000","last_peered":"2024-09-18T05:16:01.038045+0000","last_clean":"2024-09-18T05:16:01.038045+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:16:01.038045+0000","last_undegraded":"2024-09-18T05:16:01.038045+0000","last_fullsized":"2024-09-18T05:16:01.038045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029068919999999999,"stat_sum":{"num_bytes":8830663,"num_objects":26,"num_object_clones":5,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":16,"num_read":4560,"num_read_kb":29216,"num_write":665,"num_write_kb":13076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.899614+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:16:00.899614+0000","last_peered":"2024-09-18T05:16:00.899614+0000","last_clean":"2024-09-18T05:16:00.899614+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:16:00.899614+0000","last_undegraded":"2024-09-18T05:16:00.899614+0000","last_fullsized":"2024-09-18T05:16:00.899614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"124'473","reported_seq":2695,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.901023+0000","last_change":"2024-09-18T05:16:00.901023+0000","last_active":"2024-09-18T05:16:00.901023+0000","last_peered":"2024-09-18T05:16:00.901023+0000","last_clean":"2024-09-18T05:16:00.901023+0000","last_became_active":"2024-09-18T05:13:45.882587+0000","last_became_peered":"2024-09-18T05:13:45.882587+0000","last_unstale":"2024-09-18T05:16:00.901023+0000","last_undegraded":"2024-09-18T05:16:00.901023+0000","last_fullsized":"2024-09-18T05:16:00.901023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:27:19.084581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00653501,"stat_sum":{"num_bytes":29398597,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":3402,"num_read_kb":32978,"num_write":574,"num_write_kb":10107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.899468+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:16:00.899468+0000","last_peered":"2024-09-18T05:16:00.899468+0000","last_clean":"2024-09-18T05:16:00.899468+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:16:00.899468+0000","last_undegraded":"2024-09-18T05:16:00.899468+0000","last_fullsized":"2024-09-18T05:16:00.899468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"129'390","reported_seq":5870,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.903299+0000","last_change":"2024-09-18T05:16:00.903299+0000","last_active":"2024-09-18T05:16:00.903299+0000","last_peered":"2024-09-18T05:16:00.903299+0000","last_clean":"2024-09-18T05:16:00.903299+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:16:00.903299+0000","last_undegraded":"2024-09-18T05:16:00.903299+0000","last_fullsized":"2024-09-18T05:16:00.903299+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:46.818280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032429749999999999,"stat_sum":{"num_bytes":22201297,"num_objects":30,"num_object_clones":4,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":15,"num_read":6526,"num_read_kb":27661,"num_write":413,"num_write_kb":9090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"2.4","version":"0'0","reported_seq":127,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.900231+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:16:00.900231+0000","last_peered":"2024-09-18T05:16:00.900231+0000","last_clean":"2024-09-18T05:16:00.900231+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:16:00.900231+0000","last_undegraded":"2024-09-18T05:16:00.900231+0000","last_fullsized":"2024-09-18T05:16:00.900231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"126'428","reported_seq":5884,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.899136+0000","last_change":"2024-09-18T05:16:00.899136+0000","last_active":"2024-09-18T05:16:00.899136+0000","last_peered":"2024-09-18T05:16:00.899136+0000","last_clean":"2024-09-18T05:16:00.899136+0000","last_became_active":"2024-09-18T05:14:56.206206+0000","last_became_peered":"2024-09-18T05:14:56.206206+0000","last_unstale":"2024-09-18T05:16:00.899136+0000","last_undegraded":"2024-09-18T05:16:00.899136+0000","last_fullsized":"2024-09-18T05:16:00.899136+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:21.659467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051135149999999999,"stat_sum":{"num_bytes":13098884,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":18,"num_read":5834,"num_read_kb":39781,"num_write":437,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.3","version":"130'1065","reported_seq":4695,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.041828+0000","last_change":"2024-09-18T05:16:00.913864+0000","last_active":"2024-09-18T05:16:01.041828+0000","last_peered":"2024-09-18T05:16:01.041828+0000","last_clean":"2024-09-18T05:16:01.041828+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:16:01.041828+0000","last_undegraded":"2024-09-18T05:16:01.041828+0000","last_fullsized":"2024-09-18T05:16:01.041828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.004894771,"stat_sum":{"num_bytes":30951245,"num_objects":31,"num_object_clones":8,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":15,"num_read":6757,"num_read_kb":44162,"num_write":1372,"num_write_kb":20003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"2.2","version":"21'2","reported_seq":81,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.899922+0000","last_change":"2024-09-18T05:14:56.205729+0000","last_active":"2024-09-18T05:16:00.899922+0000","last_peered":"2024-09-18T05:16:00.899922+0000","last_clean":"2024-09-18T05:16:00.899922+0000","last_became_active":"2024-09-18T05:14:56.205340+0000","last_became_peered":"2024-09-18T05:14:56.205340+0000","last_unstale":"2024-09-18T05:16:00.899922+0000","last_undegraded":"2024-09-18T05:16:00.899922+0000","last_fullsized":"2024-09-18T05:16:00.899922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:02:33.068329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"126'407","reported_seq":4596,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.903672+0000","last_change":"2024-09-18T05:16:00.903672+0000","last_active":"2024-09-18T05:16:00.903672+0000","last_peered":"2024-09-18T05:16:00.903672+0000","last_clean":"2024-09-18T05:16:00.903672+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:16:00.903672+0000","last_undegraded":"2024-09-18T05:16:00.903672+0000","last_fullsized":"2024-09-18T05:16:00.903672+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:12.320367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002897125,"stat_sum":{"num_bytes":14467608,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":17,"num_read":4850,"num_read_kb":21771,"num_write":377,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.217921+0000","last_change":"2024-09-18T05:15:55.216600+0000","last_active":"2024-09-18T05:15:57.217921+0000","last_peered":"2024-09-18T05:15:57.217921+0000","last_clean":"2024-09-18T05:15:57.217921+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:15:57.217921+0000","last_undegraded":"2024-09-18T05:15:57.217921+0000","last_fullsized":"2024-09-18T05:15:57.217921+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:42:31.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"129'338","reported_seq":2330,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.902087+0000","last_change":"2024-09-18T05:16:01.902390+0000","last_active":"2024-09-18T05:16:01.902087+0000","last_peered":"2024-09-18T05:16:01.902087+0000","last_clean":"2024-09-18T05:16:01.902087+0000","last_became_active":"2024-09-18T05:16:01.899154+0000","last_became_peered":"2024-09-18T05:16:01.899154+0000","last_unstale":"2024-09-18T05:16:01.902087+0000","last_undegraded":"2024-09-18T05:16:01.902087+0000","last_fullsized":"2024-09-18T05:16:01.902087+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:00:29.357279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014680229999999999,"stat_sum":{"num_bytes":5216053,"num_objects":32,"num_object_clones":10,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":17,"num_read":2129,"num_read_kb":5502,"num_write":360,"num_write_kb":5251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":2091093,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.900434+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:16:00.900434+0000","last_peered":"2024-09-18T05:16:00.900434+0000","last_clean":"2024-09-18T05:16:00.900434+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:16:00.900434+0000","last_undegraded":"2024-09-18T05:16:00.900434+0000","last_fullsized":"2024-09-18T05:16:00.900434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"126'529","reported_seq":4820,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.928960+0000","last_change":"2024-09-18T05:16:00.902656+0000","last_active":"2024-09-18T05:16:01.928960+0000","last_peered":"2024-09-18T05:16:01.928960+0000","last_clean":"2024-09-18T05:16:01.928960+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:16:01.928960+0000","last_undegraded":"2024-09-18T05:16:01.928960+0000","last_fullsized":"2024-09-18T05:16:01.928960+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:22:34.025479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029292189999999998,"stat_sum":{"num_bytes":30673317,"num_objects":31,"num_object_clones":7,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":14,"num_read":7112,"num_read_kb":38437,"num_write":530,"num_write_kb":10736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"2.3","version":"19'1","reported_seq":30,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-18T05:15:57.218076+0000","last_change":"2024-09-18T05:15:55.218072+0000","last_active":"2024-09-18T05:15:57.218076+0000","last_peered":"2024-09-18T05:15:57.218076+0000","last_clean":"2024-09-18T05:15:57.218076+0000","last_became_active":"2024-09-18T05:15:55.217766+0000","last_became_peered":"2024-09-18T05:15:55.217766+0000","last_unstale":"2024-09-18T05:15:57.218076+0000","last_undegraded":"2024-09-18T05:15:57.218076+0000","last_fullsized":"2024-09-18T05:15:57.218076+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:22:23.860200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.900414+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:16:00.900414+0000","last_peered":"2024-09-18T05:16:00.900414+0000","last_clean":"2024-09-18T05:16:00.900414+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:16:00.900414+0000","last_undegraded":"2024-09-18T05:16:00.900414+0000","last_fullsized":"2024-09-18T05:16:00.900414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"126'362","reported_seq":4935,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.937345+0000","last_change":"2024-09-18T05:16:01.902329+0000","last_active":"2024-09-18T05:16:01.937345+0000","last_peered":"2024-09-18T05:16:01.937345+0000","last_clean":"2024-09-18T05:16:01.937345+0000","last_became_active":"2024-09-18T05:16:01.898482+0000","last_became_peered":"2024-09-18T05:16:01.898482+0000","last_unstale":"2024-09-18T05:16:01.937345+0000","last_undegraded":"2024-09-18T05:16:01.937345+0000","last_fullsized":"2024-09-18T05:16:01.937345+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:22.456629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016532719999999999,"stat_sum":{"num_bytes":13333085,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":15,"num_read":6064,"num_read_kb":42277,"num_write":334,"num_write_kb":15919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":15236017,"num_keys_recovered":42,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.9","version":"129'271","reported_seq":4029,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.908928+0000","last_change":"2024-09-18T05:16:00.908928+0000","last_active":"2024-09-18T05:16:00.908928+0000","last_peered":"2024-09-18T05:16:00.908928+0000","last_clean":"2024-09-18T05:16:00.908928+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:16:00.908928+0000","last_undegraded":"2024-09-18T05:16:00.908928+0000","last_fullsized":"2024-09-18T05:16:00.908928+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:06:43.114897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060111799999999999,"stat_sum":{"num_bytes":18671911,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":16,"num_read":3697,"num_read_kb":33449,"num_write":289,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.a","version":"126'599","reported_seq":2566,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-18T05:15:58.248591+0000","last_change":"2024-09-18T05:15:58.249152+0000","last_active":"2024-09-18T05:15:58.248591+0000","last_peered":"2024-09-18T05:15:58.248591+0000","last_clean":"2024-09-18T05:15:58.248591+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:15:58.248591+0000","last_undegraded":"2024-09-18T05:15:58.248591+0000","last_fullsized":"2024-09-18T05:15:58.248591+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091194599999999996,"stat_sum":{"num_bytes":9712143,"num_objects":26,"num_object_clones":6,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":13,"num_read":3568,"num_read_kb":18366,"num_write":730,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"18","length":"1a"}]},{"pgid":"3.b","version":"126'274","reported_seq":3220,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.893981+0000","last_change":"2024-09-18T05:16:00.895575+0000","last_active":"2024-09-18T05:16:01.893981+0000","last_peered":"2024-09-18T05:16:01.893981+0000","last_clean":"2024-09-18T05:16:01.893981+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:16:01.893981+0000","last_undegraded":"2024-09-18T05:16:01.893981+0000","last_fullsized":"2024-09-18T05:16:01.893981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020106809999999998,"stat_sum":{"num_bytes":8695692,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":15,"num_read":2826,"num_read_kb":19519,"num_write":250,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.c","version":"130'452","reported_seq":5066,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.903618+0000","last_change":"2024-09-18T05:16:00.903618+0000","last_active":"2024-09-18T05:16:00.903618+0000","last_peered":"2024-09-18T05:16:00.903618+0000","last_clean":"2024-09-18T05:16:00.903618+0000","last_became_active":"2024-09-18T05:14:56.206142+0000","last_became_peered":"2024-09-18T05:14:56.206142+0000","last_unstale":"2024-09-18T05:16:00.903618+0000","last_undegraded":"2024-09-18T05:16:00.903618+0000","last_fullsized":"2024-09-18T05:16:00.903618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:17:28.830425+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0099725160000000007,"stat_sum":{"num_bytes":10436643,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":17,"num_read":5187,"num_read_kb":29961,"num_write":517,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.d","version":"129'376","reported_seq":3481,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.907234+0000","last_change":"2024-09-18T05:16:00.901097+0000","last_active":"2024-09-18T05:16:01.907234+0000","last_peered":"2024-09-18T05:16:01.907234+0000","last_clean":"2024-09-18T05:16:01.907234+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:16:01.907234+0000","last_undegraded":"2024-09-18T05:16:01.907234+0000","last_fullsized":"2024-09-18T05:16:01.907234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017370039999999999,"stat_sum":{"num_bytes":8506884,"num_objects":23,"num_object_clones":5,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":10,"num_read":3939,"num_read_kb":17208,"num_write":367,"num_write_kb":12997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.e","version":"130'534","reported_seq":5664,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.907362+0000","last_change":"2024-09-18T05:16:00.904804+0000","last_active":"2024-09-18T05:16:01.907362+0000","last_peered":"2024-09-18T05:16:01.907362+0000","last_clean":"2024-09-18T05:16:01.907362+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:16:01.907362+0000","last_undegraded":"2024-09-18T05:16:01.907362+0000","last_fullsized":"2024-09-18T05:16:01.907362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050277229999999996,"stat_sum":{"num_bytes":37641762,"num_objects":56,"num_object_clones":14,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":34,"num_read":6712,"num_read_kb":34541,"num_write":559,"num_write_kb":4812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.f","version":"126'514","reported_seq":8823,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.896276+0000","last_change":"2024-09-18T05:16:00.896276+0000","last_active":"2024-09-18T05:16:00.896276+0000","last_peered":"2024-09-18T05:16:00.896276+0000","last_clean":"2024-09-18T05:16:00.896276+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:16:00.896276+0000","last_undegraded":"2024-09-18T05:16:00.896276+0000","last_fullsized":"2024-09-18T05:16:00.896276+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025606940000000001,"stat_sum":{"num_bytes":12393517,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":17,"num_read":9510,"num_read_kb":40428,"num_write":534,"num_write_kb":18331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.10","version":"126'613","reported_seq":3761,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-18T05:15:58.248441+0000","last_change":"2024-09-18T05:15:58.248930+0000","last_active":"2024-09-18T05:15:58.248441+0000","last_peered":"2024-09-18T05:15:58.248441+0000","last_clean":"2024-09-18T05:15:58.248441+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:15:58.248441+0000","last_undegraded":"2024-09-18T05:15:58.248441+0000","last_fullsized":"2024-09-18T05:15:58.248441+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079537499999999997,"stat_sum":{"num_bytes":29415686,"num_objects":32,"num_object_clones":6,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":17,"num_read":6800,"num_read_kb":30722,"num_write":729,"num_write_kb":9597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"18","length":"1a"}]},{"pgid":"3.11","version":"126'430","reported_seq":3668,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.901659+0000","last_change":"2024-09-18T05:16:00.901659+0000","last_active":"2024-09-18T05:16:00.901659+0000","last_peered":"2024-09-18T05:16:00.901659+0000","last_clean":"2024-09-18T05:16:00.901659+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:16:00.901659+0000","last_undegraded":"2024-09-18T05:16:00.901659+0000","last_fullsized":"2024-09-18T05:16:00.901659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023219209999999998,"stat_sum":{"num_bytes":18657218,"num_objects":19,"num_object_clones":3,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":10,"num_read":4545,"num_read_kb":16351,"num_write":459,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.12","version":"131'597","reported_seq":2651,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-18T05:16:01.969641+0000","last_change":"2024-09-18T05:16:00.903677+0000","last_active":"2024-09-18T05:16:01.969641+0000","last_peered":"2024-09-18T05:16:01.969641+0000","last_clean":"2024-09-18T05:16:01.969641+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:16:01.969641+0000","last_undegraded":"2024-09-18T05:16:01.969641+0000","last_fullsized":"2024-09-18T05:16:01.969641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024188830000000001,"stat_sum":{"num_bytes":4763206,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":17,"num_read":4517,"num_read_kb":15727,"num_write":693,"num_write_kb":7877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"6"}]},{"pgid":"3.13","version":"126'789","reported_seq":2900,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-18T05:16:00.905839+0000","last_change":"2024-09-18T05:16:00.905839+0000","last_active":"2024-09-18T05:16:00.905839+0000","last_peered":"2024-09-18T05:16:00.905839+0000","last_clean":"2024-09-18T05:16:00.905839+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:16:00.905839+0000","last_undegraded":"2024-09-18T05:16:00.905839+0000","last_fullsized":"2024-09-18T05:16:00.905839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048327999999999999,"stat_sum":{"num_bytes":6707712,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":21,"num_read":5519,"num_read_kb":22552,"num_write":1199,"num_write_kb":8974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"6"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":605537173,"num_objects":1073,"num_object_clones":266,"num_object_copies":2146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1073,"num_whiteouts":552,"num_read":177366,"num_read_kb":917287,"num_write":20918,"num_write_kb":363244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":542,"num_bytes_recovered":26896232,"num_keys_recovered":130,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25083904,"data_stored":272677377,"data_compressed":16657022,"data_compressed_allocated":16953344,"data_compressed_original":265608771,"omap_allocated":6486,"internal_metadata":0},"log_size":17605,"ondisk_log_size":17605,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54760,"kb_used_data":5588,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94317080,"statfs":{"total":96636764160,"available":96580689920,"internally_reserved":0,"allocated":5722112,"data_stored":44671927,"data_compressed":2702862,"data_compressed_allocated":2772992,"data_compressed_original":42666669,"omap_allocated":1589,"internal_metadata":50330059},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.85999999999999999,"15min":0.88800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1519999999999999,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0489999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.36899999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.92100000000000004,"15min":0.93899999999999995},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7030000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.89700000000000002,"15min":0.92900000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97399999999999998,"5min":1.583,"15min":1.583},"last":0.41899999999999998}]},{"osd":2,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.073,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.008,"15min":1.036},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2070000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.86199999999999999,"15min":0.86699999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.823,"5min":1.925,"15min":1.925},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.04,"15min":1.0589999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.232,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.80200000000000005}]},{"osd":4,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.0580000000000001,"15min":1.097},"min":{"1min":0.46100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.522,"5min":3.488,"15min":3.488},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.92600000000000005,"15min":0.95099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1910000000000001,"5min":2.512,"15min":2.512},"last":0.63100000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.1399999999999999,"15min":1.173},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.1539999999999999,"5min":3.069,"15min":3.069},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.1100000000000001,"15min":1.131},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.83099999999999996}]}]},{"osd":6,"up_from":61,"seq":261993005073,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34848,"kb_used_data":2508,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94336992,"statfs":{"total":96636764160,"available":96601079808,"internally_reserved":0,"allocated":2568192,"data_stored":11434616,"data_compressed":623292,"data_compressed_allocated":708608,"data_compressed_original":10442709,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.96199999999999997}]},{"osd":1,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.036}]},{"osd":5,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.214}]},{"osd":7,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.1639999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36820,"kb_used_data":5688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335020,"statfs":{"total":96636764160,"available":96599060480,"internally_reserved":0,"allocated":5824512,"data_stored":45348575,"data_compressed":2938393,"data_compressed_allocated":3035136,"data_compressed_original":43611326,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3080000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.64200000000000002}]},{"osd":1,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1020000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.80700000000000005,"15min":0.82799999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.143,"5min":1.502,"15min":1.502},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.90200000000000002,"15min":0.91400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2549999999999999,"5min":1.804,"15min":1.804},"last":0.86299999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.84799999999999998,"15min":0.81000000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.2350000000000003,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.871,"15min":0.873},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.274,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.754}]},{"osd":6,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.97199999999999998}]},{"osd":7,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.998,"5min":0.99199999999999999,"15min":0.99099999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.0169999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63528,"kb_used_data":6172,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94308312,"statfs":{"total":96636764160,"available":96571711488,"internally_reserved":0,"allocated":6320128,"data_stored":53653970,"data_compressed":3363761,"data_compressed_allocated":3452928,"data_compressed_original":51886939,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.84799999999999998,"15min":0.875},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.198,"5min":2.827,"15min":2.827},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.69599999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1060000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93300000000000005,"15min":0.96799999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0669999999999999,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.47499999999999998}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1859999999999999,"5min":1.365,"15min":1.365},"last":0.55700000000000005}]},{"osd":3,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.012,"5min":1.133,"15min":1.133},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93400000000000005,"15min":0.92500000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.282,"5min":4.282,"15min":4.282},"last":0.52900000000000003}]},{"osd":5,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.38900000000000001}]},{"osd":6,"last update":"Wed Sep 18 05:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.437},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.34200000000000003}]},{"osd":7,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.84699999999999998,"15min":0.83899999999999997},"min":{"1min":0.45900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.997,"15min":1.018},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80932,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94290908,"statfs":{"total":96636764160,"available":96553889792,"internally_reserved":0,"allocated":5648384,"data_stored":47848649,"data_compressed":2576900,"data_compressed_allocated":2572288,"data_compressed_original":45652205,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.623,"15min":0.63500000000000001},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.98199999999999998,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.314}]},{"osd":1,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.90000000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82899999999999996,"15min":0.84499999999999997},"min":{"1min":0.46899999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1679999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.92000000000000004,"15min":0.93799999999999994},"min":{"1min":0.48199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.294,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.85199999999999998,"15min":0.86699999999999999},"min":{"1min":0.50900000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.133,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.89900000000000002,"15min":0.91900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3220000000000001,"5min":1.373,"15min":1.373},"last":0.995}]},{"osd":6,"last update":"Wed Sep 18 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.036},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.995,"15min":1.0189999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2809999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.075},{"interface":"front","average":{"1min":0.85899999999999999,"5min":1.0309999999999999,"15min":1.0600000000000001},"min":{"1min":0.57099999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.321,"5min":2.722,"15min":2.722},"last":0.85199999999999998}]}]},{"osd":2,"up_from":123,"seq":528280977410,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30524,"kb_used_data":2284,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341316,"statfs":{"total":96636764160,"available":96605507584,"internally_reserved":0,"allocated":2338816,"data_stored":11039992,"data_compressed":614504,"data_compressed_allocated":454656,"data_compressed_original":9961472,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":4268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":4370432,"data_stored":35297700,"data_compressed":2208995,"data_compressed_allocated":1974272,"data_compressed_original":33732212,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":0.83499999999999996,"15min":0.72899999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":17.597000000000001,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.312},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.504}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.626},{"interface":"front","average":{"1min":1.3879999999999999,"5min":0.85999999999999999,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":0.432}]},{"osd":3,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":0.94999999999999996,"15min":0.84799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":17.638999999999999,"5min":17.638999999999999,"15min":17.638999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":1.8420000000000001,"5min":0.97699999999999998,"15min":0.83299999999999996},"min":{"1min":0.35099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":19.489999999999998,"5min":19.489999999999998,"15min":19.489999999999998},"last":0.64500000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.85199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.78300000000000003}]},{"osd":5,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.91500000000000004,"15min":0.91300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.577,"5min":1.762,"15min":1.762},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.7070000000000001,"5min":1.167,"15min":1.077},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":14.198,"5min":14.198,"15min":14.198},"last":0.85799999999999998}]},{"osd":6,"last update":"Wed Sep 18 05:15:42 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.81399999999999995}]},{"osd":7,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.1850000000000001,"15min":1.1020000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":14.234,"5min":14.234,"15min":14.234},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0209999999999999,"15min":1.0269999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.88100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62712,"kb_used_data":5356,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94309128,"statfs":{"total":96636764160,"available":96572547072,"internally_reserved":0,"allocated":5484544,"data_stored":41578722,"data_compressed":2336354,"data_compressed_allocated":2617344,"data_compressed_original":39763015,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.3380000000000001,"5min":1.829,"15min":1.829},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.274,"5min":2.25,"15min":2.25},"last":0.42699999999999999}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.39200000000000002}]},{"osd":3,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72899999999999998,"15min":0.747},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.2589999999999999,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.375},{"interface":"front","average":{"1min":1,"5min":0.82599999999999996,"15min":0.79700000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":9.4220000000000006,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.44800000000000001}]},{"osd":4,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.85599999999999998,"15min":0.879},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.042,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.93700000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.3140000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.65800000000000003}]},{"osd":5,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.47099999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9690000000000003,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.99199999999999999,"15min":1.0229999999999999},"min":{"1min":0.57799999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3069999999999999,"5min":1.911,"15min":1.911},"last":0.60999999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.98599999999999999,"15min":1.014},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.343,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.622},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0669999999999999,"15min":1.073},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":0.69999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3862528,"data_stored":40246303,"data_compressed":2302948,"data_compressed_allocated":2572288,"data_compressed_original":39189575,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2797568,"data_stored":34549694,"data_compressed":2208995,"data_compressed_allocated":1974272,"data_compressed_original":33732212,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":10322663,"data_compressed":614504,"data_compressed_allocated":454656,"data_compressed_original":9961472,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4079616,"data_stored":47100662,"data_compressed":2576900,"data_compressed_allocated":2572288,"data_compressed_original":45652205,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":52905983,"data_compressed":3363761,"data_compressed_allocated":3452928,"data_compressed_original":51886939,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":44600512,"data_compressed":2938393,"data_compressed_allocated":3035136,"data_compressed_original":43611326,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":10710952,"data_compressed":623292,"data_compressed_allocated":708608,"data_compressed_original":10442709,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3465216,"data_stored":32240608,"data_compressed":2028229,"data_compressed_allocated":2183168,"data_compressed_original":31132333,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:16:03.491 INFO:tasks.thrashosds.thrasher:Setting 3.7 to [2, 3] 2024-09-18T05:16:03.491 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.7', '2', '3'] 2024-09-18T05:16:03.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.7 2 3 2024-09-18T05:16:03.492 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:03.482+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:03.588 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:03.582+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:03.647 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:16:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:16:03.647 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:03.662 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:16:03.689 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:03.686+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:03.791 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:03.786+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:03.814 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:03.814 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:16:03.814 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:16:03.814 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:16:03.814 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:03.827 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:16:03.891 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:03.886+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:03.901 INFO:teuthology.orchestra.run.smithi017.stderr:set 3.7 pg_upmap mapping to [2,3] 2024-09-18T05:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.041211979, 2024-09-18T05:16:03.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:16:03.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.04118103600001, 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:16:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:16:03.963 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.04115547200001, 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:16:03.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.041130756, 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:16:03.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:16:03.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.04110452200001, 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:03.977 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.041075613, 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.041051783, 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:16:03.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.04102730700001, 2024-09-18T05:16:03.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:16:03.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:16:03.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:16:03.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.040909508, 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:16:03.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:03.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.037917553, 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.996 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:16:03.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:03.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.037839491, 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:16:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:16:04.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:04.005 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.03780820399999, 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:16:04.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.03778219099999, 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:16:04.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:16:04.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:16:04.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:16:04.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.03775441799999, 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:16:04.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:16:04.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:16:04.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.03772935500001, 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:16:04.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.03770432499999, 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:16:04.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:16:04.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:04.028 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.033579997, 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.03355945199999, 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:16:04.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:16:04.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:16:04.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 132.03353977, 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:16:04.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.042 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.765468322999993, 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:16:04.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:16:04.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:16:04.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:16:04.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.050 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:04.050 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:04.050 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:04.052 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:16:04.052 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:04.046+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:04.152 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:04.146+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:04.191 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:04.191 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:04.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:16:04.253 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:04.246+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:04.325 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:04.325 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:04.325 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:04.325 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:04.326 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:04.340 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:16:04.354 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:04.350+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:04.455 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:04.450+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711446955, 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:16:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:16:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:16:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711437965000002, 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:16:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711428998000002, 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:16:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:16:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:16:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:16:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:16:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:16:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:16:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:16:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:16:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711420215000004, 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:16:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711411439000003, 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:16:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:16:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:16:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:16:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:16:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:16:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:16:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:16:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:16:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711401147000004, 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:16:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:16:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711387259999995, 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:16:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:16:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:16:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:16:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:16:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711378053999994, 2024-09-18T05:16:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:16:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:16:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:16:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711369356000006, 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:16:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:16:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:16:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:16:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:16:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711360291000005, 2024-09-18T05:16:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:16:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:16:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711336932999998, 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:16:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:16:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:16:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:16:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:16:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:16:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:16:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:16:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:16:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:16:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:16:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:16:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711327268000005, 2024-09-18T05:16:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:16:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:16:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:16:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711300910999995, 2024-09-18T05:16:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:16:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.535 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.535 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:16:04.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.535 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:04.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:04.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:16:04.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:16:04.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711287378999998, 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:16:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711275928000006, 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:16:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711266447, 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:16:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:16:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:16:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:16:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711256364999997, 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:16:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:16:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:16:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:16:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:16:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711247276999998, 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:16:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:16:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.71123772, 2024-09-18T05:16:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:16:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:16:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:16:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:16:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:16:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:16:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:16:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:16:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:16:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:16:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:16:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:16:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:16:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.711228899000005, 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:16:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:16:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:16:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:16:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:16:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:16:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:16:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:16:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:16:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:04.579 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:04.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:16:04.583 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:04.578+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:04.684 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:04.678+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:04.751 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:04.751 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:04.751 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:04.751 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:04.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:16:04.784 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:04.778+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:04.885 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:04.878+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:04.888 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:04.888 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:04.888 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:04.888 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:04.888 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:04.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:16:04.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:16:04.986 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:04.982+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:05.035 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.37254881299999, 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.036 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:16:05.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:16:05.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.040 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.041 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.041 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:05.041 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.37248189500001, 2024-09-18T05:16:05.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:05.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:16:05.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.372393385, 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.046 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:05.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.050 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.372342829, 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:05.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:05.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.372279714, 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.060 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.372232794, 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:16:05.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:16:05.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:05.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:16:05.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:16:05.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:16:05.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:16:05.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:16:05.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.37217891500001, 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:16:05.066 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:05.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:16:05.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.071 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.372131782, 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:16:05.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:05.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:16:05.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:16:05.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:16:05.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.076 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.37208416, 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.077 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:16:05.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:16:05.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:16:05.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:16:05.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:16:05.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:16:05.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:16:05.082 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.082 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.082 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.082 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.083 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:05.083 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.37196133899999, 2024-09-18T05:16:05.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:16:05.083 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.083 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.083 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.084 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.084 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.084 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:16:05.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.084 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:05.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:16:05.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:16:05.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:16:05.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.37188000899999, 2024-09-18T05:16:05.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:16:05.090 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.090 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.090 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:05.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:16:05.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.094 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.371808766, 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:05.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:16:05.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:16:05.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:16:05.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:16:05.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:16:05.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:16:05.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:16:05.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:16:05.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.105 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.105 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:05.105 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.371758555, 2024-09-18T05:16:05.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:16:05.105 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.105 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:16:05.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.371681361, 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.114 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.115 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:05.115 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.371631491, 2024-09-18T05:16:05.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:16:05.115 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.115 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.115 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:16:05.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.119 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.37155692, 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.120 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.371491142, 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.125 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:16:05.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:05.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:16:05.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:16:05.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.129 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.371444106, 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:16:05.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:16:05.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.371382013, 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:16:05.135 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:16:05.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:16:05.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:16:05.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:16:05.141 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.141 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.141 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.142 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:05.142 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:05.142 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.371335634, 2024-09-18T05:16:05.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:16:05.142 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:05.142 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:05.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:05.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:05.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:05.143 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:16:05.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:05.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:05.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:05.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:16:05.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:05.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:05.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:16:05.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:16:05.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:05.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:16:05.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:16:05.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:05.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:16:05.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:16:05.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:05.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:16:05.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:16:05.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:05.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:16:05.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:16:05.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:05.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:05.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:05.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:16:05.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:16:05.150 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.151 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.151 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.151 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:05.151 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:05.151 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:05.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:16:05.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:16:05.156 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:05.150+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:05.254 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:05.250+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:05.301 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:05.301 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:05.315 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:05.315 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:05.326 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:05.326 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:05.331 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:05.331 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:05.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:16:05.348 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:05.355 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:05.350+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:05.365 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:05.383 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:05.384 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:05.402 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:05.402 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:05.419 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:05.420 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:05.459 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:05.459 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:05.473 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:16:05.482 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:05.478+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:05.557 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:05.550+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:05.589 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:05.590 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:05.604 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:16:05.657 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:05.654+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:05.725 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:05.726 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:05.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:16:05.758 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:05.754+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:05.859 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:05.854+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:05.862 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:05.862 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:05.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:16:05.904 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:16:05.964 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:05.962+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:06.045 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:06.045 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:06.060 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:16:06.061 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:06.058+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:06.161 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:06.158+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:06.189 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:06.189 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:06.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:16:06.262 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:06.258+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:06.330 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:06.330 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:06.344 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:16:06.362 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:06.358+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:06.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:06.458+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:06.511 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:06.511 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:06.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:16:06.570 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:06.566+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:06.664 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:06.662+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:06.699 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:06.713 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:16:06.765 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:06.762+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:06.842 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:06.842 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:06.856 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:16:06.902 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:06.898+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:06.968 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:06.962+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:06.983 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:06.983 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:06.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:16:07.070 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:07.066+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:07.169 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:07.166+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:07.183 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:07.198 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:16:07.270 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:07.266+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:07.322 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:07.322 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:07.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:16:07.378 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:07.374+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:07.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:16:07.482 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:07.478+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:07.505 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:07.506 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:07.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:16:07.583 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:07.584 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:07.584 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:07.578+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:07.600 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:07.601 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:07.618 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:07.618 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:07.635 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:07.655 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:07.673 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:07.670+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:07.676 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:07.678 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:16:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:16:07.678 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:07.693 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:16:07.698 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:07.719 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:07.720 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:07.782 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:07.778+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:16:07.818 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:07.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:16:07.875 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:07.870+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:07.941 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:16:07.976 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:07.974+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:08.019 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10544291599999, 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:16:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.105411973, 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:16:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.105386409, 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:16:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10536169299999, 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:16:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.105335459, 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:16:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10530654999999, 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:16:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10528271999999, 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:16:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.105258244, 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:16:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:16:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10514044499999, 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:16:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:16:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10214848999999, 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:16:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10207042799999, 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:16:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10203914100001, 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10201312800001, 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:16:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:16:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10198535500001, 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:16:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.101960292, 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:16:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:16:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.10193526200001, 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:16:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:16:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:16:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.09781093399999, 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:16:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.09779038900001, 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:16:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:16:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 136.097770707, 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:16:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:16:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.829699259999998, 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:16:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:16:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:16:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:16:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:08.115 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:08.116 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:16:08.117 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:08.114+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:08.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:08.214+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:08.249 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:08.250 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:08.250 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:08.250 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:08.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:16:08.319 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:08.314+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:08.385 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:08.385 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:08.385 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:08.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:16:08.420 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:08.414+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:08.521 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:08.518+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:08.564 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814495237000003, 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.565 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:16:08.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:16:08.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:16:08.569 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.570 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.570 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.570 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.570 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:08.570 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814486247000005, 2024-09-18T05:16:08.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814477280000006, 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.575 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:08.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:16:08.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:16:08.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:16:08.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:16:08.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814468497000007, 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:16:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:16:08.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:16:08.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:16:08.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:16:08.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:16:08.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:16:08.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:16:08.589 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.589 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.590 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.590 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.590 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:08.590 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814459721000006, 2024-09-18T05:16:08.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:16:08.591 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.591 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.591 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.591 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.591 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.591 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:16:08.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.592 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:08.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:16:08.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:16:08.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814449429000007, 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.597 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:16:08.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814435541999998, 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:08.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:16:08.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814426335999997, 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.607 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:08.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.611 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814417637999995, 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:08.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:08.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:16:08.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:16:08.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814408572999994, 2024-09-18T05:16:08.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:16:08.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:16:08.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814385215000001, 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:16:08.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814375549999994, 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.625 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:16:08.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814349192999998, 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:16:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:16:08.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814335661000001, 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:08.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.638 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814324209999995, 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:16:08.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:16:08.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814314729000003, 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.643 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:16:08.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:16:08.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814304647, 2024-09-18T05:16:08.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:08.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814295559000001, 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.652 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:08.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814286002000003, 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.656 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:16:08.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.814277180999994, 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:16:08.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.665 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.665 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.665 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:08.665 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:08.665 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:08.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:16:08.667 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:08.662+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:08.767 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:08.762+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:08.833 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:08.833 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:08.834 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:08.834 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:08.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:16:08.896 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:08.894+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:08.927 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 7, 6, 2] 2024-09-18T05:16:08.927 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:16:08.927 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-18T05:16:08.927 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T05:16:08.927 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T05:16:08.928 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-18T05:16:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:16:09.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:09.006+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:09.031 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:09.031 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:09.031 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:09.047 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:16:09.073 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:09.073 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T05:16:09.073 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:09.092 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:09.090+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:09.168 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.50549699699999, 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:09.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.50543007900001, 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:16:09.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:16:09.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.505341569, 2024-09-18T05:16:09.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:16:09.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:16:09.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.505291013, 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:16:09.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.505227898, 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.187 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:09.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:16:09.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:16:09.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:16:09.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:16:09.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:16:09.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.505180978, 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.194 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:16:09.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.50512709900001, 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.198 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.199 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:16:09.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.199 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.505079966, 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.505032344, 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:16:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:16:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.50490952299999, 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:16:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:16:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:16:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.50482819299999, 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.50475695, 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.504706739, 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:16:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:16:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.504629545, 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:16:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.504579675, 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:16:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.504505104, 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:16:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.504439326, 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:16:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.50439229, 2024-09-18T05:16:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:16:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.504330197, 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:16:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 107.504283818, 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.262 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:09.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:16:09.264 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:09.258+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:09.365 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:09.358+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:09.434 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:09.434 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:09.448 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:16:09.466 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:09.462+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:09.565 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:09.565 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:09.566 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:09.566 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:09.566 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:09.566 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:09.562+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:09.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:16:09.668 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:09.666+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:09.740 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:16:09.743 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:09.743 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:09.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:09.743 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121386 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 686080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783952726999999, 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056108969000000002, 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121386 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:09.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955696+0000", 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0874e-05 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955703+0000", 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3189999999999997e-06 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955708+0000", 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0429999999999998e-06 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011705+0000", 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055996870999999997 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011743+0000", 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7895000000000002e-05 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011794+0000", 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1307999999999997e-05 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121387 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 698368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783925144000001, 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056181659000000002, 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.748 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121387 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955712+0000", 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955715+0000", 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3760000000000002e-06 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955721+0000", 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2589999999999997e-06 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955725+0000", 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4009999999999999e-06 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011813+0000", 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056088051999999999 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011848+0000", 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4847e-05 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011894+0000", 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.752 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121388 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783908232000002, 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056271570999999999, 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121388 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955729+0000", 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955731+0000", 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2019999999999998e-06 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955737+0000", 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9139999999999996e-06 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955751+0000", 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3311e-05 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011914+0000", 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163594999999997 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011952+0000", 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7834999999999999e-05 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012001+0000", 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9084e-05 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.756 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121389 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 722944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783882102, 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056345279999999998, 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.757 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121389 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955755+0000", 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955759+0000", 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3850000000000002e-06 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955766+0000", 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8499999999999996e-06 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955771+0000", 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0170000000000004e-06 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012021+0000", 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056250737000000002 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012057+0000", 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5271000000000002e-05 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012101+0000", 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4403999999999997e-05 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121390 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 735232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783861174000002, 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056430889999999997, 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.761 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121390 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955776+0000", 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955779+0000", 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6290000000000002e-06 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955786+0000", 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.435e-06 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955791+0000", 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7520000000000004e-06 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012120+0000", 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056329443999999999 2024-09-18T05:16:09.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012158+0000", 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7925e-05 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012208+0000", 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9301000000000001e-05 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121391 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 747520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783829713999999, 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056498934000000001, 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121391 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955811+0000", 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9560000000000002e-06 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955818+0000", 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3339999999999996e-06 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955823+0000", 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2839999999999997e-06 2024-09-18T05:16:09.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012227+0000", 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056403880000000003 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012262+0000", 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4618e-05 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012307+0000", 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5413e-05 2024-09-18T05:16:09.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121392 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783809878, 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056582623999999998, 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.770 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121392 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955830+0000", 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999998e-06 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955837+0000", 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-18T05:16:09.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955842+0000", 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6770000000000003e-06 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012326+0000", 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056483691000000003 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012363+0000", 2024-09-18T05:16:09.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7024999999999999e-05 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012411+0000", 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7845e-05 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121393 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 772096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783791458000003, 2024-09-18T05:16:09.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056662902000000001, 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121393 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955848+0000", 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2350000000000002e-06 2024-09-18T05:16:09.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955855+0000", 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0500000000000003e-06 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955860+0000", 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8080000000000004e-06 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012430+0000", 2024-09-18T05:16:09.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056570047999999998 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012465+0000", 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4718000000000002e-05 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012509+0000", 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4418000000000001e-05 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121394 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 784384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783773566000001, 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056750383000000001, 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121394 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955866+0000", 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955873+0000", 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4810000000000003e-06 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955878+0000", 2024-09-18T05:16:09.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8500000000000002e-06 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012529+0000", 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056651708000000002 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012567+0000", 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7642000000000003e-05 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012615+0000", 2024-09-18T05:16:09.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7811e-05 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121395 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783756197999999, 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056832344999999999, 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121395 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955881+0000", 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955884+0000", 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3240000000000001e-06 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955890+0000", 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0909999999999998e-06 2024-09-18T05:16:09.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955894+0000", 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012635+0000", 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056740087000000002 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012670+0000", 2024-09-18T05:16:09.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5123999999999998e-05 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012714+0000", 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4384000000000001e-05 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121396 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 808960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783723723999998, 2024-09-18T05:16:09.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057018234000000001, 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121396 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955917+0000", 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0979999999999998e-06 2024-09-18T05:16:09.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955930+0000", 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3552e-05 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955936+0000", 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7309999999999998e-06 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012733+0000", 2024-09-18T05:16:09.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056797146999999999 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012770+0000", 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7239e-05 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012932+0000", 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016205000000000001 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121397 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 821248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783697066999999, 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057105428999999999, 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121397 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955940+0000", 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955943+0000", 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7439999999999999e-06 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955950+0000", 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8129999999999998e-06 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955957+0000", 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1849999999999998e-06 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012953+0000", 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056995559000000001 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012987+0000", 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4777000000000003e-05 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013046+0000", 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8867999999999999e-05 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121398 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 833536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783676190000001, 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057212333999999997, 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.796 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121398 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955961+0000", 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955970+0000", 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6759999999999996e-06 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955981+0000", 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0706999999999999e-05 2024-09-18T05:16:09.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955986+0000", 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0719999999999999e-06 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013067+0000", 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057081595999999998 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013111+0000", 2024-09-18T05:16:09.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3331999999999998e-05 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013174+0000", 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3323000000000003e-05 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121399 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:09.800 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.783647178000002, 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057281034000000002, 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121399 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955990+0000", 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955993+0000", 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:16:09.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955999+0000", 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4699999999999999e-06 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.956004+0000", 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013194+0000", 2024-09-18T05:16:09.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057189503000000003 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013233+0000", 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9082000000000003e-05 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013272+0000", 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9014000000000003e-05 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.804 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121415 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.780814941999999, 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023800999999998, 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121415 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.805 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:09.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958825+0000", 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.835e-06 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958831+0000", 2024-09-18T05:16:09.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.088e-06 2024-09-18T05:16:09.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958842+0000", 2024-09-18T05:16:09.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0916e-05 2024-09-18T05:16:09.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014771+0000", 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055928731000000002 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014809+0000", 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7713999999999998e-05 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014847+0000", 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7888e-05 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.809 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121416 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 528384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.780789697000003, 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056112120000000001, 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121416 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958850+0000", 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.729e-06 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958858+0000", 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958866+0000", 2024-09-18T05:16:09.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2840000000000006e-06 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014866+0000", 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056000419000000003 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014907+0000", 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0533e-05 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014960+0000", 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3427000000000002e-05 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121417 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 540672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.780766249000003, 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056196533999999999, 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121417 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958871+0000", 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958874+0000", 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.537e-06 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958881+0000", 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1840000000000002e-06 2024-09-18T05:16:09.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958886+0000", 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014981+0000", 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056095036000000001 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015017+0000", 2024-09-18T05:16:09.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6732e-05 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015068+0000", 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0855e-05 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121418 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 552960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:09.818 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.780673122000003, 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056223713000000002, 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121418 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958889+0000", 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999247 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958968+0000", 2024-09-18T05:16:09.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8638000000000002e-05 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958990+0000", 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1614e-05 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959004+0000", 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4157e-05 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015088+0000", 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056084547999999998 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015129+0000", 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1048999999999999e-05 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015188+0000", 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8967e-05 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121420 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 577536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.780257398000003, 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056036506999999999, 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121420 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959383+0000", 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3689999999999998e-06 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959390+0000", 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1799999999999999e-06 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959396+0000", 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5330000000000002e-06 2024-09-18T05:16:09.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015330+0000", 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055934086000000001 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015369+0000", 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8732000000000001e-05 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015417+0000", 2024-09-18T05:16:09.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8241000000000001e-05 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121421 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 589824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.780236785, 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056116280999999997, 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:09.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121421 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959403+0000", 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6989999999999999e-06 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959409+0000", 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1099999999999999e-06 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959414+0000", 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6190000000000002e-06 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015437+0000", 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023252000000003 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015473+0000", 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6086e-05 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:09.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:09.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:09.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015517+0000", 2024-09-18T05:16:09.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4082999999999998e-05 2024-09-18T05:16:09.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.831 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:09.831 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:09.831 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:09.832 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:16:09.833 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:09.830+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:09.904 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:09.924 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:09.924 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:09.933 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:09.930+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:09.942 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:09.942 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:09.961 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:09.981 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:10.004 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:10.019 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:10.019 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:10.020 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:10.020 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:10.026 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:10.026 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:10.035 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:16:10.035 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:10.030+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:10.045 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:10.135 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:10.130+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:10.198 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:10.198 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:10.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:16:10.256 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:10.254+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:10.337 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:10.334+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:10.379 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:10.379 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:10.394 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:16:10.440 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:10.438+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:10.527 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:10.527 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:10.539 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:10.534+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:10.542 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:16:10.640 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:10.638+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:10.666 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:10.666 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:10.681 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:16:10.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:10.734+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:10.807 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:10.807 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:10.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:16:10.862 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:10.858+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:10.941 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:10.938+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:10.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:16:11.005 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:11.005 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:11.025 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:16:11.042 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:11.038+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:11.143 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:11.138+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:11.191 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:11.191 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:11.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:16:11.254 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:11.250+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:11.325 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:11.325 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:11.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:16:11.346 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:11.342+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:11.450 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:11.442+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:11.506 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:11.506 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:11.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:16:11.550 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:11.546+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:11.654 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:11.650+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:11.681 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:11.682 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:11.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:16:11.755 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:11.750+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:11.819 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:11.819 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:11.833 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:16:11.857 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:11.854+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:11.956 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:16:11.961 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:11.954+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:12.021 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:12.021 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:12.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:16:12.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:16:12.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:12.074+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:12.160 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:12.158+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:12.202 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:12.202 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:12.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:16:12.232 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:12.249 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:12.249 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:12.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:12.254+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:12.265 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:12.266 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:12.282 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:12.282 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:12.302 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:12.322 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:12.323 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:12.343 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:12.343 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:16:12.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:16:12.343 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:16:12.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.343 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1833 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2129920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.343 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:16:12.343 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.43031260199999, 2024-09-18T05:16:12.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098016743000000003, 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1833 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909109+0000", 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909108+0000", 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909113+0000", 2024-09-18T05:16:12.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.237e-06 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909126+0000", 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2816000000000001e-05 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909134+0000", 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4800000000000004e-06 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006805+0000", 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097671354000000002 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.006951+0000", 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580800000000001 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007126+0000", 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017486100000000001 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.347 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1834 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.430281659, 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098392462999999999, 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1834 2024-09-18T05:16:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909140+0000", 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909139+0000", 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909143+0000", 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0339999999999998e-06 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909152+0000", 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7760000000000003e-06 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909159+0000", 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1239999999999999e-06 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007200+0000", 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098041151000000007 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007388+0000", 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018712700000000001 2024-09-18T05:16:12.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007532+0000", 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000144871 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1835 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2375680~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.430256095, 2024-09-18T05:16:12.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098751079000000005, 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1835 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909166+0000", 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909165+0000", 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909168+0000", 2024-09-18T05:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0529999999999998e-06 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909177+0000", 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5699999999999993e-06 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909184+0000", 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4170000000000003e-06 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007614+0000", 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098429548000000006 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007768+0000", 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015471899999999999 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.007917+0000", 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148362 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1836 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2498560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.43023137899999, 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099082106000000003, 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1836 2024-09-18T05:16:12.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909190+0000", 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909193+0000", 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4400000000000001e-06 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909202+0000", 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5569999999999996e-06 2024-09-18T05:16:12.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909210+0000", 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-06 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008003+0000", 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098793205999999995 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008122+0000", 2024-09-18T05:16:12.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118297 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008272+0000", 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015061299999999999 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1837 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2621440~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.430205145, 2024-09-18T05:16:12.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099410685999999998, 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1837 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909217+0000", 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909216+0000", 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909219+0000", 2024-09-18T05:16:12.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909231+0000", 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1749999999999999e-05 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909237+0000", 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.703e-06 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008361+0000", 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099124074000000006 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008475+0000", 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113953 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008627+0000", 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151753 2024-09-18T05:16:12.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1838 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.43017623599999, 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099731088999999995, 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.366 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1838 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909245+0000", 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909248+0000", 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9699999999999999e-06 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909257+0000", 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7569999999999993e-06 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909263+0000", 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9090000000000003e-06 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008716+0000", 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099452055999999997 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008832+0000", 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116279 2024-09-18T05:16:12.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.008977+0000", 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014470800000000001 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1839 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2867200~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.43015240599999, 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.10004095, 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1839 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909269+0000", 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909272+0000", 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2229999999999999e-06 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909281+0000", 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6999999999999997e-06 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909287+0000", 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8340000000000001e-06 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009046+0000", 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099758843999999999 2024-09-18T05:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009160+0000", 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113639 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009310+0000", 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015032700000000001 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1840 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.43012793, 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100349575, 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1840 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909294+0000", 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909293+0000", 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909301+0000", 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2430000000000005e-06 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909316+0000", 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4667e-05 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909323+0000", 2024-09-18T05:16:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1300000000000003e-06 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009382+0000", 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100058883 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009495+0000", 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113076 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009643+0000", 2024-09-18T05:16:12.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014817899999999999 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1841 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3112960~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.43001013099999, 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100566142, 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.379 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1841 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909412+0000", 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909329+0000", 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999175 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909419+0000", 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0415999999999996e-05 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909443+0000", 2024-09-18T05:16:12.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3553e-05 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909461+0000", 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7520000000000002e-05 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009719+0000", 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.100258208 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009828+0000", 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000109079 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.009978+0000", 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149868 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1842 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.383 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.42701817599999, 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097902437999999994, 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1842 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:16:12.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912403+0000", 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.909474+0000", 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9970703 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912412+0000", 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029385000000000001 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912434+0000", 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1880000000000001e-05 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912447+0000", 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3077e-05 2024-09-18T05:16:12.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010047+0000", 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097599612000000002 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010160+0000", 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113133 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010306+0000", 2024-09-18T05:16:12.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014580699999999999 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1843 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3358720~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.42694011399999, 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098168082000000004, 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.388 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1843 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912482+0000", 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912481+0000", 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912486+0000", 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9030000000000003e-06 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912497+0000", 2024-09-18T05:16:12.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1453e-05 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912505+0000", 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4870000000000002e-06 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010376+0000", 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097870312000000001 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010490+0000", 2024-09-18T05:16:12.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011456200000000001 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010650+0000", 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926100000000001 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1844 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.42690882700001, 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098466817999999998, 2024-09-18T05:16:12.392 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1844 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912513+0000", 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912512+0000", 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912516+0000", 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8500000000000004e-06 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912525+0000", 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8489999999999995e-06 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912532+0000", 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5340000000000002e-06 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010719+0000", 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098187046 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010830+0000", 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110962 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.010980+0000", 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014939 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1845 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3604480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.42688281400001, 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098740040000000001, 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1845 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.397 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912539+0000", 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912538+0000", 2024-09-18T05:16:12.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912542+0000", 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6969999999999999e-06 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912553+0000", 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0923e-05 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912560+0000", 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3130000000000001e-06 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011052+0000", 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098491711999999995 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011165+0000", 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011295599999999999 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011279+0000", 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114036 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1846 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3727360~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.42685504100001, 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099008336000000002, 2024-09-18T05:16:12.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1846 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912567+0000", 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912566+0000", 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912570+0000", 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6500000000000002e-06 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912579+0000", 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9700000000000005e-06 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912586+0000", 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9670000000000004e-06 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011348+0000", 2024-09-18T05:16:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098762734000000005 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011465+0000", 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116247 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011575+0000", 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110362 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1847 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3850240~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.426829978, 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099278013999999998, 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1847 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.406 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912592+0000", 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912591+0000", 2024-09-18T05:16:12.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912595+0000", 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6830000000000001e-06 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912603+0000", 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6500000000000002e-06 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912611+0000", 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.114e-06 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011645+0000", 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099034672000000004 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011758+0000", 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112939 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011870+0000", 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111556 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1848 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 3973120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.42680494800001, 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099539530000000001, 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1848 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912617+0000", 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912616+0000", 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912619+0000", 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1700000000000001e-06 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912632+0000", 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969999999999999e-05 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.912639+0000", 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8029999999999999e-06 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.011936+0000", 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.099297386000000001 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012045+0000", 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010849900000000001 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.012156+0000", 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011130500000000001 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1855 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 663552~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.42268061999999, 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098104830000000004, 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.415 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1855 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916741+0000", 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916743+0000", 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9069999999999999e-06 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916751+0000", 2024-09-18T05:16:12.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1890000000000001e-06 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916756+0000", 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7950000000000004e-06 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014585+0000", 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.097828424999999997 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014701+0000", 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011599600000000001 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014846+0000", 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014501600000000001 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1856 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 786432~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:16:12.419 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.42266007500001, 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098414711000000002, 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1856 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:16:12.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916762+0000", 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916761+0000", 2024-09-18T05:16:12.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916764+0000", 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916771+0000", 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9550000000000003e-06 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916776+0000", 2024-09-18T05:16:12.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3519999999999997e-06 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.014910+0000", 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098134221999999993 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015029+0000", 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118891 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015176+0000", 2024-09-18T05:16:12.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014715600000000001 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:1857 3.7 3:e4a5b12d:::rbd_data.118bc12db472.0000000000000002:4 [read 909312~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26)", 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 140.42264039299999, 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098736315000000005, 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1857 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916781+0000", 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916783+0000", 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5840000000000002e-06 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916790+0000", 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0829999999999998e-06 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:51.916796+0000", 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7860000000000002e-06 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015260+0000", 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.098463766999999994 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015384+0000", 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012421900000000001 2024-09-18T05:16:12.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:13:52.015518+0000", 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013335300000000001 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:57353 3.1e 3:7c1f9592:::rbd_object_map.118b8f6e3d14:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.154568945999998, 2024-09-18T05:16:12.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.94366356399999995, 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 57353 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184853+0000", 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184851+0000", 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184862+0000", 2024-09-18T05:16:12.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0907000000000001e-05 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184882+0000", 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0797000000000001e-05 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184890+0000", 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0160000000000008e-06 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184941+0000", 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686000000000002e-05 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:43.184948+0000", 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2679999999999997e-06 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122400+0000", 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.93745215299999995 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122556+0000", 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015588599999999999 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.122723+0000", 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016635099999999999 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128424+0000", 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.005701144 2024-09-18T05:16:12.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128435+0000", 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1336e-05 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128488+0000", 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2447000000000001e-05 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:14:44.128516+0000", 2024-09-18T05:16:12.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8637e-05 2024-09-18T05:16:12.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.435 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:12.435 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:12.435 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:12.436 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:12.436 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:12.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:16:12.437 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:12.438 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:12.438 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:12.434+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:12.537 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:12.534+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:12.570 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:12.571 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:12.571 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:12.585 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:16:12.641 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:12.638+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:12.743 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:12.738+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:12.758 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:12.759 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:12.772 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:16:12.860 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:12.858+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:12.941 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:12.941 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189690448999997, 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.942 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:16:12.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.946 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189681458999999, 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:16:12.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:16:12.950 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189672492, 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:16:12.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189663709000001, 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:16:12.955 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:16:12.959 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189654933, 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.960 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.964 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189644641000001, 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:12.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:16:12.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:16:12.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189630754000007, 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189621548000005, 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.973 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:12.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:16:12.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:16:12.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189612850000003, 2024-09-18T05:16:12.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:16:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:16:12.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189603785000003, 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:16:12.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189580426999996, 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.986 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.990 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189570762000002, 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:16:12.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:16:12.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189544405000007, 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:12.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:16:12.998 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189530872999995, 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:12.999 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:16:13.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:16:13.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:13.003 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189519422000004, 2024-09-18T05:16:13.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:16:13.004 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.004 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.004 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.004 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.004 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.004 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:16:13.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.004 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:16:13.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189509940999997, 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.008 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:13.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189499858999994, 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:16:13.016 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189490770999996, 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:16:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189481213999997, 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.022 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:16:13.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.023 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:13.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:16:13.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:16:13.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.189472393000003, 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.030 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.031 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.031 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.031 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.031 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:13.032 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:16:13.033 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:13.030+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:13.133 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:13.130+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:13.211 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:13.211 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:13.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:16:13.268 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:13.266+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:13.335 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:13.330+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:13.392 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:13.392 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:13.392 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:13.392 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:13.392 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:13.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:16:13.448 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:13.446+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:13.537 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:13.534+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:13.572 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:13.572 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:13.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:13.572 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:13.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.572 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.572 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.90769371499999, 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:13.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:16:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.90762679700001, 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:16:13.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.90753828699999, 2024-09-18T05:16:13.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:16:13.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:16:13.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.907487731, 2024-09-18T05:16:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.907424616, 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:16:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:16:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.907377696, 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:16:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.598 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.90732381700001, 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.599 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:16:13.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.907276684, 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.603 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.607 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.907229062, 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:13.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.611 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.90710624099999, 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.612 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:13.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:16:13.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:16:13.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:16:13.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:16:13.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.90702491099999, 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:16:13.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:16:13.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:16:13.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.906953668, 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:16:13.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.626 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.906903457, 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.627 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:16:13.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.906826263, 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:16:13.631 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:16:13.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.906776393, 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:16:13.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:16:13.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.906701822, 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.640 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.906636044, 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:16:13.644 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:16:13.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.906589008, 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:16:13.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:16:13.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.906526915, 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:16:13.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:16:13.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 111.906480536, 2024-09-18T05:16:13.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:13.661 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:13.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:16:13.663 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:13.658+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:13.764 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:13.762+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:13.830 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:13.830 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:13.830 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:13.830 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:13.844 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:16:13.888 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:13.886+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:13.967 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:13.967 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:13.967 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:13.967 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:13.967 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:13.967 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:13.962+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:13.983 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:16:13.994 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:16:14.068 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:14.066+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:14.089 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 7, 6, 2] 2024-09-18T05:16:14.089 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:16:14.090 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-18T05:16:14.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T05:16:14.154 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121386 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 686080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194264077, 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056108969000000002, 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121386 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955696+0000", 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0874e-05 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955703+0000", 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3189999999999997e-06 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955708+0000", 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0429999999999998e-06 2024-09-18T05:16:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011705+0000", 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055996870999999997 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011743+0000", 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7895000000000002e-05 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011794+0000", 2024-09-18T05:16:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1307999999999997e-05 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121387 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 698368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194236494000002, 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056181659000000002, 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121387 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955712+0000", 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955715+0000", 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3760000000000002e-06 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955721+0000", 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2589999999999997e-06 2024-09-18T05:16:14.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955725+0000", 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4009999999999999e-06 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011813+0000", 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056088051999999999 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011848+0000", 2024-09-18T05:16:14.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4847e-05 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011894+0000", 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121388 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194219582000002, 2024-09-18T05:16:14.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056271570999999999, 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121388 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955729+0000", 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955731+0000", 2024-09-18T05:16:14.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2019999999999998e-06 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955737+0000", 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9139999999999996e-06 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955751+0000", 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3311e-05 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011914+0000", 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163594999999997 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011952+0000", 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7834999999999999e-05 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012001+0000", 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9084e-05 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121389 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 722944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194193452, 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056345279999999998, 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121389 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.168 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955755+0000", 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955759+0000", 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3850000000000002e-06 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955766+0000", 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8499999999999996e-06 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955771+0000", 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0170000000000004e-06 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012021+0000", 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056250737000000002 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012057+0000", 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5271000000000002e-05 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012101+0000", 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4403999999999997e-05 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121390 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 735232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:14.172 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194172524000003, 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056430889999999997, 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121390 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955776+0000", 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955779+0000", 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6290000000000002e-06 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955786+0000", 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.435e-06 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955791+0000", 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7520000000000004e-06 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012120+0000", 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056329443999999999 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012158+0000", 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7925e-05 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012208+0000", 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9301000000000001e-05 2024-09-18T05:16:14.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121391 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 747520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194141064, 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056498934000000001, 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.177 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121391 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955811+0000", 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9560000000000002e-06 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955818+0000", 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3339999999999996e-06 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955823+0000", 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2839999999999997e-06 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012227+0000", 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056403880000000003 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012262+0000", 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4618e-05 2024-09-18T05:16:14.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012307+0000", 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5413e-05 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121392 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194121228, 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056582623999999998, 2024-09-18T05:16:14.181 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121392 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955830+0000", 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999998e-06 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955837+0000", 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955842+0000", 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6770000000000003e-06 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012326+0000", 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056483691000000003 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012363+0000", 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7024999999999999e-05 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012411+0000", 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7845e-05 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121393 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 772096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194102807999997, 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056662902000000001, 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121393 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955848+0000", 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2350000000000002e-06 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955855+0000", 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0500000000000003e-06 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955860+0000", 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8080000000000004e-06 2024-09-18T05:16:14.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012430+0000", 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056570047999999998 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012465+0000", 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4718000000000002e-05 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012509+0000", 2024-09-18T05:16:14.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4418000000000001e-05 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121394 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 784384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194084916000001, 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056750383000000001, 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121394 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955866+0000", 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955873+0000", 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4810000000000003e-06 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955878+0000", 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8500000000000002e-06 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012529+0000", 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056651708000000002 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012567+0000", 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7642000000000003e-05 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012615+0000", 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7811e-05 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121395 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194067548, 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056832344999999999, 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121395 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:14.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955881+0000", 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955884+0000", 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3240000000000001e-06 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955890+0000", 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0909999999999998e-06 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955894+0000", 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012635+0000", 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056740087000000002 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012670+0000", 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5123999999999998e-05 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012714+0000", 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4384000000000001e-05 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.198 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121396 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 808960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194035073999999, 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057018234000000001, 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121396 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955917+0000", 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0979999999999998e-06 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955930+0000", 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3552e-05 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955936+0000", 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7309999999999998e-06 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012733+0000", 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056797146999999999 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012770+0000", 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7239e-05 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012932+0000", 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016205000000000001 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121397 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 821248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.194008416999999, 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057105428999999999, 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121397 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.203 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955940+0000", 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955943+0000", 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7439999999999999e-06 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955950+0000", 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8129999999999998e-06 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955957+0000", 2024-09-18T05:16:14.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1849999999999998e-06 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012953+0000", 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056995559000000001 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012987+0000", 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4777000000000003e-05 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013046+0000", 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8867999999999999e-05 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121398 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 833536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.193987540000002, 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057212333999999997, 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121398 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955961+0000", 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955970+0000", 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6759999999999996e-06 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955981+0000", 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0706999999999999e-05 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955986+0000", 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0719999999999999e-06 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013067+0000", 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057081595999999998 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013111+0000", 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3331999999999998e-05 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013174+0000", 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3323000000000003e-05 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121399 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.193958528000003, 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057281034000000002, 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121399 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955990+0000", 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955993+0000", 2024-09-18T05:16:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955999+0000", 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4699999999999999e-06 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.956004+0000", 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013194+0000", 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057189503000000003 2024-09-18T05:16:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013233+0000", 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9082000000000003e-05 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013272+0000", 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9014000000000003e-05 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121415 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.191126292, 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023800999999998, 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121415 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958825+0000", 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.835e-06 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958831+0000", 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.088e-06 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958842+0000", 2024-09-18T05:16:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0916e-05 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014771+0000", 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055928731000000002 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014809+0000", 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7713999999999998e-05 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014847+0000", 2024-09-18T05:16:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7888e-05 2024-09-18T05:16:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121416 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 528384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.191101046999997, 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056112120000000001, 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121416 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958850+0000", 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.729e-06 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958858+0000", 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958866+0000", 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2840000000000006e-06 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014866+0000", 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056000419000000003 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014907+0000", 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0533e-05 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014960+0000", 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3427000000000002e-05 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121417 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 540672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.191077599000003, 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056196533999999999, 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121417 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958871+0000", 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958874+0000", 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.537e-06 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958881+0000", 2024-09-18T05:16:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1840000000000002e-06 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958886+0000", 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014981+0000", 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056095036000000001 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015017+0000", 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6732e-05 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015068+0000", 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0855e-05 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121418 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 552960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.190984471999997, 2024-09-18T05:16:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056223713000000002, 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121418 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958889+0000", 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999247 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958968+0000", 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8638000000000002e-05 2024-09-18T05:16:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958990+0000", 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1614e-05 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959004+0000", 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4157e-05 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015088+0000", 2024-09-18T05:16:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056084547999999998 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015129+0000", 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1048999999999999e-05 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015188+0000", 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8967e-05 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121420 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 577536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.190568747999997, 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056036506999999999, 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121420 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959383+0000", 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3689999999999998e-06 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959390+0000", 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1799999999999999e-06 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959396+0000", 2024-09-18T05:16:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5330000000000002e-06 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015330+0000", 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055934086000000001 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015369+0000", 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8732000000000001e-05 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015417+0000", 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8241000000000001e-05 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121421 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 589824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.190548135, 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056116280999999997, 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121421 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959403+0000", 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6989999999999999e-06 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959409+0000", 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1099999999999999e-06 2024-09-18T05:16:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959414+0000", 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6190000000000002e-06 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015437+0000", 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023252000000003 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015473+0000", 2024-09-18T05:16:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6086e-05 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015517+0000", 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4082999999999998e-05 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:14.242 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:14.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:16:14.244 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:14.238+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:14.345 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:14.342+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:14.398 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:14.398 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:14.398 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 143, 2024-09-18T05:16:14.398 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "04ac0d2c-34bd-46ad-a307-a4eb23236eb4", 2024-09-18T05:16:14.398 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2024-09-18T05:13:15.193498+0000", 2024-09-18T05:16:14.398 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2024-09-18T05:16:13.966474+0000", 2024-09-18T05:16:14.398 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2024-09-18T05:15:54.176883+0000", 2024-09-18T05:16:14.398 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2024-09-18T05:13:18.221936+0000", 2024-09-18T05:16:14.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5806080, 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "nodeep-scrub", 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "noscrub", 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 6, 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T05:16:14.399 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 3, 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "luminous", 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:28.629114+0000", 2024-09-18T05:16:14.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2024-09-18T05:16:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "17", 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:16:14.402 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:16:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:16:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2024-09-18T05:16:14.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.904327392578125, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2024-09-18T05:16:14.406 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:34.103981+0000", 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:16:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "21", 2024-09-18T05:16:14.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 3, 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 21, 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:16:14.409 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:16:14.410 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:16:14.411 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2.9900000095367432, 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2.9900000095367432, 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2.630000114440918, 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2.630000114440918, 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.904327392578125, 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "pool_client.0", 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2024-09-18T05:13:44.114945+0000", 2024-09-18T05:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 8193, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2024-09-18T05:16:14.413 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "143", 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T05:16:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 88, 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 143, 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2024-09-18T05:16:14.415 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2024-09-18T05:16:14.416 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2024-09-18T05:16:14.417 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 0.904327392578125, 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "a2a580f7-2bbc-46c3-b6b5-5a9e93539d27", 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:14.418 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 130, 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-18T05:16:14.419 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.421 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:14.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2024-09-18T05:16:14.423 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1558450642 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1558450642", 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1558450642", 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1558450642", 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1558450642", 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "260da429-e6eb-446b-95a0-dcf4581bb584", 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 129, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:14.425 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.426 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.427 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2024-09-18T05:16:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3444575073 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/3444575073", 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/3444575073", 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/3444575073", 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/3444575073", 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "0cf5d53a-552d-4775-8437-86af3465b1bc", 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 13, 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 100, 2024-09-18T05:16:14.431 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 123, 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 136, 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 101, 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.435 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1738914066 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/1738914066", 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/1738914066", 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/1738914066", 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/1738914066", 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "73bc18b6-4972-4164-a294-b6372bcf9f9d", 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 135, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:14.437 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:14.440 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3763834627 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/3763834627", 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/3763834627", 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/3763834627", 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/3763834627", 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.442 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "536c8ef2-eca6-44b4-a70c-06f191eb5ff1", 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 123, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:14.443 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6800", 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6802", 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6804", 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6806", 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.445 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6815", 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6819", 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6809", 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6812", 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1703780253 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6802/1703780253", 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6806/1703780253", 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6819/1703780253", 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6812/1703780253", 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "4341bba4-2913-4352-89d4-36fa18ee39cb", 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:14.448 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 0.234619140625, 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 101, 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6808", 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:14.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6811", 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6813", 2024-09-18T05:16:14.450 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6816", 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6822", 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6823", 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6817", 2024-09-18T05:16:14.452 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6820", 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3348904742 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6811/3348904742", 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6816/3348904742", 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6823/3348904742", 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6820/3348904742", 2024-09-18T05:16:14.453 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "e47d4aad-9c4b-43a9-9b32-2db463ec2a20", 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 13, 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 47, 2024-09-18T05:16:14.454 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 61, 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 131, 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 48, 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6801", 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6803", 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:14.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6805", 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6807", 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6818", 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6821", 2024-09-18T05:16:14.457 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6810", 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6814", 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3446120186 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6803/3446120186", 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6807/3446120186", 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6821/3446120186", 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6814/3446120186", 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "686d275c-e592-44c1-87f9-ac9718f3a112", 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 48, 2024-09-18T05:16:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6824", 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6825", 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.461 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6826", 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6827", 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.462 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6830", 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.463 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6831", 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6828", 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6829", 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1345159853 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6825/1345159853", 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6827/1345159853", 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6831/1345159853", 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6829/1345159853", 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2024-09-18T05:16:14.465 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.758535+0000", 2024-09-18T05:16:14.466 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.800715+0000", 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2024-09-18T05:16:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.783374+0000", 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 101 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:14.468 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.779519+0000", 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.893837+0000", 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.469 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.776852+0000", 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.919808+0000", 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 48 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2024-09-18T05:16:14.471 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2024-09-18T05:13:23.883599+0000", 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [ 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "3.2", 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: 1, 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: 5 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "3.7", 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: 2, 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: 3 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [ 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "3.f", 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 7, 2024-09-18T05:16:14.473 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 3 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2024-09-18T05:16:14.474 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [ 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: "snaps": [ 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: "begin": 11, 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: "length": 10 2024-09-18T05:16:14.475 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [ 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: "snaps": [ 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: "begin": 11, 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: "length": 1 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:14.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:14.477 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:14.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:16:14.480 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:14.480 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:14.480 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:14.480 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:14.481 INFO:tasks.thrashosds.thrasher:j is {'epoch': 143, 'fsid': '04ac0d2c-34bd-46ad-a307-a4eb23236eb4', 'created': '2024-09-18T05:13:15.193498+0000', 'modified': '2024-09-18T05:16:13.966474+0000', 'last_up_change': '2024-09-18T05:15:54.176883+0000', 'last_in_change': '2024-09-18T05:13:18.221936+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T05:13:28.629114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.904327392578125, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T05:13:34.103981+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.904327392578125, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T05:13:44.114945+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 88, 'snap_epoch': 143, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.904327392578125, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': 'a2a580f7-2bbc-46c3-b6b5-5a9e93539d27', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6800', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6801', 'nonce': 1558450642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 1558450642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6806', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6807', 'nonce': 1558450642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6804', 'nonce': 1558450642}, {'type': 'v1', 'addr': '172.21.15.17:6805', 'nonce': 1558450642}]}, 'public_addr': '172.21.15.17:6801/1558450642', 'cluster_addr': '172.21.15.17:6803/1558450642', 'heartbeat_back_addr': '172.21.15.17:6807/1558450642', 'heartbeat_front_addr': '172.21.15.17:6805/1558450642', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '260da429-e6eb-446b-95a0-dcf4581bb584', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 129, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6808', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6809', 'nonce': 3444575073}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6811', 'nonce': 3444575073}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6814', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6815', 'nonce': 3444575073}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6812', 'nonce': 3444575073}, {'type': 'v1', 'addr': '172.21.15.17:6813', 'nonce': 3444575073}]}, 'public_addr': '172.21.15.17:6809/3444575073', 'cluster_addr': '172.21.15.17:6811/3444575073', 'heartbeat_back_addr': '172.21.15.17:6815/3444575073', 'heartbeat_front_addr': '172.21.15.17:6813/3444575073', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0cf5d53a-552d-4775-8437-86af3465b1bc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 100, 'up_from': 123, 'up_thru': 136, 'down_at': 101, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6816', 'nonce': 1738914066}, {'type': 'v1', 'addr': '172.21.15.17:6817', 'nonce': 1738914066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6818', 'nonce': 1738914066}, {'type': 'v1', 'addr': '172.21.15.17:6819', 'nonce': 1738914066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6822', 'nonce': 1738914066}, {'type': 'v1', 'addr': '172.21.15.17:6823', 'nonce': 1738914066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6820', 'nonce': 1738914066}, {'type': 'v1', 'addr': '172.21.15.17:6821', 'nonce': 1738914066}]}, 'public_addr': '172.21.15.17:6817/1738914066', 'cluster_addr': '172.21.15.17:6819/1738914066', 'heartbeat_back_addr': '172.21.15.17:6823/1738914066', 'heartbeat_front_addr': '172.21.15.17:6821/1738914066', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '73bc18b6-4972-4164-a294-b6372bcf9f9d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6824', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6825', 'nonce': 3763834627}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6826', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6827', 'nonce': 3763834627}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6830', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6831', 'nonce': 3763834627}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6828', 'nonce': 3763834627}, {'type': 'v1', 'addr': '172.21.15.17:6829', 'nonce': 3763834627}]}, 'public_addr': '172.21.15.17:6825/3763834627', 'cluster_addr': '172.21.15.17:6827/3763834627', 'heartbeat_back_addr': '172.21.15.17:6831/3763834627', 'heartbeat_front_addr': '172.21.15.17:6829/3763834627', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '536c8ef2-eca6-44b4-a70c-06f191eb5ff1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 123, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6802', 'nonce': 1703780253}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6806', 'nonce': 1703780253}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6815', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 1703780253}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6809', 'nonce': 1703780253}, {'type': 'v1', 'addr': '172.21.15.86:6812', 'nonce': 1703780253}]}, 'public_addr': '172.21.15.86:6802/1703780253', 'cluster_addr': '172.21.15.86:6806/1703780253', 'heartbeat_back_addr': '172.21.15.86:6819/1703780253', 'heartbeat_front_addr': '172.21.15.86:6812/1703780253', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4341bba4-2913-4352-89d4-36fa18ee39cb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.234619140625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 3348904742}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6813', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6816', 'nonce': 3348904742}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6823', 'nonce': 3348904742}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6817', 'nonce': 3348904742}, {'type': 'v1', 'addr': '172.21.15.86:6820', 'nonce': 3348904742}]}, 'public_addr': '172.21.15.86:6811/3348904742', 'cluster_addr': '172.21.15.86:6816/3348904742', 'heartbeat_back_addr': '172.21.15.86:6823/3348904742', 'heartbeat_front_addr': '172.21.15.86:6820/3348904742', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e47d4aad-9c4b-43a9-9b32-2db463ec2a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 47, 'up_from': 61, 'up_thru': 131, 'down_at': 48, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6801', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 3446120186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6805', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 3446120186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 3446120186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 3446120186}, {'type': 'v1', 'addr': '172.21.15.86:6814', 'nonce': 3446120186}]}, 'public_addr': '172.21.15.86:6803/3446120186', 'cluster_addr': '172.21.15.86:6807/3446120186', 'heartbeat_back_addr': '172.21.15.86:6821/3446120186', 'heartbeat_front_addr': '172.21.15.86:6814/3446120186', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '686d275c-e592-44c1-87f9-ac9718f3a112', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 1345159853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6826', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 1345159853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6830', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 1345159853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 1345159853}, {'type': 'v1', 'addr': '172.21.15.86:6829', 'nonce': 1345159853}]}, 'public_addr': '172.21.15.86:6825/1345159853', 'cluster_addr': '172.21.15.86:6827/1345159853', 'heartbeat_back_addr': '172.21.15.86:6831/1345159853', 'heartbeat_front_addr': '172.21.15.86:6829/1345159853', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.758535+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.800715+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.783374+0000', 'dead_epoch': 101}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.779519+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.893837+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.776852+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.919808+0000', 'dead_epoch': 48}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T05:13:23.883599+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.2', 'osds': [1, 5]}, {'pgid': '3.7', 'osds': [2, 3]}], 'pg_upmap_items': [{'pgid': '3.f', 'mappings': [{'from': 7, 'to': 3}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 11, 'length': 10}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 11, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T05:16:14.481 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.7 2024-09-18T05:16:14.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.7 2024-09-18T05:16:14.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:14.474+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:14.482 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:16:14.580 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:14.578+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:14.651 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:14.651 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:14.651 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:14.651 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:14.651 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:14.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:16:14.680 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:14.680 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:14.681 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:14.674+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:14.696 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:14.696 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:14.712 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:14.728 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:14.728 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:14.748 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:14.765 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:14.765 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:14.782 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:14.778+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:14.785 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:15.192 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:15.193 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:15.193 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:15.194 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:16:15.194 INFO:teuthology.orchestra.run.smithi017.stderr:clear 3.7 pg_upmap mapping 2024-09-18T05:16:15.196 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:15.196 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:15.197 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:16:15.238 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:15.234+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:15.297 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:15.294+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:15.372 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:15.372 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:15.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:16:15.434 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:15.430+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:15.499 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:15.494+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:15.506 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:15.507 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:15.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:16:15.600 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:15.598+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:15.690 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:15.690 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:15.701 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:15.694+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:15.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:16:15.802 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:15.798+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:15.885 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:16:15.906 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:15.902+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:16.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:15.998+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:16.024 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:16.024 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:16.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:16:16.130 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:16.126+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:16.206 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:16.202+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:16.214 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:16.214 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:16.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:16:16.307 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:16.302+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:16.398 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:16.398 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:16.408 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:16.402+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:16.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:16:16.509 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:16.502+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:16.573 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:16.573 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:16.588 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:16:16.634 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:16.630+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:16.711 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:16.706+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:16.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:16:16.822 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:16.818+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:16.909 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:16.909 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:16.913 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:16.910+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:16.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:16:17.014 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:17.010+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:17.094 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:17.094 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:17.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:16:17.154 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:17.150+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:17.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:16:17.196 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:16:17.215 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:17.210+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:17.228 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:17.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:16:17.317 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:17.310+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:17.341 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:17.357 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:17.373 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:17.373 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:17.374 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:17.374 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:17.391 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:17.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:16:17.407 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:17.408 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:17.425 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:17.425 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:17.440 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:17.438+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:17.442 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:17.460 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:17.513 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:17.513 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:17.513 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:17.514 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:17.514 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:17.522 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:17.518+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:17.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:16:17.621 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:17.618+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:17.697 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:17.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76204 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947170467999996, 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069806603999999994, 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76204 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747516+0000", 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747517+0000", 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747520+0000", 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0860000000000002e-06 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747523+0000", 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817154+0000", 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069631435000000005 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817244+0000", 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9506999999999995e-05 2024-09-18T05:16:17.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817322+0000", 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8907999999999997e-05 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76205 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 782336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947161477999998, 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069943065999999998, 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.702 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76205 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747525+0000", 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747526+0000", 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.251e-06 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747529+0000", 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9160000000000001e-06 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747531+0000", 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.745e-06 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817353+0000", 2024-09-18T05:16:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069822001999999994 2024-09-18T05:16:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817419+0000", 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5544999999999997e-05 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817468+0000", 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.884e-05 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76206 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947152510999999, 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070134048000000004, 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76206 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747534+0000", 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747535+0000", 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.282e-06 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747538+0000", 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0149999999999999e-06 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747540+0000", 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4830000000000002e-06 2024-09-18T05:16:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817502+0000", 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.069961976999999995 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817592+0000", 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9229999999999998e-05 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817668+0000", 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6285000000000006e-05 2024-09-18T05:16:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76207 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 917504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947143728, 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070283348999999995, 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76207 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747543+0000", 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747542+0000", 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747544+0000", 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2389999999999999e-06 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747547+0000", 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9340000000000002e-06 2024-09-18T05:16:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747549+0000", 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6120000000000001e-06 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817698+0000", 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070149109000000001 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817766+0000", 2024-09-18T05:16:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8162000000000002e-05 2024-09-18T05:16:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817826+0000", 2024-09-18T05:16:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9518000000000002e-05 2024-09-18T05:16:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76208 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 958464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947134951999999, 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070475890999999999, 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76208 2024-09-18T05:16:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747551+0000", 2024-09-18T05:16:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747552+0000", 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2529999999999999e-06 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747555+0000", 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8990000000000001e-06 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747558+0000", 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6400000000000001e-06 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817859+0000", 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070300725999999994 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.817947+0000", 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8258999999999996e-05 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818027+0000", 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0338000000000002e-05 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76209 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.94712466, 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070612738999999994, 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76209 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747562+0000", 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747561+0000", 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747566+0000", 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1019999999999999e-06 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747569+0000", 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.213e-06 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747571+0000", 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6199999999999999e-06 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818058+0000", 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070486715000000005 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818124+0000", 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6200999999999999e-05 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818174+0000", 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0114999999999997e-05 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76210 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 544768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947110773000006, 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070803910999999997, 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76210 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747576+0000", 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747575+0000", 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747577+0000", 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747580+0000", 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747583+0000", 2024-09-18T05:16:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7269999999999999e-06 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818207+0000", 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070624733999999995 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818300+0000", 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2589000000000004e-05 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818379+0000", 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9569999999999999e-05 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76211 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947101567000004, 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070941836999999994, 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.730 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76211 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747585+0000", 2024-09-18T05:16:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747584+0000", 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747586+0000", 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.313e-06 2024-09-18T05:16:17.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747589+0000", 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9189999999999999e-06 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747591+0000", 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.604e-06 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818413+0000", 2024-09-18T05:16:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070821836999999999 2024-09-18T05:16:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818476+0000", 2024-09-18T05:16:17.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3066999999999998e-05 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818527+0000", 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0330000000000001e-05 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.735 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76212 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947092869000002, 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071134485999999997, 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76212 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747593+0000", 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747595+0000", 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.46e-06 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747598+0000", 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0019999999999998e-06 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747600+0000", 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.565e-06 2024-09-18T05:16:17.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818561+0000", 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.070961061000000006 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818651+0000", 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9622000000000004e-05 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818728+0000", 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7000000000000001e-05 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76213 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 798720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947083804000002, 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071280316999999996, 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.740 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76213 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747602+0000", 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747603+0000", 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2300000000000001e-06 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747606+0000", 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747609+0000", 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6340000000000001e-06 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818759+0000", 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071149638000000001 2024-09-18T05:16:17.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818821+0000", 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2235000000000003e-05 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818883+0000", 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1860999999999996e-05 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76214 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 839680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947060445999995, 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071461070000000002, 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76214 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.745 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747626+0000", 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747625+0000", 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747627+0000", 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8589999999999999e-06 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747631+0000", 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.507e-06 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747633+0000", 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6860000000000002e-06 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.818919+0000", 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071285881999999995 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819009+0000", 2024-09-18T05:16:17.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0109000000000001e-05 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819087+0000", 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7527999999999994e-05 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76215 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 626688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947050781000002, 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071597852000000003, 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76215 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747636+0000", 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747635+0000", 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747637+0000", 2024-09-18T05:16:17.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2610000000000001e-06 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747640+0000", 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-06 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747642+0000", 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.593e-06 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819120+0000", 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071477843999999999 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819184+0000", 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3517999999999997e-05 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819233+0000", 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9775999999999999e-05 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.753 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76216 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 880640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947024424000006, 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071792721000000004, 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.754 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76216 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747662+0000", 2024-09-18T05:16:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747663+0000", 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.482e-06 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747670+0000", 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2609999999999996e-06 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747673+0000", 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819266+0000", 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071592938999999994 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819371+0000", 2024-09-18T05:16:17.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105534 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819455+0000", 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3096999999999994e-05 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.759 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76217 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 921600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.947010891999994, 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071928317000000005, 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76217 2024-09-18T05:16:17.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:17.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747675+0000", 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747677+0000", 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.328e-06 2024-09-18T05:16:17.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747679+0000", 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.92e-06 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747682+0000", 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8540000000000001e-06 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819487+0000", 2024-09-18T05:16:17.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071804704999999996 2024-09-18T05:16:17.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819553+0000", 2024-09-18T05:16:17.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6155999999999995e-05 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819604+0000", 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76218 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 667648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.946999441000003, 2024-09-18T05:16:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072236076999999996, 2024-09-18T05:16:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76218 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747687+0000", 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747686+0000", 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747688+0000", 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.502e-06 2024-09-18T05:16:17.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747691+0000", 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747694+0000", 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-18T05:16:17.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819639+0000", 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071944745000000004 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819761+0000", 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012219800000000001 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819923+0000", 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161941 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76219 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 962560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.946989959999996, 2024-09-18T05:16:17.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072349759, 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76219 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747696+0000", 2024-09-18T05:16:17.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747697+0000", 2024-09-18T05:16:17.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:17.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747700+0000", 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9689999999999999e-06 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747704+0000", 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.817e-06 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819945+0000", 2024-09-18T05:16:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072240482999999994 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.819997+0000", 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2686999999999999e-05 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820046+0000", 2024-09-18T05:16:17.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8757000000000001e-05 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76220 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.946979877999993, 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719143, 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.777 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76220 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747706+0000", 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747707+0000", 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559999999999999e-06 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747710+0000", 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747713+0000", 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8930000000000001e-06 2024-09-18T05:16:17.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820115+0000", 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072401726999999999 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820281+0000", 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016618000000000001 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820426+0000", 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014432299999999999 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76221 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:17.782 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.946970789999995, 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072853287000000003, 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76221 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:17.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747715+0000", 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747717+0000", 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.254e-06 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747720+0000", 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747722+0000", 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820472+0000", 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072749707999999996 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820522+0000", 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0127999999999998e-05 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820569+0000", 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6635000000000003e-05 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76222 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 749568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.946961232999996, 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073210631999999998, 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76222 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.788 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747725+0000", 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747726+0000", 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.229e-06 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747729+0000", 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.18e-06 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747732+0000", 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.548e-06 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820622+0000", 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072889948999999996 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820789+0000", 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016746999999999999 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820936+0000", 2024-09-18T05:16:17.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014647999999999999 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:76223 3.14 3:2d9a05c9:::rbd_data.118b23c698ea.000000000000002d:23 [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.946952412000002, 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073392391000000001, 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.793 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76223 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747734+0000", 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747735+0000", 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.389e-06 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747738+0000", 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9660000000000001e-06 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.747741+0000", 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5830000000000001e-06 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.820980+0000", 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073239206000000001 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821047+0000", 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7331999999999998e-05 2024-09-18T05:16:17.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:58.821126+0000", 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9160999999999996e-05 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:17.798 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:17.800 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:16:17.801 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:17.798+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:17.901 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:17.898+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:16:17.994 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:17.994 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:17.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.994 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:133172 3.16 3:6ebe657a:::rbd_header.118bd6f23a9d:head [call lock.unlock in=52b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-18T05:16:17.994 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:16:17.992017+0000", 2024-09-18T05:16:17.994 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00097204699999999997, 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010031249999999999, 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "waiting for sub ops", 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 133172 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:17.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:16:17.992017+0000", 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:16:17.992017+0000", 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:16:17.992016+0000", 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:16:17.992023+0000", 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8800000000000002e-06 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:16:17.992037+0000", 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4154e-05 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:16:17.992043+0000", 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4200000000000004e-06 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:16:17.992102+0000", 2024-09-18T05:16:17.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8127000000000001e-05 2024-09-18T05:16:17.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:17.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:16:17.992204+0000", 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102044 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:16:17.992409+0000", 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020556700000000001 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.000 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.001 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.001 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-18T05:16:18.001 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 1 2024-09-18T05:16:18.001 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:18.002 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:17.998+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:18.010 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:16:18.103 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:18.098+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:18.177 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:18.177 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:18.177 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:18.177 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:18.177 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:18.192 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:16:18.236 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:18.234+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:18.305 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:18.302+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:18.315 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:18.315 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:18.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.65127498299999, 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:16:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:16:18.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:18.320 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.65120806500001, 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:16:18.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.65111955499999, 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.325 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.329 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.651068999, 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:16:18.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.651005884, 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:16:18.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:18.338 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650958964, 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:16:18.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.65090508500001, 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:16:18.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650857952, 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.347 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.351 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.65081033, 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:18.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:16:18.355 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.65068750899999, 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.356 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:16:18.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:16:18.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:16:18.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:16:18.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.360 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.65060617899999, 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:16:18.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:16:18.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650534936, 2024-09-18T05:16:18.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:16:18.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:16:18.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650484725, 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.370 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:16:18.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:16:18.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650407531, 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:16:18.374 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:16:18.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650357661, 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:16:18.382 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.65028309, 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:16:18.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650217312, 2024-09-18T05:16:18.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:16:18.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.391 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650170276, 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:16:18.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650108183, 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.396 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.650061804, 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:18.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:16:18.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:16:18.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.405 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.405 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.405 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:18.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:16:18.408 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:18.402+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:18.507 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:18.502+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:18.577 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:18.577 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:18.577 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:18.577 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:18.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:16:18.632 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:18.630+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:18.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:18.702+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:18.752 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:18.752 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:18.752 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:18.752 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:18.752 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:18.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:16:18.812 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:18.810+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:18.891 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:18.891 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:18.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121386 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 686080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931802003000001, 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056108969000000002, 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.892 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121386 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955696+0000", 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0874e-05 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955703+0000", 2024-09-18T05:16:18.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3189999999999997e-06 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955708+0000", 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0429999999999998e-06 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011705+0000", 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055996870999999997 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011743+0000", 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7895000000000002e-05 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011794+0000", 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1307999999999997e-05 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.896 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121387 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 698368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931774419999996, 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056181659000000002, 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121387 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955712+0000", 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955715+0000", 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3760000000000002e-06 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955721+0000", 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2589999999999997e-06 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955725+0000", 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4009999999999999e-06 2024-09-18T05:16:18.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011813+0000", 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056088051999999999 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011848+0000", 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4847e-05 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011894+0000", 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121388 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931757507999997, 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056271570999999999, 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.901 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121388 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955729+0000", 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955731+0000", 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2019999999999998e-06 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955737+0000", 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9139999999999996e-06 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955751+0000", 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3311e-05 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011914+0000", 2024-09-18T05:16:18.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163594999999997 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011952+0000", 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7834999999999999e-05 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012001+0000", 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9084e-05 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.905 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121389 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 722944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931731378000002, 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056345279999999998, 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.906 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121389 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955755+0000", 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955759+0000", 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3850000000000002e-06 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955766+0000", 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8499999999999996e-06 2024-09-18T05:16:18.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955771+0000", 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0170000000000004e-06 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012021+0000", 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056250737000000002 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012057+0000", 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5271000000000002e-05 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012101+0000", 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4403999999999997e-05 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.910 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121390 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 735232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931710449999997, 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056430889999999997, 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121390 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955776+0000", 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955779+0000", 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6290000000000002e-06 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955786+0000", 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.435e-06 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955791+0000", 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7520000000000004e-06 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012120+0000", 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056329443999999999 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012158+0000", 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7925e-05 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012208+0000", 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9301000000000001e-05 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121391 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 747520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931678990000002, 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056498934000000001, 2024-09-18T05:16:18.915 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121391 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955811+0000", 2024-09-18T05:16:18.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9560000000000002e-06 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955818+0000", 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3339999999999996e-06 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955823+0000", 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2839999999999997e-06 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012227+0000", 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056403880000000003 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012262+0000", 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4618e-05 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012307+0000", 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5413e-05 2024-09-18T05:16:18.919 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121392 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931659154000002, 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056582623999999998, 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.920 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121392 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:18.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955830+0000", 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999998e-06 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955837+0000", 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955842+0000", 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6770000000000003e-06 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012326+0000", 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056483691000000003 2024-09-18T05:16:18.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012363+0000", 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7024999999999999e-05 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012411+0000", 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7845e-05 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121393 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 772096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931640733999998, 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056662902000000001, 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121393 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.925 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955848+0000", 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2350000000000002e-06 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955855+0000", 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0500000000000003e-06 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955860+0000", 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8080000000000004e-06 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012430+0000", 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056570047999999998 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012465+0000", 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4718000000000002e-05 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012509+0000", 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4418000000000001e-05 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121394 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 784384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931622842000003, 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056750383000000001, 2024-09-18T05:16:18.929 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121394 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955866+0000", 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:16:18.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955873+0000", 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4810000000000003e-06 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955878+0000", 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8500000000000002e-06 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012529+0000", 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056651708000000002 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012567+0000", 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7642000000000003e-05 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012615+0000", 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7811e-05 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.933 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121395 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931605474000001, 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056832344999999999, 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.934 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121395 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955881+0000", 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955884+0000", 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3240000000000001e-06 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955890+0000", 2024-09-18T05:16:18.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0909999999999998e-06 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955894+0000", 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012635+0000", 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056740087000000002 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012670+0000", 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5123999999999998e-05 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012714+0000", 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4384000000000001e-05 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.938 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121396 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 808960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931573, 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057018234000000001, 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121396 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955917+0000", 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0979999999999998e-06 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955930+0000", 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3552e-05 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955936+0000", 2024-09-18T05:16:18.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7309999999999998e-06 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012733+0000", 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056797146999999999 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012770+0000", 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7239e-05 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012932+0000", 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016205000000000001 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121397 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 821248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931546343000001, 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057105428999999999, 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121397 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955940+0000", 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955943+0000", 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7439999999999999e-06 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955950+0000", 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8129999999999998e-06 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955957+0000", 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1849999999999998e-06 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012953+0000", 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056995559000000001 2024-09-18T05:16:18.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012987+0000", 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4777000000000003e-05 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013046+0000", 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8867999999999999e-05 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121398 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 833536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931525465999997, 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057212333999999997, 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121398 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955961+0000", 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955970+0000", 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6759999999999996e-06 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955981+0000", 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0706999999999999e-05 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955986+0000", 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0719999999999999e-06 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013067+0000", 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057081595999999998 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013111+0000", 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3331999999999998e-05 2024-09-18T05:16:18.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013174+0000", 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3323000000000003e-05 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121399 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.931496453999998, 2024-09-18T05:16:18.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057281034000000002, 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121399 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955990+0000", 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955993+0000", 2024-09-18T05:16:18.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955999+0000", 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4699999999999999e-06 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.956004+0000", 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013194+0000", 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057189503000000003 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013233+0000", 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9082000000000003e-05 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013272+0000", 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9014000000000003e-05 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.956 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121415 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.928664218000002, 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023800999999998, 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.957 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121415 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958825+0000", 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.835e-06 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958831+0000", 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.088e-06 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958842+0000", 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0916e-05 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014771+0000", 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055928731000000002 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014809+0000", 2024-09-18T05:16:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7713999999999998e-05 2024-09-18T05:16:18.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014847+0000", 2024-09-18T05:16:18.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7888e-05 2024-09-18T05:16:18.961 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.961 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.961 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121416 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 528384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.928638972999998, 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056112120000000001, 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121416 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.962 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958850+0000", 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.729e-06 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958858+0000", 2024-09-18T05:16:18.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958866+0000", 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2840000000000006e-06 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014866+0000", 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056000419000000003 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014907+0000", 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0533e-05 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014960+0000", 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3427000000000002e-05 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121417 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 540672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.928615524999998, 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056196533999999999, 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121417 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958871+0000", 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958874+0000", 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.537e-06 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958881+0000", 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1840000000000002e-06 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958886+0000", 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014981+0000", 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056095036000000001 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015017+0000", 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6732e-05 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015068+0000", 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0855e-05 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121418 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 552960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.928522397999998, 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056223713000000002, 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.971 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121418 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958889+0000", 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999247 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958968+0000", 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8638000000000002e-05 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958990+0000", 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1614e-05 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959004+0000", 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4157e-05 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015088+0000", 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056084547999999998 2024-09-18T05:16:18.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015129+0000", 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1048999999999999e-05 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015188+0000", 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8967e-05 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121420 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 577536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.928106673999999, 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056036506999999999, 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121420 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959383+0000", 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3689999999999998e-06 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959390+0000", 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1799999999999999e-06 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959396+0000", 2024-09-18T05:16:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5330000000000002e-06 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015330+0000", 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055934086000000001 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015369+0000", 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8732000000000001e-05 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015417+0000", 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8241000000000001e-05 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121421 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 589824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.928086061000002, 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056116280999999997, 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:18.980 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121421 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:18.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959403+0000", 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6989999999999999e-06 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959409+0000", 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1099999999999999e-06 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959414+0000", 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6190000000000002e-06 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015437+0000", 2024-09-18T05:16:18.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023252000000003 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015473+0000", 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6086e-05 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015517+0000", 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4082999999999998e-05 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.984 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.985 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.985 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:18.985 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:18.985 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:18.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:16:18.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:18.982+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:19.087 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:19.082+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:19.160 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:19.160 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:19.175 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:16:19.188 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:19.182+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:19.289 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:19.286+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:19.340 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:19.341 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:19.341 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:19.341 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:19.341 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:19.355 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:16:19.391 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:19.386+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:19.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T05:16:19.491 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:19.486+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:19.516 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:19.516 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:19.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:102332 3.10 3:0b2ae2d1:::rbd_data.118b62cc3496.000000000000001a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 67.385060817999999, 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.065837997999999995, 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102332 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.517 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126923+0000", 2024-09-18T05:16:19.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:19.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126935+0000", 2024-09-18T05:16:19.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1970000000000001e-05 2024-09-18T05:16:19.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126960+0000", 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4888999999999998e-05 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126980+0000", 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0642999999999999e-05 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127082+0000", 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101118 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127332+0000", 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000250771 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.140319+0000", 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012987115 2024-09-18T05:16:19.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192666+0000", 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052346629999999998 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192681+0000", 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4769e-05 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192726+0000", 2024-09-18T05:16:19.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4925000000000001e-05 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192763+0000", 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7141000000000002e-05 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121156 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2064384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.620682975000001, 2024-09-18T05:16:19.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038247947999999997, 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121156 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891302+0000", 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891314+0000", 2024-09-18T05:16:19.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1557e-05 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891321+0000", 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7619999999999998e-06 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891325+0000", 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6600000000000003e-06 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929365+0000", 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038039942 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929467+0000", 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101191 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929551+0000", 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4220000000000003e-05 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.528 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121157 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2076672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.620655835999997, 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038423377000000002, 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.530 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121157 2024-09-18T05:16:19.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.530 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891332+0000", 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891338+0000", 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9800000000000003e-06 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891342+0000", 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3470000000000001e-06 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929593+0000", 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038250926999999997 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929674+0000", 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0976999999999994e-05 2024-09-18T05:16:19.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929753+0000", 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8948000000000004e-05 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121158 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2088960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.620639214999997, 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818722, 2024-09-18T05:16:19.534 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121158 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:16:19.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891346+0000", 2024-09-18T05:16:19.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891349+0000", 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5050000000000002e-06 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891355+0000", 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4370000000000004e-06 2024-09-18T05:16:19.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891365+0000", 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7520000000000008e-06 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929862+0000", 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038497177 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930078+0000", 2024-09-18T05:16:19.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000215992 2024-09-18T05:16:19.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930165+0000", 2024-09-18T05:16:19.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7243000000000005e-05 2024-09-18T05:16:19.539 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.539 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.539 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.540 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121271 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1906688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.540 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:16:19.540 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607576375000001, 2024-09-18T05:16:19.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038405050000000003, 2024-09-18T05:16:19.540 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.540 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.540 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121271 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904416+0000", 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0160000000000003e-06 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904423+0000", 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9890000000000003e-06 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904428+0000", 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6890000000000003e-06 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942670+0000", 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038242653000000001 2024-09-18T05:16:19.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942752+0000", 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2140999999999998e-05 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942814+0000", 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2101999999999996e-05 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121272 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1918976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607548803999997, 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038493807999999997, 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121272 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.545 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904439+0000", 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3870000000000002e-06 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904445+0000", 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0240000000000003e-06 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904450+0000", 2024-09-18T05:16:19.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9400000000000001e-06 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942846+0000", 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038395692000000002 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942889+0000", 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3659000000000003e-05 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942931+0000", 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1470000000000001e-05 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121273 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1931264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607531455, 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038620175, 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121273 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904456+0000", 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3360000000000002e-06 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904462+0000", 2024-09-18T05:16:19.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7289999999999997e-06 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904472+0000", 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0020999999999999e-05 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942960+0000", 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038488306999999999 2024-09-18T05:16:19.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943002+0000", 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2089999999999999e-05 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943075+0000", 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2092e-05 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121274 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1943552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607501014999997, 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818021000000001, 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121274 2024-09-18T05:16:19.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904484+0000", 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904487+0000", 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904494+0000", 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0940000000000002e-06 2024-09-18T05:16:19.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904499+0000", 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.933e-06 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943121+0000", 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038622507 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943208+0000", 2024-09-18T05:16:19.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6397999999999995e-05 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943303+0000", 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4895000000000005e-05 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121275 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1955840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:16:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607482724999997, 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039005943000000001, 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121275 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:16:19.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904505+0000", 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904511+0000", 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0190000000000003e-06 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904516+0000", 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9200000000000003e-06 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943351+0000", 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038834425999999998 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943430+0000", 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9505000000000005e-05 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943509+0000", 2024-09-18T05:16:19.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-09-18T05:16:19.563 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.563 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.563 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.563 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121276 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1968128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.564 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:16:19.564 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607465329, 2024-09-18T05:16:19.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039192704000000002, 2024-09-18T05:16:19.564 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.564 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.564 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.564 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121276 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904523+0000", 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5179999999999999e-06 2024-09-18T05:16:19.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904529+0000", 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4860000000000002e-06 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904533+0000", 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2390000000000004e-06 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943554+0000", 2024-09-18T05:16:19.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039020332999999997 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943634+0000", 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0673000000000005e-05 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943713+0000", 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8858999999999998e-05 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121277 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1980416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607448005999998, 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039321828000000003, 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121277 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904537+0000", 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904544+0000", 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8990000000000004e-06 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904551+0000", 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3940000000000001e-06 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904556+0000", 2024-09-18T05:16:19.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1200000000000001e-06 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943770+0000", 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039214514999999998 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943816+0000", 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5371999999999999e-05 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943860+0000", 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3875999999999998e-05 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121278 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1992704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:16:19.573 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607425382000002, 2024-09-18T05:16:19.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039412773999999998, 2024-09-18T05:16:19.574 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.574 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.574 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.574 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.574 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121278 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904563+0000", 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5000000000000002e-06 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904569+0000", 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.224e-06 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904574+0000", 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8659999999999997e-06 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943890+0000", 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039316027000000003 2024-09-18T05:16:19.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943931+0000", 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1137000000000003e-05 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943973+0000", 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2416999999999997e-05 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121279 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2004992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607407907999999, 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039512600000000002, 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121279 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904580+0000", 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3640000000000002e-06 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904587+0000", 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6719999999999998e-06 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904591+0000", 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5549999999999996e-06 2024-09-18T05:16:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944001+0000", 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039410387999999998 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944046+0000", 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4626000000000003e-05 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944090+0000", 2024-09-18T05:16:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4351000000000003e-05 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121280 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2017280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607390041000002, 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039608457999999999, 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.583 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121280 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904595+0000", 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904598+0000", 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4549999999999998e-06 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904604+0000", 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904609+0000", 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7949999999999998e-06 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944120+0000", 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039511211999999997 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944161+0000", 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0766000000000002e-05 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944204+0000", 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3234e-05 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.587 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121281 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2029568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607372366999996, 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039699867999999999, 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121281 2024-09-18T05:16:19.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904615+0000", 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.305e-06 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904622+0000", 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4320000000000004e-06 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904627+0000", 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.729e-06 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944231+0000", 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039604749000000002 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944270+0000", 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8531000000000001e-05 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944313+0000", 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3479000000000002e-05 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121282 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2041856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607333500999999, 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039764847999999998, 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.592 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121282 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904655+0000", 2024-09-18T05:16:19.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8219999999999998e-06 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904661+0000", 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8539999999999999e-06 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904677+0000", 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5488000000000001e-05 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944340+0000", 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039663588999999999 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944380+0000", 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9548999999999997e-05 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944417+0000", 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7138000000000003e-05 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.596 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121283 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2054144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607303833000003, 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039840091000000001, 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.597 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121283 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904689+0000", 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7190000000000001e-06 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904696+0000", 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6529999999999997e-06 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904701+0000", 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.101e-06 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944443+0000", 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039741601000000001 2024-09-18T05:16:19.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944483+0000", 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0138000000000001e-05 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944522+0000", 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9289000000000003e-05 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121284 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2066432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607280697, 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039925616999999997, 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121284 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904707+0000", 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.616e-06 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904714+0000", 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.161e-06 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904718+0000", 2024-09-18T05:16:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8389999999999997e-06 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944553+0000", 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039834596 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944591+0000", 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944631+0000", 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9526000000000001e-05 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121285 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2078720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607262534, 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040039444, 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.606 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121285 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904726+0000", 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6630000000000002e-06 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904732+0000", 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6069999999999996e-06 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904737+0000", 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9609999999999996e-06 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944658+0000", 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039920421999999997 2024-09-18T05:16:19.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944696+0000", 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8395000000000001e-05 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944763+0000", 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6761999999999995e-05 2024-09-18T05:16:19.610 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121286 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2091008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 53.607243552, 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040212352999999999, 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:19.611 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121286 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904744+0000", 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904751+0000", 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7689999999999999e-06 2024-09-18T05:16:19.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904756+0000", 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5959999999999997e-06 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944796+0000", 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040040048000000002 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944883+0000", 2024-09-18T05:16:19.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7268999999999994e-05 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944955+0000", 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1505000000000001e-05 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:19.615 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:19.617 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:16:19.617 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:19.614+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:19.639 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:19.640 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:19.656 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:19.656 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:19.687 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:19.718 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:19.714+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:19.721 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:19.758 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:19.758 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:19.769 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:19.770 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:19.778 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:19.778 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:19.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:16:19.800 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:19.800 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:19.818 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:19.814+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:19.820 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:19.920 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:19.918+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:19.928 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:19.928 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:19.942 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:16:19.954 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T05:16:20.064 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:20.064 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:20.067 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:20.058+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:20.076 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T05:16:20.133 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:20.126+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:20.195 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 7, 6, 2] 2024-09-18T05:16:20.196 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T05:16:20.196 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-09-18T05:16:20.196 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-09-18T05:16:20.261 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:20.254+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:20.265 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:20.265 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:20.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T05:16:20.325 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:20.322+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:20.427 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:20.422+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:20.448 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:20.448 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:20.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T05:16:20.527 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:20.522+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:20.585 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:20.585 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:20.599 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T05:16:20.628 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:20.626+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:20.727 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:20.728 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:20.729 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:20.726+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:20.742 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T05:16:20.830 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:20.826+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:20.868 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:20.869 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:20.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T05:16:20.918 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-18T05:16:20.914+0000 7fb0c70e1640 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-09-18T05:16:20.929 INFO:teuthology.orchestra.run.smithi017.stderr:osd set-full-ratio 0.001 2024-09-18T05:16:20.931 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:20.926+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:20.933 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-18T05:16:21.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:21.026+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:21.033 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:21.034 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:21.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T05:16:21.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:21.130+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:21.217 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:21.217 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:21.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T05:16:21.233 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:21.230+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:21.334 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:21.330+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:21.399 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:21.399 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:21.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T05:16:21.435 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:21.430+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:21.532 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:21.532 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:21.535 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-18T05:16:21.530+0000 7faab925f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26325) UID: 0 2024-09-18T05:16:21.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T05:16:21.637 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-18T05:16:21.634+0000 7f937ed7a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26154) UID: 0 2024-09-18T05:16:21.680 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:21.680 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:21.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T05:16:21.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:21.734+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:21.815 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:21.815 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:21.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T05:16:21.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T05:16:21.839 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:21.834+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:21.948 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:21.934+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:21.957 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:21.957 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:21.969 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-09-18T05:16:21.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-09-18T05:16:21.976 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T05:16:22.013 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-18T05:16:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T05:16:22.041 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:22.038+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:22.104 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:22.105 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:22.119 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T05:16:22.160 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:22.158+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:22.238 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-18T05:16:22.238 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T05:16:22.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-18T05:16:22.238+0000 7f4a887b4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26150) UID: 0 2024-09-18T05:16:22.257 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-18T05:16:22.257 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T05:16:22.282 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-18T05:16:22.282 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T05:16:22.282 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-18T05:16:22.283 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T05:16:22.296 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T05:16:22.309 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-18T05:16:22.309 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T05:16:22.325 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-18T05:16:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T05:16:22.344 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:22.338+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:22.346 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-18T05:16:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T05:16:22.366 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-18T05:16:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T05:16:22.421 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:22.421 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:22.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:22.421 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:22.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.421 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35007 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3473408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.421 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.756656505, 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071287807999999994, 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35007 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660304+0000", 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660303+0000", 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660309+0000", 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5030000000000002e-06 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660332+0000", 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2617999999999999e-05 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660346+0000", 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4022000000000001e-05 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731423+0000", 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071077036999999996 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731499+0000", 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6147000000000001e-05 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731591+0000", 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2603999999999996e-05 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.425 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35008 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3483648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.75658958699999, 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071475989000000004, 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35008 2024-09-18T05:16:22.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660371+0000", 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660370+0000", 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660376+0000", 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5060000000000001e-06 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660428+0000", 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2012999999999998e-05 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660445+0000", 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731650+0000", 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071204824 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731743+0000", 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3299000000000002e-05 2024-09-18T05:16:22.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731847+0000", 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103645 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35009 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3493888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.756501077, 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071618726999999993, 2024-09-18T05:16:22.430 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35009 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660459+0000", 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660458+0000", 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660465+0000", 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1919999999999999e-06 2024-09-18T05:16:22.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660483+0000", 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8102999999999999e-05 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660497+0000", 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3397999999999999e-05 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731895+0000", 2024-09-18T05:16:22.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071398773999999998 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.731982+0000", 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6384000000000005e-05 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732078+0000", 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6099000000000003e-05 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35010 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3504128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.756450521, 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071823613999999994, 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35010 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.435 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660510+0000", 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660508+0000", 2024-09-18T05:16:22.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660528+0000", 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0041e-05 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660547+0000", 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8739000000000001e-05 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660560+0000", 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3069e-05 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732124+0000", 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071564354999999996 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732230+0000", 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105734 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732333+0000", 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010315900000000001 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35011 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3514368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.756387406, 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071960509000000006, 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.439 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35011 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660573+0000", 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660572+0000", 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660578+0000", 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1460000000000001e-06 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660595+0000", 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6812000000000001e-05 2024-09-18T05:16:22.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660607+0000", 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2369e-05 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732372+0000", 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071765413 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732441+0000", 2024-09-18T05:16:22.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8918999999999995e-05 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732533+0000", 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.187e-05 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35012 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3524608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.756340486, 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072168290999999996, 2024-09-18T05:16:22.443 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35012 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660620+0000", 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660618+0000", 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660625+0000", 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5989999999999998e-06 2024-09-18T05:16:22.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660642+0000", 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7439e-05 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660657+0000", 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4302e-05 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732589+0000", 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.071931891999999997 2024-09-18T05:16:22.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732682+0000", 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3723999999999999e-05 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732788+0000", 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105575 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35013 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3534848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.75628660700001, 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072304663000000005, 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35013 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660674+0000", 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660673+0000", 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660679+0000", 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1120000000000001e-06 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660696+0000", 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7002000000000001e-05 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660709+0000", 2024-09-18T05:16:22.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3139000000000001e-05 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732826+0000", 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072116868000000001 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732892+0000", 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6068999999999994e-05 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.732978+0000", 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6355999999999998e-05 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35014 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3545088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.756239474, 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072518861000000004, 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.452 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35014 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660721+0000", 2024-09-18T05:16:22.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660719+0000", 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660726+0000", 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0099999999999998e-06 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660742+0000", 2024-09-18T05:16:22.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5981000000000002e-05 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660756+0000", 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3893000000000001e-05 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733035+0000", 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072278564000000003 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733128+0000", 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3350999999999994e-05 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733240+0000", 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111529 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35015 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3555328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.756191852, 2024-09-18T05:16:22.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072665798000000004, 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35015 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660768+0000", 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660767+0000", 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660773+0000", 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0900000000000001e-06 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660791+0000", 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660827+0000", 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6919999999999999e-05 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733278+0000", 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072450958999999995 2024-09-18T05:16:22.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733350+0000", 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1314000000000002e-05 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733434+0000", 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4376000000000007e-05 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35016 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3565568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.756069031, 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072820857000000003, 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35016 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660891+0000", 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660889+0000", 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660902+0000", 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3276e-05 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660933+0000", 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0862999999999999e-05 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660953+0000", 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0027e-05 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733490+0000", 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072537641 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733585+0000", 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4967000000000001e-05 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733712+0000", 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126697 2024-09-18T05:16:22.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35017 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3575808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.755987701, 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072928646, 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.465 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35017 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660972+0000", 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660971+0000", 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.660996+0000", 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4669e-05 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661017+0000", 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0662e-05 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661031+0000", 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.435e-05 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733750+0000", 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072719523999999994 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733819+0000", 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8238999999999995e-05 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733901+0000", 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2490000000000005e-05 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35018 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3586048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.755916458, 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073101646000000006, 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.469 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35018 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661044+0000", 2024-09-18T05:16:22.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661043+0000", 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661049+0000", 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661069+0000", 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661082+0000", 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388000000000001e-05 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.733957+0000", 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072875282999999999 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734045+0000", 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8271999999999998e-05 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734145+0000", 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9962000000000003e-05 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35019 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3596288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.473 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.755866247, 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073237851000000007, 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35019 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:22.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661094+0000", 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661093+0000", 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661112+0000", 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9644e-05 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661142+0000", 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9286e-05 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661158+0000", 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.645e-05 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734183+0000", 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073025321000000004 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734250+0000", 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6828000000000005e-05 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734332+0000", 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1482000000000004e-05 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35020 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3606528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.755789053, 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073415491999999999, 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35020 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.478 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661171+0000", 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661170+0000", 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661176+0000", 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4250000000000003e-06 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661194+0000", 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7204e-05 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661206+0000", 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2768e-05 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734387+0000", 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073180095000000001 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734481+0000", 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4372999999999999e-05 2024-09-18T05:16:22.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734587+0000", 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010572400000000001 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35021 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3616768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.755739183, 2024-09-18T05:16:22.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073562532, 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35021 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661221+0000", 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661220+0000", 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661226+0000", 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-09-18T05:16:22.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661242+0000", 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6364000000000001e-05 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661258+0000", 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734624+0000", 2024-09-18T05:16:22.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073366090999999994 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734694+0000", 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9831000000000003e-05 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734784+0000", 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9889999999999995e-05 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35022 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3627008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.755664612, 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073735321000000006, 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35022 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661296+0000", 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661294+0000", 2024-09-18T05:16:22.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661314+0000", 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9820999999999999e-05 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661333+0000", 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9055999999999998e-05 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661347+0000", 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4226999999999999e-05 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734838+0000", 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073490310000000003 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.734931+0000", 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3300000000000005e-05 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735031+0000", 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9951999999999994e-05 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35023 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3637248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.755598834, 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073868159000000003, 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.491 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35023 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661361+0000", 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661360+0000", 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661366+0000", 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3219999999999998e-06 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661383+0000", 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6362e-05 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661397+0000", 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735070+0000", 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073672662999999999 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735140+0000", 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0130999999999997e-05 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735229+0000", 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9761999999999999e-05 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.495 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35024 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3647488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.755551798, 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074079699999999998, 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35024 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661408+0000", 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661407+0000", 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661413+0000", 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0939999999999998e-06 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661429+0000", 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6002e-05 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661458+0000", 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9832000000000002e-05 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735291+0000", 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073832853000000004 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735385+0000", 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4127000000000002e-05 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735488+0000", 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102735 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35025 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3657728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.755489705, 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074207494999999998, 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35025 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.500 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661470+0000", 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661469+0000", 2024-09-18T05:16:22.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661475+0000", 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8429999999999998e-06 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661494+0000", 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8884000000000001e-05 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661507+0000", 2024-09-18T05:16:22.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.235e-05 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735526+0000", 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074019843000000002 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735595+0000", 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8922000000000002e-05 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735678+0000", 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2668000000000002e-05 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:35026 3.16 3:6caa2778:::rbd_data.118b475dc9c5.0000000000000003:13 [read 3667968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.75544332600001, 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074406363000000003, 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:22.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 35026 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661517+0000", 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661516+0000", 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661522+0000", 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6930000000000004e-06 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661537+0000", 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5855999999999999e-05 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.661550+0000", 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2771e-05 2024-09-18T05:16:22.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735713+0000", 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074162350000000002 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735812+0000", 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9519999999999996e-05 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:14:21.735923+0000", 2024-09-18T05:16:22.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111147 2024-09-18T05:16:22.509 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.509 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.509 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.509 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:22.509 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:22.509 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:22.510 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T05:16:22.511 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:22.506+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:22.611 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:22.606+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:22.682 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:22.682 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:22.682 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:22.682 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:22.696 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T05:16:22.740 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-18T05:16:22.738+0000 7fa101ca1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26327) UID: 0 2024-09-18T05:16:22.814 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-18T05:16:22.810+0000 7f378a3c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26329) UID: 0 2024-09-18T05:16:22.863 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:22.863 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:22.863 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:22.863 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:22.863 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:22.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T05:16:22.921 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-18T05:16:22.918+0000 7f0b22687640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33493) UID: 0 2024-09-18T05:16:22.951 INFO:teuthology.orchestra.run.smithi017.stderr:osd set-full-ratio 0.95 2024-09-18T05:16:22.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T05:16:23.026 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-18T05:16:23.022+0000 7f757ee86640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26152) UID: 0 2024-09-18T05:16:23.055 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121386 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 686080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097339724000001, 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056108969000000002, 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121386 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955685+0000", 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955696+0000", 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0874e-05 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955703+0000", 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3189999999999997e-06 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955708+0000", 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0429999999999998e-06 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011705+0000", 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055996870999999997 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011743+0000", 2024-09-18T05:16:23.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7895000000000002e-05 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011794+0000", 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1307999999999997e-05 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121387 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 698368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097312141000003, 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056181659000000002, 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121387 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.062 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955713+0000", 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955712+0000", 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955715+0000", 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3760000000000002e-06 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955721+0000", 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2589999999999997e-06 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955725+0000", 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4009999999999999e-06 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011813+0000", 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056088051999999999 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011848+0000", 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4847e-05 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011894+0000", 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121388 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:23.067 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097295228999997, 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056271570999999999, 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121388 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955730+0000", 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955729+0000", 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955731+0000", 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2019999999999998e-06 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955737+0000", 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9139999999999996e-06 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955751+0000", 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3311e-05 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011914+0000", 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163594999999997 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.011952+0000", 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7834999999999999e-05 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012001+0000", 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9084e-05 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121389 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 722944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097269099000002, 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056345279999999998, 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121389 2024-09-18T05:16:23.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955756+0000", 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955755+0000", 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955759+0000", 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3850000000000002e-06 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955766+0000", 2024-09-18T05:16:23.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8499999999999996e-06 2024-09-18T05:16:23.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955771+0000", 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0170000000000004e-06 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012021+0000", 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056250737000000002 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012057+0000", 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5271000000000002e-05 2024-09-18T05:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012101+0000", 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4403999999999997e-05 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121390 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 735232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.078 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:23.079 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097248170999997, 2024-09-18T05:16:23.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056430889999999997, 2024-09-18T05:16:23.079 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.079 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.079 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.079 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.079 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.079 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121390 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955777+0000", 2024-09-18T05:16:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955776+0000", 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955779+0000", 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6290000000000002e-06 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955786+0000", 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.435e-06 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955791+0000", 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7520000000000004e-06 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012120+0000", 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056329443999999999 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012158+0000", 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7925e-05 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012208+0000", 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9301000000000001e-05 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121391 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 747520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097216711000002, 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056498934000000001, 2024-09-18T05:16:23.084 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121391 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955808+0000", 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955811+0000", 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9560000000000002e-06 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955818+0000", 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3339999999999996e-06 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955823+0000", 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2839999999999997e-06 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012227+0000", 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056403880000000003 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012262+0000", 2024-09-18T05:16:23.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4618e-05 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012307+0000", 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5413e-05 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121392 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097196875000002, 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056582623999999998, 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121392 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.090 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955828+0000", 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955830+0000", 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999998e-06 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955837+0000", 2024-09-18T05:16:23.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955842+0000", 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6770000000000003e-06 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012326+0000", 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056483691000000003 2024-09-18T05:16:23.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012363+0000", 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7024999999999999e-05 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012411+0000", 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7845e-05 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121393 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 772096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097178454999998, 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056662902000000001, 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121393 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.095 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955846+0000", 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955848+0000", 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2350000000000002e-06 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955855+0000", 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0500000000000003e-06 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955860+0000", 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8080000000000004e-06 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012430+0000", 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056570047999999998 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012465+0000", 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4718000000000002e-05 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012509+0000", 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4418000000000001e-05 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.099 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121394 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 784384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097160563000003, 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056750383000000001, 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121394 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955864+0000", 2024-09-18T05:16:23.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955866+0000", 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2570000000000002e-06 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955873+0000", 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4810000000000003e-06 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955878+0000", 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8500000000000002e-06 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012529+0000", 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056651708000000002 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012567+0000", 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7642000000000003e-05 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012615+0000", 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7811e-05 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121395 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097143195000001, 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056832344999999999, 2024-09-18T05:16:23.104 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121395 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955882+0000", 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955881+0000", 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955884+0000", 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3240000000000001e-06 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955890+0000", 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0909999999999998e-06 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955894+0000", 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012635+0000", 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056740087000000002 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012670+0000", 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5123999999999998e-05 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012714+0000", 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4384000000000001e-05 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.109 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121396 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 808960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097110721, 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057018234000000001, 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121396 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955914+0000", 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955917+0000", 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0979999999999998e-06 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955930+0000", 2024-09-18T05:16:23.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3552e-05 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955936+0000", 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7309999999999998e-06 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012733+0000", 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056797146999999999 2024-09-18T05:16:23.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012770+0000", 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7239e-05 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012932+0000", 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016205000000000001 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121397 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 821248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097084064000001, 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057105428999999999, 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.115 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121397 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955941+0000", 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955940+0000", 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955943+0000", 2024-09-18T05:16:23.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7439999999999999e-06 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955950+0000", 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8129999999999998e-06 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955957+0000", 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1849999999999998e-06 2024-09-18T05:16:23.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012953+0000", 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056995559000000001 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.012987+0000", 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4777000000000003e-05 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013046+0000", 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8867999999999999e-05 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121398 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 833536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097063187000003, 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057212333999999997, 2024-09-18T05:16:23.120 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121398 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955962+0000", 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955961+0000", 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955970+0000", 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6759999999999996e-06 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955981+0000", 2024-09-18T05:16:23.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0706999999999999e-05 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955986+0000", 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0719999999999999e-06 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013067+0000", 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057081595999999998 2024-09-18T05:16:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013111+0000", 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3331999999999998e-05 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013174+0000", 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3323000000000003e-05 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121399 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.097034174999997, 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057281034000000002, 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.126 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121399 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955991+0000", 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955990+0000", 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955993+0000", 2024-09-18T05:16:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6180000000000002e-06 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.955999+0000", 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4699999999999999e-06 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.956004+0000", 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7770000000000002e-06 2024-09-18T05:16:23.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013194+0000", 2024-09-18T05:16:23.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057189503000000003 2024-09-18T05:16:23.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013233+0000", 2024-09-18T05:16:23.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9082000000000003e-05 2024-09-18T05:16:23.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.013272+0000", 2024-09-18T05:16:23.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9014000000000003e-05 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121415 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.094201939000001, 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023800999999998, 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.133 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121415 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958823+0000", 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958825+0000", 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.835e-06 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958831+0000", 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.088e-06 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958842+0000", 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0916e-05 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014771+0000", 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055928731000000002 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014809+0000", 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7713999999999998e-05 2024-09-18T05:16:23.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014847+0000", 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7888e-05 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121416 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 528384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:23.138 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.094176693999998, 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056112120000000001, 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121416 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:23.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958848+0000", 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958850+0000", 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.729e-06 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958858+0000", 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958866+0000", 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2840000000000006e-06 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014866+0000", 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056000419000000003 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014907+0000", 2024-09-18T05:16:23.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0533e-05 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014960+0000", 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3427000000000002e-05 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121417 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 540672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.143 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.094153245999998, 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056196533999999999, 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121417 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958872+0000", 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958871+0000", 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958874+0000", 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.537e-06 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958881+0000", 2024-09-18T05:16:23.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1840000000000002e-06 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958886+0000", 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.014981+0000", 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056095036000000001 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015017+0000", 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6732e-05 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015068+0000", 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0855e-05 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121418 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 552960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.094060118999998, 2024-09-18T05:16:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056223713000000002, 2024-09-18T05:16:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121418 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958965+0000", 2024-09-18T05:16:23.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958889+0000", 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999247 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958968+0000", 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8638000000000002e-05 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.958990+0000", 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1614e-05 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959004+0000", 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4157e-05 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015088+0000", 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056084547999999998 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015129+0000", 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1048999999999999e-05 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015188+0000", 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8967e-05 2024-09-18T05:16:23.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121420 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 577536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.093644394999998, 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056036506999999999, 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121420 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959380+0000", 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959383+0000", 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3689999999999998e-06 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959390+0000", 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1799999999999999e-06 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959396+0000", 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5330000000000002e-06 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015330+0000", 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055934086000000001 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015369+0000", 2024-09-18T05:16:23.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8732000000000001e-05 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015417+0000", 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8241000000000001e-05 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121421 3.d 3:b630f606:::rbd_data.118bedc1b58d.000000000000000e:2e [read 589824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:23.159 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.093623782000002, 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056116280999999997, 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121421 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959401+0000", 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959403+0000", 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6989999999999999e-06 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959409+0000", 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1099999999999999e-06 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.959414+0000", 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6190000000000002e-06 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015437+0000", 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056023252000000003 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015473+0000", 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6086e-05 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:26.015517+0000", 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4082999999999998e-05 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.164 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.165 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:23.167 INFO:teuthology.orchestra.run.smithi017.stdout:All operations completed A-OK! 2024-09-18T05:16:23.167 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T05:16:23.168 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-18T05:16:23.162+0000 7fe5b4772640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39181) UID: 0 2024-09-18T05:16:23.168 DEBUG:teuthology.parallel:result is None 2024-09-18T05:16:23.168 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-18T05:16:23.178 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-18T05:16:23.211 INFO:tasks.thrashosds:joining thrashosds 2024-09-18T05:16:23.339 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:23.339 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:23.339 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-18T05:16:23.339 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:23.353 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T05:16:23.475 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:23.475 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-18T05:16:23.475 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-18T05:16:23.475 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-18T05:16:23.475 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:23.489 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T05:16:23.616 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-18T05:16:23.616 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-18T05:16:23.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-18T05:16:23.616 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-18T05:16:23.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.616 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:102332 3.10 3:0b2ae2d1:::rbd_data.118b62cc3496.000000000000001a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-18T05:16:23.616 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 71.485044268999999, 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.065837997999999995, 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102332 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126925+0000", 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126923+0000", 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126935+0000", 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1970000000000001e-05 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126960+0000", 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4888999999999998e-05 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.126980+0000", 2024-09-18T05:16:23.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0642999999999999e-05 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127082+0000", 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101118 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.127332+0000", 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000250771 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.140319+0000", 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012987115 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192666+0000", 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.052346629999999998 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192681+0000", 2024-09-18T05:16:23.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4769e-05 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192726+0000", 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4925000000000001e-05 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:12.192763+0000", 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7141000000000002e-05 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.622 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121156 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2064384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.720666426000001, 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038247947999999997, 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121156 2024-09-18T05:16:23.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.624 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:16:23.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891303+0000", 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891302+0000", 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891314+0000", 2024-09-18T05:16:23.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1557e-05 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891321+0000", 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7619999999999998e-06 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891325+0000", 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6600000000000003e-06 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929365+0000", 2024-09-18T05:16:23.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038039942 2024-09-18T05:16:23.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929467+0000", 2024-09-18T05:16:23.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101191 2024-09-18T05:16:23.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929551+0000", 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4220000000000003e-05 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121157 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2076672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.720639286999997, 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038423377000000002, 2024-09-18T05:16:23.629 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121157 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:16:23.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891330+0000", 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891332+0000", 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891338+0000", 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9800000000000003e-06 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891342+0000", 2024-09-18T05:16:23.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3470000000000001e-06 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929593+0000", 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038250926999999997 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929674+0000", 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0976999999999994e-05 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929753+0000", 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8948000000000004e-05 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121158 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2088960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.720622665999997, 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818722, 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121158 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891347+0000", 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891346+0000", 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891349+0000", 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5050000000000002e-06 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891355+0000", 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4370000000000004e-06 2024-09-18T05:16:23.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.891365+0000", 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7520000000000008e-06 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.929862+0000", 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038497177 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930078+0000", 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000215992 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.930165+0000", 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7243000000000005e-05 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121271 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1906688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.638 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707559826000001, 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038405050000000003, 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121271 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904409+0000", 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904416+0000", 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0160000000000003e-06 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904423+0000", 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9890000000000003e-06 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904428+0000", 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6890000000000003e-06 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942670+0000", 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038242653000000001 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942752+0000", 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2140999999999998e-05 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942814+0000", 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2101999999999996e-05 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.642 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121272 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1918976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707532254999997, 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038493807999999997, 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121272 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904437+0000", 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904439+0000", 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3870000000000002e-06 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904445+0000", 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0240000000000003e-06 2024-09-18T05:16:23.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904450+0000", 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9400000000000001e-06 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942846+0000", 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038395692000000002 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942889+0000", 2024-09-18T05:16:23.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3659000000000003e-05 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942931+0000", 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1470000000000001e-05 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121273 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1931264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:16:23.647 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707514906, 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038620175, 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121273 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904454+0000", 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904456+0000", 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3360000000000002e-06 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904462+0000", 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7289999999999997e-06 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904472+0000", 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0020999999999999e-05 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.942960+0000", 2024-09-18T05:16:23.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038488306999999999 2024-09-18T05:16:23.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943002+0000", 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2089999999999999e-05 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943075+0000", 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2092e-05 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.652 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121274 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1943552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707484465999997, 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038818021000000001, 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121274 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:16:23.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904485+0000", 2024-09-18T05:16:23.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904484+0000", 2024-09-18T05:16:23.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904487+0000", 2024-09-18T05:16:23.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-18T05:16:23.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904494+0000", 2024-09-18T05:16:23.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0940000000000002e-06 2024-09-18T05:16:23.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904499+0000", 2024-09-18T05:16:23.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.933e-06 2024-09-18T05:16:23.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943121+0000", 2024-09-18T05:16:23.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038622507 2024-09-18T05:16:23.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943208+0000", 2024-09-18T05:16:23.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6397999999999995e-05 2024-09-18T05:16:23.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943303+0000", 2024-09-18T05:16:23.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4895000000000005e-05 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121275 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1955840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707466175999997, 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039005943000000001, 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.660 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121275 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:16:23.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904503+0000", 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904505+0000", 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904511+0000", 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0190000000000003e-06 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904516+0000", 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9200000000000003e-06 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943351+0000", 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038834425999999998 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943430+0000", 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9505000000000005e-05 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943509+0000", 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121276 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1968128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.70744878, 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039192704000000002, 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121276 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904520+0000", 2024-09-18T05:16:23.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904523+0000", 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5179999999999999e-06 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904529+0000", 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4860000000000002e-06 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904533+0000", 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2390000000000004e-06 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943554+0000", 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039020332999999997 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943634+0000", 2024-09-18T05:16:23.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0673000000000005e-05 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943713+0000", 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8858999999999998e-05 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121277 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1980416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707431456999998, 2024-09-18T05:16:23.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039321828000000003, 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121277 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904538+0000", 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904537+0000", 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904544+0000", 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8990000000000004e-06 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904551+0000", 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3940000000000001e-06 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904556+0000", 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1200000000000001e-06 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943770+0000", 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039214514999999998 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943816+0000", 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5371999999999999e-05 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943860+0000", 2024-09-18T05:16:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3875999999999998e-05 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121278 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 1992704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707408833000002, 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039412773999999998, 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121278 2024-09-18T05:16:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904560+0000", 2024-09-18T05:16:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904563+0000", 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5000000000000002e-06 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904569+0000", 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.224e-06 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904574+0000", 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8659999999999997e-06 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943890+0000", 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039316027000000003 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943931+0000", 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1137000000000003e-05 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.943973+0000", 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2416999999999997e-05 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121279 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2004992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.678 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707391358999999, 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039512600000000002, 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121279 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.679 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904578+0000", 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904580+0000", 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3640000000000002e-06 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904587+0000", 2024-09-18T05:16:23.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6719999999999998e-06 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904591+0000", 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5549999999999996e-06 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944001+0000", 2024-09-18T05:16:23.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039410387999999998 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944046+0000", 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4626000000000003e-05 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944090+0000", 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4351000000000003e-05 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121280 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2017280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707373492000002, 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039608457999999999, 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.684 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121280 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904596+0000", 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904595+0000", 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904598+0000", 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4549999999999998e-06 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904604+0000", 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3489999999999997e-06 2024-09-18T05:16:23.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904609+0000", 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7949999999999998e-06 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944120+0000", 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039511211999999997 2024-09-18T05:16:23.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944161+0000", 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0766000000000002e-05 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944204+0000", 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3234e-05 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121281 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2029568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707355818000003, 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039699867999999999, 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121281 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904613+0000", 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904615+0000", 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.305e-06 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904622+0000", 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4320000000000004e-06 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904627+0000", 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.729e-06 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944231+0000", 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039604749000000002 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944270+0000", 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8531000000000001e-05 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944313+0000", 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3479000000000002e-05 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121282 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2041856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707316951999999, 2024-09-18T05:16:23.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039764847999999998, 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121282 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904652+0000", 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904655+0000", 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8219999999999998e-06 2024-09-18T05:16:23.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904661+0000", 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8539999999999999e-06 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904677+0000", 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5488000000000001e-05 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944340+0000", 2024-09-18T05:16:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039663588999999999 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944380+0000", 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9548999999999997e-05 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944417+0000", 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7138000000000003e-05 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121283 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2054144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707287284000003, 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039840091000000001, 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121283 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.698 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904682+0000", 2024-09-18T05:16:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904689+0000", 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7190000000000001e-06 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904696+0000", 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6529999999999997e-06 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904701+0000", 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.101e-06 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944443+0000", 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039741601000000001 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944483+0000", 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0138000000000001e-05 2024-09-18T05:16:23.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944522+0000", 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9289000000000003e-05 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121284 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2066432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:16:23.702 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707264148, 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039925616999999997, 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121284 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:16:23.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904705+0000", 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904707+0000", 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.616e-06 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904714+0000", 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.161e-06 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904718+0000", 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8389999999999997e-06 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944553+0000", 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039834596 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944591+0000", 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944631+0000", 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9526000000000001e-05 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.706 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121285 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2078720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707245985, 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040039444, 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121285 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904723+0000", 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904726+0000", 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6630000000000002e-06 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904732+0000", 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6069999999999996e-06 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904737+0000", 2024-09-18T05:16:23.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9609999999999996e-06 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944658+0000", 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039920421999999997 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944696+0000", 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8395000000000001e-05 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944763+0000", 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6761999999999995e-05 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4491.0:121286 3.10 3:0bc5c87f:::rbd_data.118bedc1b58d.000000000000000d:2e [read 2091008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.707227003, 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040212352999999999, 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-18T05:16:23.711 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4491", 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 121286 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:16:23.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904742+0000", 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904744+0000", 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-18T05:16:23.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904751+0000", 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7689999999999999e-06 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.904756+0000", 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5959999999999997e-06 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944796+0000", 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.040040048000000002 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944883+0000", 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7268999999999994e-05 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-18T05:15:25.944955+0000", 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1505000000000001e-05 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-18T05:16:23.715 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-18T05:16:23.717 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T05:16:23.854 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:23.854 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:16:23.854 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-18T05:16:23.854 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:23.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T05:16:23.949 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-18T05:16:23.990 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:23.990 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-18T05:16:23.991 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-18T05:16:23.991 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-18T05:16:23.991 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:24.006 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T05:16:24.178 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-18T05:16:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-18T05:16:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-18T05:16:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(osd.4.0:2565 3.9 e124/123 3:92c0f4e1:::rbd_data.118b41a97670.000000000000000b:2d v 124'260, mlcod=124'256)", 2024-09-18T05:16:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:55.276468+0000", 2024-09-18T05:16:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.895786969, 2024-09-18T05:16:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001894078, 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.276468+0000", 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.276468+0000", 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.276467+0000", 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.276479+0000", 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1789e-05 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.276490+0000", 2024-09-18T05:16:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.276497+0000", 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5690000000000001e-06 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.276552+0000", 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5262e-05 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.276578+0000", 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5652000000000001e-05 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.278313+0000", 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017357710000000001 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.278362+0000", 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8495999999999998e-05 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(osd.4.0:2566 3.9 e124/123 3:91878a0a:::rbd_data.118b41a97670.0000000000000002:2d v 124'262, mlcod=124'256)", 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:55.277218+0000", 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.895037132999999, 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016386630000000001, 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.277218+0000", 2024-09-18T05:16:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.277218+0000", 2024-09-18T05:16:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.277217+0000", 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.277227+0000", 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8579999999999995e-06 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.277238+0000", 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0915e-05 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.277245+0000", 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9310000000000002e-06 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.277561+0000", 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031611399999999999 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.277584+0000", 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2782999999999999e-05 2024-09-18T05:16:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.278817+0000", 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012333279999999999 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.278856+0000", 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9399e-05 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(osd.1.0:1446 3.0 e124/123 3:07b7f500:::rbd_data.118b17097827.0000000000000000:21 v 124'378, mlcod=124'374)", 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:15:55.296303+0000", 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.875952021, 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019909860000000001, 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.296303+0000", 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.296303+0000", 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.296302+0000", 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.296308+0000", 2024-09-18T05:16:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4559999999999999e-06 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.296320+0000", 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1987000000000001e-05 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.296328+0000", 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3769999999999996e-06 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.296389+0000", 2024-09-18T05:16:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1118999999999995e-05 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.296413+0000", 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3604999999999998e-05 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.298246+0000", 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00183351 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:15:55.298294+0000", 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7583999999999997e-05 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(osd.4.0:2770 3.9 e138/123 3:9368f5ee:::rbd_data.118becd44f.0000000000000003:10 v 138'285, mlcod=136'282)", 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:08.927949+0000", 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.244306015999999, 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043085420000000003, 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.927949+0000", 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.927949+0000", 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.927948+0000", 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.927996+0000", 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7911999999999998e-05 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.928024+0000", 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8160000000000001e-05 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.928045+0000", 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0897e-05 2024-09-18T05:16:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.928291+0000", 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024612499999999998 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.928368+0000", 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7212999999999994e-05 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.932187+0000", 2024-09-18T05:16:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0038189159999999999 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.932257+0000", 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0298999999999999e-05 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(osd.1.0:1558 3.4 e138/123 3:23e41bb5:::rbd_data.118becd44f.0000000000000001:10 v 138'401, mlcod=137'398)", 2024-09-18T05:16:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:08.930822+0000", 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 15.241432934000001, 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048166550000000004, 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.930822+0000", 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.930822+0000", 2024-09-18T05:16:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.930821+0000", 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.930832+0000", 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1060000000000001e-05 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.930864+0000", 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2053e-05 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.930883+0000", 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8505999999999999e-05 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.931058+0000", 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000174592 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.931109+0000", 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1153000000000003e-05 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.935495+0000", 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043865010000000001 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:08.935639+0000", 2024-09-18T05:16:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000143413 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132404 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:12.985918+0000", 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.186336537000001, 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028666690000000001, 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132404 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.985918+0000", 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.985918+0000", 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.985916+0000", 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.985929+0000", 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3956e-05 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.985960+0000", 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0729999999999999e-05 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.985977+0000", 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7184e-05 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.986081+0000", 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103235 2024-09-18T05:16:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.986239+0000", 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158646 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.986525+0000", 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028588499999999999 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.987906+0000", 2024-09-18T05:16:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013811419999999999 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.988634+0000", 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072799099999999999 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.988723+0000", 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8306999999999993e-05 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:12.988785+0000", 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2398999999999997e-05 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132425 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.025916+0000", 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.146339298999999, 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026902200000000001, 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132425 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.025916+0000", 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.025916+0000", 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.025913+0000", 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.025928+0000", 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.504e-05 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.025960+0000", 2024-09-18T05:16:24.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1615999999999997e-05 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.025976+0000", 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.613e-05 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.026072+0000", 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6389000000000002e-05 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.026223+0000", 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015085899999999999 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.026498+0000", 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000274992 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.027675+0000", 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011768060000000001 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.028468+0000", 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00079296200000000003 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.028547+0000", 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9191999999999997e-05 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.028606+0000", 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8866999999999997e-05 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.212 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132432 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.037956+0000", 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.134299081, 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031017140000000002, 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132432 2024-09-18T05:16:24.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.037956+0000", 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.037956+0000", 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.037953+0000", 2024-09-18T05:16:24.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.037970+0000", 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6816999999999998e-05 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.038004+0000", 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4536000000000003e-05 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.038050+0000", 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5893000000000003e-05 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.038177+0000", 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012655899999999999 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.038424+0000", 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024688899999999997 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.038781+0000", 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035752700000000001 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.039917+0000", 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011360529999999999 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.040913+0000", 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099602700000000002 2024-09-18T05:16:24.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.040998+0000", 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4489999999999999e-05 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.041057+0000", 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9592999999999997e-05 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132452 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.072829+0000", 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.099426151999999, 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028047219999999999, 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132452 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.072829+0000", 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.072829+0000", 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.072826+0000", 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:16:24.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.072841+0000", 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4686e-05 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.072873+0000", 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1637000000000002e-05 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.072889+0000", 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6526000000000001e-05 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.072983+0000", 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3806000000000003e-05 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.073136+0000", 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000153249 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.073415+0000", 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000278342 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.074660+0000", 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001245742 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.075483+0000", 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082270499999999996 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.075568+0000", 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4566000000000003e-05 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.075633+0000", 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5826000000000003e-05 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132456 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.078137+0000", 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.094117802, 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026428670000000001, 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132456 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.078137+0000", 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.078137+0000", 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.078135+0000", 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:24.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.078149+0000", 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4377e-05 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.078180+0000", 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0735999999999998e-05 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.078195+0000", 2024-09-18T05:16:24.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4946000000000001e-05 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.078289+0000", 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3764000000000006e-05 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.078433+0000", 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014408499999999999 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.078704+0000", 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027162200000000001 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.079863+0000", 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001158063 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.080637+0000", 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077421100000000002 2024-09-18T05:16:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.080716+0000", 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9417000000000002e-05 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.080780+0000", 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3765999999999999e-05 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.230 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132483 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.129336+0000", 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.042918934999999, 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002822752, 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132483 2024-09-18T05:16:24.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.129336+0000", 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.129336+0000", 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.129333+0000", 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.129348+0000", 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.487e-05 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.129380+0000", 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1946999999999998e-05 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.129403+0000", 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2770000000000001e-05 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.129547+0000", 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014414199999999999 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.129690+0000", 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014264599999999999 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.129974+0000", 2024-09-18T05:16:24.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028394800000000001 2024-09-18T05:16:24.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.131224+0000", 2024-09-18T05:16:24.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012507950000000001 2024-09-18T05:16:24.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.131963+0000", 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073886899999999996 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.132046+0000", 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2369999999999999e-05 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.132159+0000", 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112942 2024-09-18T05:16:24.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132490 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.136011+0000", 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.03624387, 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003642827, 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132490 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.136011+0000", 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.136011+0000", 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.136009+0000", 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.136022+0000", 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2969000000000001e-05 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.136051+0000", 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9427000000000001e-05 2024-09-18T05:16:24.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.136066+0000", 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4613000000000001e-05 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.136158+0000", 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1539999999999994e-05 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.136305+0000", 2024-09-18T05:16:24.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014777599999999999 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.136936+0000", 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063058899999999998 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.138723+0000", 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001787128 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.139457+0000", 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073355899999999995 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.139542+0000", 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5363000000000002e-05 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.139654+0000", 2024-09-18T05:16:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111889 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132509 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.156367+0000", 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.015888276, 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003411851, 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132509 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.156367+0000", 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.156367+0000", 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.156364+0000", 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999971 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.156380+0000", 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6246999999999999e-05 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.156413+0000", 2024-09-18T05:16:24.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2882999999999997e-05 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.156429+0000", 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5948999999999999e-05 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.156525+0000", 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5654000000000003e-05 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.156684+0000", 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159312 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.157283+0000", 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059875300000000005 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.158975+0000", 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001692549 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.159582+0000", 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00060646599999999995 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.159668+0000", 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6396000000000004e-05 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.159778+0000", 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000110266 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.249 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132511 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.160854+0000", 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 11.011401339000001, 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024155190000000001, 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132511 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.160854+0000", 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.160854+0000", 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.160851+0000", 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.160864+0000", 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2765999999999999e-05 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.160895+0000", 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0867000000000001e-05 2024-09-18T05:16:24.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.160910+0000", 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5163e-05 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.161017+0000", 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107249 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.161164+0000", 2024-09-18T05:16:24.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000146296 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.161438+0000", 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027432500000000001 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.162710+0000", 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272046 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.163129+0000", 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041860399999999999 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.163206+0000", 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7632000000000005e-05 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.163269+0000", 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2667000000000002e-05 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4491.0:132519 3.7 3:e2260620:::rbd_object_map.118b4b789970:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.177276+0000", 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.994978408, 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002481872, 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4491", 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/701579218", 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 132519 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.177276+0000", 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.177276+0000", 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.177274+0000", 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999976 2024-09-18T05:16:24.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.177286+0000", 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.19e-05 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.177317+0000", 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1168999999999999e-05 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.177343+0000", 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.597e-05 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.177442+0000", 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8226000000000004e-05 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.177587+0000", 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014553999999999999 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.177756+0000", 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016922199999999999 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.178847+0000", 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010908230000000001 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.179609+0000", 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076175799999999997 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.179693+0000", 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4547000000000002e-05 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.179758+0000", 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4932999999999996e-05 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(osd.1.0:1606 3.4 e143/123 3:27042990:::rbd_data.118bb08697f5.0000000000000008:b v 143'415, mlcod=138'412)", 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:13.978473+0000", 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.193781851000001, 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026143469999999999, 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.978473+0000", 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.978473+0000", 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.978472+0000", 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.978485+0000", 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3276e-05 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.978514+0000", 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8799999999999999e-05 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.978534+0000", 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.961e-05 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.978659+0000", 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012498199999999999 2024-09-18T05:16:24.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.978726+0000", 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7323000000000006e-05 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.980988+0000", 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022619699999999999 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:13.981087+0000", 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9362000000000002e-05 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(osd.1.0:1637 3.0 e147/123 3:06162f33:::rbd_data.118bd6f23a9d.0000000000000008:8 v 147'424, mlcod=145'420)", 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:17.930029+0000", 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.2422257349999999, 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020612949999999999, 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.930029+0000", 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.930029+0000", 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.930029+0000", 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.930036+0000", 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4159999999999998e-06 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.930050+0000", 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4197e-05 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.930062+0000", 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1851999999999999e-05 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.930128+0000", 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6132999999999999e-05 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.930166+0000", 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7778000000000003e-05 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.932058+0000", 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001892216 2024-09-18T05:16:24.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:17.932090+0000", 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2187000000000002e-05 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(osd.4.0:2862 3.9 e148/123 3:94647bf0:::rbd_data.118beb25b049.0000000000000094:7 v 148'290, mlcod=140'287)", 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:18.923815+0000", 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.2484400579999999, 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029541979999999999, 2024-09-18T05:16:24.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.923815+0000", 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.923815+0000", 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.923814+0000", 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.999999 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.923827+0000", 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2979999999999999e-05 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.923856+0000", 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9623000000000001e-05 2024-09-18T05:16:24.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.923878+0000", 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1637e-05 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.923999+0000", 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120976 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.924056+0000", 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6570000000000002e-05 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.926676+0000", 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026198760000000001 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.926769+0000", 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3462999999999996e-05 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(osd.4.0:2863 3.9 e148/123 3:936238fc:::rbd_data.118beb25b049.0000000000000012:7 v 148'292, mlcod=140'287)", 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:18.925391+0000", 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.2468643149999998, 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003034901, 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.925391+0000", 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.925391+0000", 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.925389+0000", 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999981 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.925406+0000", 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6886999999999999e-05 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.925435+0000", 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9082999999999999e-05 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.925453+0000", 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8309999999999999e-05 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.925530+0000", 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7199000000000004e-05 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.925581+0000", 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0686999999999998e-05 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.928307+0000", 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027264530000000002 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:18.928425+0000", 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118032 2024-09-18T05:16:24.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4491.0:133401 3.4 e148/123 3:2756da24:::rbd_data.118beb25b049.0000000000000008:head v 148'417, mlcod=143'415)", 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-18T05:16:19.085356+0000", 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.086898411, 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001844842, 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.085356+0000", 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.085356+0000", 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.085356+0000", 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4294967295.9999995 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.085368+0000", 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.085405+0000", 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7206000000000003e-05 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.085425+0000", 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0474000000000001e-05 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.085573+0000", 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147992 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.085639+0000", 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5726000000000001e-05 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.087094+0000", 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001455357 2024-09-18T05:16:24.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-18T05:16:19.087201+0000", 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106827 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-18T05:16:24.283 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:25.972 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T05:16:26.976 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-18T05:16:26.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T05:16:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-18T05:16:27.980 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-18T05:16:28.121 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a: {} 2024-09-18T05:16:28.122 INFO:teuthology.orchestra.run.smithi017.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T05:16:28.135 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b: {} 2024-09-18T05:16:28.135 INFO:teuthology.orchestra.run.smithi017.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T05:16:28.145 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c: {} 2024-09-18T05:16:28.145 INFO:teuthology.orchestra.run.smithi017.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T05:16:28.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-18T05:16:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2024-09-18T05:16:29.005 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-18T05:16:29.905 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-18T05:16:29.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-18T05:16:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2024-09-18T05:16:31.014 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-18T05:16:31.996 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-18T05:16:32.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-18T05:16:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.3 to 1 (10000) 2024-09-18T05:16:33.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-18T05:16:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-18T05:16:34.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-18T05:16:35.031 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.4 to 1 (10000) 2024-09-18T05:16:35.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-18T05:16:36.034 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-18T05:16:36.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-18T05:16:37.043 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.5 to 1 (10000) 2024-09-18T05:16:37.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-18T05:16:38.056 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-18T05:16:38.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-18T05:16:39.072 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.7 to 1 (10000) 2024-09-18T05:16:39.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-18T05:16:40.074 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-18T05:16:40.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-18T05:16:41.084 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.6 to 1 (10000) 2024-09-18T05:16:41.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-18T05:16:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-18T05:16:42.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-18T05:16:43.106 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2024-09-18T05:16:43.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-18T05:16:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-18T05:16:44.140 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-18T05:16:44.140 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-18T05:16:44.140 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-18T05:16:44.140 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-18T05:16:44.140 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T05:16:44.141 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T05:16:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:44.445 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":171,"fsid":"04ac0d2c-34bd-46ad-a307-a4eb23236eb4","created":"2024-09-18T05:13:15.193498+0000","modified":"2024-09-18T05:16:44.105283+0000","last_up_change":"2024-09-18T05:15:54.176883+0000","last_in_change":"2024-09-18T05:13:18.221936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T05:13:28.629114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T05:13:34.103981+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-18T05:13:44.114945+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":95,"snap_epoch":152,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2a580f7-2bbc-46c3-b6b5-5a9e93539d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6801","nonce":1558450642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6803","nonce":1558450642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6807","nonce":1558450642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6805","nonce":1558450642}]},"public_addr":"172.21.15.17:6801/1558450642","cluster_addr":"172.21.15.17:6803/1558450642","heartbeat_back_addr":"172.21.15.17:6807/1558450642","heartbeat_front_addr":"172.21.15.17:6805/1558450642","state":["exists","up"]},{"osd":1,"uuid":"260da429-e6eb-446b-95a0-dcf4581bb584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6809","nonce":3444575073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6811","nonce":3444575073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6815","nonce":3444575073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6813","nonce":3444575073}]},"public_addr":"172.21.15.17:6809/3444575073","cluster_addr":"172.21.15.17:6811/3444575073","heartbeat_back_addr":"172.21.15.17:6815/3444575073","heartbeat_front_addr":"172.21.15.17:6813/3444575073","state":["exists","up"]},{"osd":2,"uuid":"0cf5d53a-552d-4775-8437-86af3465b1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":100,"up_from":123,"up_thru":136,"down_at":101,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6817","nonce":1738914066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6819","nonce":1738914066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6823","nonce":1738914066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6821","nonce":1738914066}]},"public_addr":"172.21.15.17:6817/1738914066","cluster_addr":"172.21.15.17:6819/1738914066","heartbeat_back_addr":"172.21.15.17:6823/1738914066","heartbeat_front_addr":"172.21.15.17:6821/1738914066","state":["exists","up"]},{"osd":3,"uuid":"73bc18b6-4972-4164-a294-b6372bcf9f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6825","nonce":3763834627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6827","nonce":3763834627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6831","nonce":3763834627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6829","nonce":3763834627}]},"public_addr":"172.21.15.17:6825/3763834627","cluster_addr":"172.21.15.17:6827/3763834627","heartbeat_back_addr":"172.21.15.17:6831/3763834627","heartbeat_front_addr":"172.21.15.17:6829/3763834627","state":["exists","up"]},{"osd":4,"uuid":"536c8ef2-eca6-44b4-a70c-06f191eb5ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6802","nonce":1703780253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6806","nonce":1703780253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6819","nonce":1703780253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6812","nonce":1703780253}]},"public_addr":"172.21.15.86:6802/1703780253","cluster_addr":"172.21.15.86:6806/1703780253","heartbeat_back_addr":"172.21.15.86:6819/1703780253","heartbeat_front_addr":"172.21.15.86:6812/1703780253","state":["exists","up"]},{"osd":5,"uuid":"4341bba4-2913-4352-89d4-36fa18ee39cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6811","nonce":3348904742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6816","nonce":3348904742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6823","nonce":3348904742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6820","nonce":3348904742}]},"public_addr":"172.21.15.86:6811/3348904742","cluster_addr":"172.21.15.86:6816/3348904742","heartbeat_back_addr":"172.21.15.86:6823/3348904742","heartbeat_front_addr":"172.21.15.86:6820/3348904742","state":["exists","up"]},{"osd":6,"uuid":"e47d4aad-9c4b-43a9-9b32-2db463ec2a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":47,"up_from":61,"up_thru":131,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6801","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6803","nonce":3446120186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6807","nonce":3446120186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6821","nonce":3446120186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6814","nonce":3446120186}]},"public_addr":"172.21.15.86:6803/3446120186","cluster_addr":"172.21.15.86:6807/3446120186","heartbeat_back_addr":"172.21.15.86:6821/3446120186","heartbeat_front_addr":"172.21.15.86:6814/3446120186","state":["exists","up"]},{"osd":7,"uuid":"686d275c-e592-44c1-87f9-ac9718f3a112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6825","nonce":1345159853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6827","nonce":1345159853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6831","nonce":1345159853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6829","nonce":1345159853}]},"public_addr":"172.21.15.86:6825/1345159853","cluster_addr":"172.21.15.86:6827/1345159853","heartbeat_back_addr":"172.21.15.86:6831/1345159853","heartbeat_front_addr":"172.21.15.86:6829/1345159853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.758535+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.800715+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.783374+0000","dead_epoch":101},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.779519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.893837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.776852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.919808+0000","dead_epoch":48},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.883599+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[1,5]}],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T05:16:44.465 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T05:16:44.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T05:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:44.767 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":171,"fsid":"04ac0d2c-34bd-46ad-a307-a4eb23236eb4","created":"2024-09-18T05:13:15.193498+0000","modified":"2024-09-18T05:16:44.105283+0000","last_up_change":"2024-09-18T05:15:54.176883+0000","last_in_change":"2024-09-18T05:13:18.221936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T05:13:28.629114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T05:13:34.103981+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-18T05:13:44.114945+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":95,"snap_epoch":152,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2a580f7-2bbc-46c3-b6b5-5a9e93539d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6801","nonce":1558450642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6803","nonce":1558450642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6807","nonce":1558450642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6805","nonce":1558450642}]},"public_addr":"172.21.15.17:6801/1558450642","cluster_addr":"172.21.15.17:6803/1558450642","heartbeat_back_addr":"172.21.15.17:6807/1558450642","heartbeat_front_addr":"172.21.15.17:6805/1558450642","state":["exists","up"]},{"osd":1,"uuid":"260da429-e6eb-446b-95a0-dcf4581bb584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6809","nonce":3444575073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6811","nonce":3444575073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6815","nonce":3444575073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6813","nonce":3444575073}]},"public_addr":"172.21.15.17:6809/3444575073","cluster_addr":"172.21.15.17:6811/3444575073","heartbeat_back_addr":"172.21.15.17:6815/3444575073","heartbeat_front_addr":"172.21.15.17:6813/3444575073","state":["exists","up"]},{"osd":2,"uuid":"0cf5d53a-552d-4775-8437-86af3465b1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":100,"up_from":123,"up_thru":136,"down_at":101,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6817","nonce":1738914066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6819","nonce":1738914066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6823","nonce":1738914066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6821","nonce":1738914066}]},"public_addr":"172.21.15.17:6817/1738914066","cluster_addr":"172.21.15.17:6819/1738914066","heartbeat_back_addr":"172.21.15.17:6823/1738914066","heartbeat_front_addr":"172.21.15.17:6821/1738914066","state":["exists","up"]},{"osd":3,"uuid":"73bc18b6-4972-4164-a294-b6372bcf9f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6825","nonce":3763834627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6827","nonce":3763834627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6831","nonce":3763834627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6829","nonce":3763834627}]},"public_addr":"172.21.15.17:6825/3763834627","cluster_addr":"172.21.15.17:6827/3763834627","heartbeat_back_addr":"172.21.15.17:6831/3763834627","heartbeat_front_addr":"172.21.15.17:6829/3763834627","state":["exists","up"]},{"osd":4,"uuid":"536c8ef2-eca6-44b4-a70c-06f191eb5ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6802","nonce":1703780253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6806","nonce":1703780253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6819","nonce":1703780253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6812","nonce":1703780253}]},"public_addr":"172.21.15.86:6802/1703780253","cluster_addr":"172.21.15.86:6806/1703780253","heartbeat_back_addr":"172.21.15.86:6819/1703780253","heartbeat_front_addr":"172.21.15.86:6812/1703780253","state":["exists","up"]},{"osd":5,"uuid":"4341bba4-2913-4352-89d4-36fa18ee39cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6811","nonce":3348904742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6816","nonce":3348904742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6823","nonce":3348904742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6820","nonce":3348904742}]},"public_addr":"172.21.15.86:6811/3348904742","cluster_addr":"172.21.15.86:6816/3348904742","heartbeat_back_addr":"172.21.15.86:6823/3348904742","heartbeat_front_addr":"172.21.15.86:6820/3348904742","state":["exists","up"]},{"osd":6,"uuid":"e47d4aad-9c4b-43a9-9b32-2db463ec2a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":47,"up_from":61,"up_thru":131,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6801","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6803","nonce":3446120186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6807","nonce":3446120186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6821","nonce":3446120186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6814","nonce":3446120186}]},"public_addr":"172.21.15.86:6803/3446120186","cluster_addr":"172.21.15.86:6807/3446120186","heartbeat_back_addr":"172.21.15.86:6821/3446120186","heartbeat_front_addr":"172.21.15.86:6814/3446120186","state":["exists","up"]},{"osd":7,"uuid":"686d275c-e592-44c1-87f9-ac9718f3a112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6825","nonce":1345159853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6827","nonce":1345159853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6831","nonce":1345159853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6829","nonce":1345159853}]},"public_addr":"172.21.15.86:6825/1345159853","cluster_addr":"172.21.15.86:6827/1345159853","heartbeat_back_addr":"172.21.15.86:6831/1345159853","heartbeat_front_addr":"172.21.15.86:6829/1345159853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.758535+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.800715+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.783374+0000","dead_epoch":101},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.779519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.893837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.776852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.919808+0000","dead_epoch":48},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.883599+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[1,5]}],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T05:16:44.788 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T05:16:44.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T05:16:44.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T05:16:44.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T05:16:44.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-18T05:16:44.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-18T05:16:44.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-18T05:16:44.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-18T05:16:45.054 INFO:teuthology.orchestra.run.smithi017.stdout:528280977420 2024-09-18T05:16:45.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T05:16:45.058 INFO:teuthology.orchestra.run.smithi017.stdout:261993005083 2024-09-18T05:16:45.058 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T05:16:45.062 INFO:teuthology.orchestra.run.smithi017.stdout:55834574891 2024-09-18T05:16:45.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T05:16:45.070 INFO:teuthology.orchestra.run.smithi017.stdout:55834574893 2024-09-18T05:16:45.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T05:16:45.077 INFO:teuthology.orchestra.run.smithi017.stdout:55834574891 2024-09-18T05:16:45.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T05:16:45.080 INFO:teuthology.orchestra.run.smithi017.stdout:55834574892 2024-09-18T05:16:45.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T05:16:45.081 INFO:teuthology.orchestra.run.smithi017.stdout:55834574890 2024-09-18T05:16:45.081 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T05:16:45.093 INFO:teuthology.orchestra.run.smithi017.stdout:55834574891 2024-09-18T05:16:45.093 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T05:16:45.552 INFO:teuthology.orchestra.run.smithi017.stdout:261993005082 2024-09-18T05:16:45.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 261993005083 got 261993005082 for osd.6 2024-09-18T05:16:45.579 INFO:teuthology.orchestra.run.smithi017.stdout:55834574892 2024-09-18T05:16:45.599 INFO:teuthology.orchestra.run.smithi017.stdout:528280977419 2024-09-18T05:16:45.601 INFO:teuthology.orchestra.run.smithi017.stdout:55834574890 2024-09-18T05:16:45.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.7 2024-09-18T05:16:45.613 INFO:teuthology.orchestra.run.smithi017.stdout:55834574890 2024-09-18T05:16:45.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574890 for osd.3 2024-09-18T05:16:45.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 528280977420 got 528280977419 for osd.2 2024-09-18T05:16:45.633 INFO:teuthology.orchestra.run.smithi017.stdout:55834574890 2024-09-18T05:16:45.639 INFO:teuthology.orchestra.run.smithi017.stdout:55834574891 2024-09-18T05:16:45.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574890 for osd.4 2024-09-18T05:16:45.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574890 for osd.1 2024-09-18T05:16:45.653 INFO:teuthology.orchestra.run.smithi017.stdout:55834574889 2024-09-18T05:16:45.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.5 2024-09-18T05:16:45.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574890 got 55834574889 for osd.0 2024-09-18T05:16:46.577 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T05:16:46.605 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T05:16:46.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T05:16:46.631 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T05:16:46.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T05:16:46.654 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T05:16:46.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T05:16:46.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T05:16:47.093 INFO:teuthology.orchestra.run.smithi017.stdout:261993005082 2024-09-18T05:16:47.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 261993005083 got 261993005082 for osd.6 2024-09-18T05:16:47.121 INFO:teuthology.orchestra.run.smithi017.stdout:55834574892 2024-09-18T05:16:47.145 INFO:teuthology.orchestra.run.smithi017.stdout:55834574891 2024-09-18T05:16:47.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.7 2024-09-18T05:16:47.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574891 for osd.3 2024-09-18T05:16:47.164 DEBUG:teuthology.parallel:result is None 2024-09-18T05:16:47.186 INFO:teuthology.orchestra.run.smithi017.stdout:55834574891 2024-09-18T05:16:47.188 INFO:teuthology.orchestra.run.smithi017.stdout:55834574892 2024-09-18T05:16:47.204 INFO:teuthology.orchestra.run.smithi017.stdout:55834574891 2024-09-18T05:16:47.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574891 for osd.4 2024-09-18T05:16:47.207 DEBUG:teuthology.parallel:result is None 2024-09-18T05:16:47.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.5 2024-09-18T05:16:47.209 DEBUG:teuthology.parallel:result is None 2024-09-18T05:16:47.216 INFO:teuthology.orchestra.run.smithi017.stdout:55834574890 2024-09-18T05:16:47.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574891 for osd.1 2024-09-18T05:16:47.223 DEBUG:teuthology.parallel:result is None 2024-09-18T05:16:47.235 INFO:teuthology.orchestra.run.smithi017.stdout:528280977420 2024-09-18T05:16:47.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574890 got 55834574890 for osd.0 2024-09-18T05:16:47.240 DEBUG:teuthology.parallel:result is None 2024-09-18T05:16:47.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 528280977420 got 528280977420 for osd.2 2024-09-18T05:16:47.253 DEBUG:teuthology.parallel:result is None 2024-09-18T05:16:48.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T05:16:48.150 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T05:16:48.429 INFO:teuthology.orchestra.run.smithi017.stdout:261993005083 2024-09-18T05:16:48.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 261993005083 got 261993005083 for osd.6 2024-09-18T05:16:48.447 DEBUG:teuthology.parallel:result is None 2024-09-18T05:16:48.450 INFO:teuthology.orchestra.run.smithi017.stdout:55834574893 2024-09-18T05:16:48.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.7 2024-09-18T05:16:48.467 DEBUG:teuthology.parallel:result is None 2024-09-18T05:16:48.468 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-18T05:16:48.468 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:16:48.807 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:48.808 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:16:48.824 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-18T05:16:48.604837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":362,"num_object_clones":0,"num_object_copies":724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":362,"num_whiteouts":354,"num_read":182735,"num_read_kb":921879,"num_write":21996,"num_write_kb":365914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19249,"ondisk_log_size":19249,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400476,"kb_used_data":16240,"kb_used_omap":29,"kb_used_meta":384098,"kb_avail":754574244,"statfs":{"total":773094113280,"available":772684025856,"internally_reserved":0,"allocated":16629760,"data_stored":9114916,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":29988,"internal_metadata":393317084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.516552"},"pg_stats":[{"pgid":"3.1f","version":"152'705","reported_seq":2818,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198942+0000","last_change":"2024-09-18T05:16:22.952279+0000","last_active":"2024-09-18T05:16:43.198942+0000","last_peered":"2024-09-18T05:16:43.198942+0000","last_clean":"2024-09-18T05:16:43.198942+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:16:43.198942+0000","last_undegraded":"2024-09-18T05:16:43.198942+0000","last_fullsized":"2024-09-18T05:16:43.198942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069029300000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4139,"num_read_kb":20195,"num_write":907,"num_write_kb":9329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"151'1446","reported_seq":6945,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101179+0000","last_change":"2024-09-18T05:16:22.950489+0000","last_active":"2024-09-18T05:16:43.101179+0000","last_peered":"2024-09-18T05:16:43.101179+0000","last_clean":"2024-09-18T05:16:43.101179+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:16:43.101179+0000","last_undegraded":"2024-09-18T05:16:43.101179+0000","last_fullsized":"2024-09-18T05:16:43.101179+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031115520000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":11552,"num_read_kb":29398,"num_write":2219,"num_write_kb":10724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"151'500","reported_seq":2613,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202135+0000","last_change":"2024-09-18T05:16:39.081650+0000","last_active":"2024-09-18T05:16:43.202135+0000","last_peered":"2024-09-18T05:16:43.202135+0000","last_clean":"2024-09-18T05:16:43.202135+0000","last_became_active":"2024-09-18T05:16:39.078161+0000","last_became_peered":"2024-09-18T05:16:39.078161+0000","last_unstale":"2024-09-18T05:16:43.202135+0000","last_undegraded":"2024-09-18T05:16:43.202135+0000","last_fullsized":"2024-09-18T05:16:43.202135+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:58.056260+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0077051680000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3418,"num_read_kb":20008,"num_write":499,"num_write_kb":11307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"152'957","reported_seq":4756,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201751+0000","last_change":"2024-09-18T05:16:39.081624+0000","last_active":"2024-09-18T05:16:43.201751+0000","last_peered":"2024-09-18T05:16:43.201751+0000","last_clean":"2024-09-18T05:16:43.201751+0000","last_became_active":"2024-09-18T05:16:39.078258+0000","last_became_peered":"2024-09-18T05:16:39.078258+0000","last_unstale":"2024-09-18T05:16:43.201751+0000","last_undegraded":"2024-09-18T05:16:43.201751+0000","last_fullsized":"2024-09-18T05:16:43.201751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:23.450501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078280600000000004,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":14,"num_read":7245,"num_read_kb":33079,"num_write":1238,"num_write_kb":14791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"151'402","reported_seq":2487,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199015+0000","last_change":"2024-09-18T05:16:22.954184+0000","last_active":"2024-09-18T05:16:43.199015+0000","last_peered":"2024-09-18T05:16:43.199015+0000","last_clean":"2024-09-18T05:16:43.199015+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:16:43.199015+0000","last_undegraded":"2024-09-18T05:16:43.199015+0000","last_fullsized":"2024-09-18T05:16:43.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074971399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2723,"num_read_kb":17099,"num_write":364,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"151'429","reported_seq":6379,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.103891+0000","last_change":"2024-09-18T05:16:22.967762+0000","last_active":"2024-09-18T05:16:43.103891+0000","last_peered":"2024-09-18T05:16:43.103891+0000","last_clean":"2024-09-18T05:16:43.103891+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:16:43.103891+0000","last_undegraded":"2024-09-18T05:16:43.103891+0000","last_fullsized":"2024-09-18T05:16:43.103891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071492300000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":5935,"num_read_kb":45781,"num_write":417,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"152'566","reported_seq":5849,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198800+0000","last_change":"2024-09-18T05:16:22.956775+0000","last_active":"2024-09-18T05:16:43.198800+0000","last_peered":"2024-09-18T05:16:43.198800+0000","last_clean":"2024-09-18T05:16:43.198800+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:16:43.198800+0000","last_undegraded":"2024-09-18T05:16:43.198800+0000","last_fullsized":"2024-09-18T05:16:43.198800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055068100000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8335,"num_read_kb":20827,"num_write":497,"num_write_kb":15047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"151'863","reported_seq":2720,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101173+0000","last_change":"2024-09-18T05:16:22.948825+0000","last_active":"2024-09-18T05:16:43.101173+0000","last_peered":"2024-09-18T05:16:43.101173+0000","last_clean":"2024-09-18T05:16:43.101173+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:16:43.101173+0000","last_undegraded":"2024-09-18T05:16:43.101173+0000","last_fullsized":"2024-09-18T05:16:43.101173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001816465,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4198,"num_read_kb":22346,"num_write":1180,"num_write_kb":9146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'583","reported_seq":7223,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199402+0000","last_change":"2024-09-18T05:16:22.953058+0000","last_active":"2024-09-18T05:16:43.199402+0000","last_peered":"2024-09-18T05:16:43.199402+0000","last_clean":"2024-09-18T05:16:43.199402+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:16:43.199402+0000","last_undegraded":"2024-09-18T05:16:43.199402+0000","last_fullsized":"2024-09-18T05:16:43.199402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012193429999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8338,"num_read_kb":33067,"num_write":470,"num_write_kb":10649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'656","reported_seq":8296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202132+0000","last_change":"2024-09-18T05:16:22.963058+0000","last_active":"2024-09-18T05:16:43.202132+0000","last_peered":"2024-09-18T05:16:43.202132+0000","last_clean":"2024-09-18T05:16:43.202132+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:16:43.202132+0000","last_undegraded":"2024-09-18T05:16:43.202132+0000","last_fullsized":"2024-09-18T05:16:43.202132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655983,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9449,"num_read_kb":47880,"num_write":679,"num_write_kb":15057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"151'746","reported_seq":6974,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202806+0000","last_change":"2024-09-18T05:16:22.947810+0000","last_active":"2024-09-18T05:16:43.202806+0000","last_peered":"2024-09-18T05:16:43.202806+0000","last_clean":"2024-09-18T05:16:43.202806+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:16:43.202806+0000","last_undegraded":"2024-09-18T05:16:43.202806+0000","last_fullsized":"2024-09-18T05:16:43.202806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013431739999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":8031,"num_read_kb":49145,"num_write":1033,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"151'399","reported_seq":2296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104237+0000","last_change":"2024-09-18T05:16:22.968983+0000","last_active":"2024-09-18T05:16:43.104237+0000","last_peered":"2024-09-18T05:16:43.104237+0000","last_clean":"2024-09-18T05:16:43.104237+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:16:43.104237+0000","last_undegraded":"2024-09-18T05:16:43.104237+0000","last_fullsized":"2024-09-18T05:16:43.104237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010340900000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":2061,"num_read_kb":19662,"num_write":411,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201271+0000","last_change":"2024-09-18T05:16:02.923317+0000","last_active":"2024-09-18T05:16:43.201271+0000","last_peered":"2024-09-18T05:16:43.201271+0000","last_clean":"2024-09-18T05:16:43.201271+0000","last_became_active":"2024-09-18T05:16:02.922394+0000","last_became_peered":"2024-09-18T05:16:02.922394+0000","last_unstale":"2024-09-18T05:16:43.201271+0000","last_undegraded":"2024-09-18T05:16:43.201271+0000","last_fullsized":"2024-09-18T05:16:43.201271+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:34.150689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"152'577","reported_seq":3709,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199283+0000","last_change":"2024-09-18T05:16:22.953341+0000","last_active":"2024-09-18T05:16:43.199283+0000","last_peered":"2024-09-18T05:16:43.199283+0000","last_clean":"2024-09-18T05:16:43.199283+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:16:43.199283+0000","last_undegraded":"2024-09-18T05:16:43.199283+0000","last_fullsized":"2024-09-18T05:16:43.199283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015023230000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":4591,"num_read_kb":29240,"num_write":682,"num_write_kb":13080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199016+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:16:43.199016+0000","last_peered":"2024-09-18T05:16:43.199016+0000","last_clean":"2024-09-18T05:16:43.199016+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:16:43.199016+0000","last_undegraded":"2024-09-18T05:16:43.199016+0000","last_fullsized":"2024-09-18T05:16:43.199016+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"152'533","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101657+0000","last_change":"2024-09-18T05:16:22.951905+0000","last_active":"2024-09-18T05:16:43.101657+0000","last_peered":"2024-09-18T05:16:43.101657+0000","last_clean":"2024-09-18T05:16:43.101657+0000","last_became_active":"2024-09-18T05:16:19.904499+0000","last_became_peered":"2024-09-18T05:16:19.904499+0000","last_unstale":"2024-09-18T05:16:43.101657+0000","last_undegraded":"2024-09-18T05:16:43.101657+0000","last_fullsized":"2024-09-18T05:16:43.101657+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:10:44.782963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00364015,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3679,"num_read_kb":33211,"num_write":613,"num_write_kb":10118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":7448296,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202988+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:16:43.202988+0000","last_peered":"2024-09-18T05:16:43.202988+0000","last_clean":"2024-09-18T05:16:43.202988+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:16:43.202988+0000","last_undegraded":"2024-09-18T05:16:43.202988+0000","last_fullsized":"2024-09-18T05:16:43.202988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"150'420","reported_seq":6024,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199233+0000","last_change":"2024-09-18T05:16:22.957252+0000","last_active":"2024-09-18T05:16:43.199233+0000","last_peered":"2024-09-18T05:16:43.199233+0000","last_clean":"2024-09-18T05:16:43.199233+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:16:43.199233+0000","last_undegraded":"2024-09-18T05:16:43.199233+0000","last_fullsized":"2024-09-18T05:16:43.199233+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:46.818280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060223399999999999,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":6557,"num_read_kb":27685,"num_write":436,"num_write_kb":9094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199291+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:16:43.199291+0000","last_peered":"2024-09-18T05:16:43.199291+0000","last_clean":"2024-09-18T05:16:43.199291+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:16:43.199291+0000","last_undegraded":"2024-09-18T05:16:43.199291+0000","last_fullsized":"2024-09-18T05:16:43.199291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"151'459","reported_seq":6025,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202438+0000","last_change":"2024-09-18T05:16:39.081593+0000","last_active":"2024-09-18T05:16:43.202438+0000","last_peered":"2024-09-18T05:16:43.202438+0000","last_clean":"2024-09-18T05:16:43.202438+0000","last_became_active":"2024-09-18T05:16:39.077813+0000","last_became_peered":"2024-09-18T05:16:39.077813+0000","last_unstale":"2024-09-18T05:16:43.202438+0000","last_undegraded":"2024-09-18T05:16:43.202438+0000","last_fullsized":"2024-09-18T05:16:43.202438+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:26:16.213994+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.032776543999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5840,"num_read_kb":39783,"num_write":450,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"152'1164","reported_seq":4989,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104129+0000","last_change":"2024-09-18T05:16:22.969058+0000","last_active":"2024-09-18T05:16:43.104129+0000","last_peered":"2024-09-18T05:16:43.104129+0000","last_clean":"2024-09-18T05:16:43.104129+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:16:43.104129+0000","last_undegraded":"2024-09-18T05:16:43.104129+0000","last_fullsized":"2024-09-18T05:16:43.104129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011154260000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":6871,"num_read_kb":44276,"num_write":1455,"num_write_kb":20060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":81,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201766+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201766+0000","last_peered":"2024-09-18T05:16:43.201766+0000","last_clean":"2024-09-18T05:16:43.201766+0000","last_became_active":"2024-09-18T05:16:39.076198+0000","last_became_peered":"2024-09-18T05:16:39.076198+0000","last_unstale":"2024-09-18T05:16:43.201766+0000","last_undegraded":"2024-09-18T05:16:43.201766+0000","last_fullsized":"2024-09-18T05:16:43.201766+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:48:58.557656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'438","reported_seq":4750,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198784+0000","last_change":"2024-09-18T05:16:22.956747+0000","last_active":"2024-09-18T05:16:43.198784+0000","last_peered":"2024-09-18T05:16:43.198784+0000","last_clean":"2024-09-18T05:16:43.198784+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:16:43.198784+0000","last_undegraded":"2024-09-18T05:16:43.198784+0000","last_fullsized":"2024-09-18T05:16:43.198784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:12.320367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037471100000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":4862,"num_read_kb":21776,"num_write":386,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.102497+0000","last_change":"2024-09-18T05:15:55.216600+0000","last_active":"2024-09-18T05:16:43.102497+0000","last_peered":"2024-09-18T05:16:43.102497+0000","last_clean":"2024-09-18T05:16:43.102497+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:16:43.102497+0000","last_undegraded":"2024-09-18T05:16:43.102497+0000","last_fullsized":"2024-09-18T05:16:43.102497+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:42:31.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"151'363","reported_seq":2476,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199170+0000","last_change":"2024-09-18T05:16:22.951266+0000","last_active":"2024-09-18T05:16:43.199170+0000","last_peered":"2024-09-18T05:16:43.199170+0000","last_clean":"2024-09-18T05:16:43.199170+0000","last_became_active":"2024-09-18T05:16:01.899154+0000","last_became_peered":"2024-09-18T05:16:01.899154+0000","last_unstale":"2024-09-18T05:16:43.199170+0000","last_undegraded":"2024-09-18T05:16:43.199170+0000","last_fullsized":"2024-09-18T05:16:43.199170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:00:29.357279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032123,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":2135,"num_read_kb":5505,"num_write":365,"num_write_kb":5251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":2091093,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202445+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:16:43.202445+0000","last_peered":"2024-09-18T05:16:43.202445+0000","last_clean":"2024-09-18T05:16:43.202445+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:16:43.202445+0000","last_undegraded":"2024-09-18T05:16:43.202445+0000","last_fullsized":"2024-09-18T05:16:43.202445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"151'596","reported_seq":5170,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198896+0000","last_change":"2024-09-18T05:16:22.957237+0000","last_active":"2024-09-18T05:16:43.198896+0000","last_peered":"2024-09-18T05:16:43.198896+0000","last_clean":"2024-09-18T05:16:43.198896+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:16:43.198896+0000","last_undegraded":"2024-09-18T05:16:43.198896+0000","last_fullsized":"2024-09-18T05:16:43.198896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:22:34.025479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083719899999999995,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7500,"num_read_kb":38768,"num_write":572,"num_write_kb":10748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":106,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201713+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201713+0000","last_peered":"2024-09-18T05:16:43.201713+0000","last_clean":"2024-09-18T05:16:43.201713+0000","last_became_active":"2024-09-18T05:16:39.075931+0000","last_became_peered":"2024-09-18T05:16:39.075931+0000","last_unstale":"2024-09-18T05:16:43.201713+0000","last_undegraded":"2024-09-18T05:16:43.201713+0000","last_fullsized":"2024-09-18T05:16:43.201713+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:06.991206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202783+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:16:43.202783+0000","last_peered":"2024-09-18T05:16:43.202783+0000","last_clean":"2024-09-18T05:16:43.202783+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:16:43.202783+0000","last_undegraded":"2024-09-18T05:16:43.202783+0000","last_fullsized":"2024-09-18T05:16:43.202783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"152'426","reported_seq":5316,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.100966+0000","last_change":"2024-09-18T05:16:22.948527+0000","last_active":"2024-09-18T05:16:43.100966+0000","last_peered":"2024-09-18T05:16:43.100966+0000","last_clean":"2024-09-18T05:16:43.100966+0000","last_became_active":"2024-09-18T05:16:01.898482+0000","last_became_peered":"2024-09-18T05:16:01.898482+0000","last_unstale":"2024-09-18T05:16:43.100966+0000","last_undegraded":"2024-09-18T05:16:43.100966+0000","last_fullsized":"2024-09-18T05:16:43.100966+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:22.456629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015649310000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6584,"num_read_kb":42729,"num_write":374,"num_write_kb":15931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":15236017,"num_keys_recovered":42,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"151'296","reported_seq":4172,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104036+0000","last_change":"2024-09-18T05:16:22.967630+0000","last_active":"2024-09-18T05:16:43.104036+0000","last_peered":"2024-09-18T05:16:43.104036+0000","last_clean":"2024-09-18T05:16:43.104036+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:16:43.104036+0000","last_undegraded":"2024-09-18T05:16:43.104036+0000","last_fullsized":"2024-09-18T05:16:43.104036+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:06:43.114897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062945099999999995,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3697,"num_read_kb":33449,"num_write":292,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"151'633","reported_seq":2727,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201314+0000","last_change":"2024-09-18T05:16:22.966505+0000","last_active":"2024-09-18T05:16:43.201314+0000","last_peered":"2024-09-18T05:16:43.201314+0000","last_clean":"2024-09-18T05:16:43.201314+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:16:43.201314+0000","last_undegraded":"2024-09-18T05:16:43.201314+0000","last_fullsized":"2024-09-18T05:16:43.201314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000499841,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":3587,"num_read_kb":18383,"num_write":752,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"151'299","reported_seq":3368,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101410+0000","last_change":"2024-09-18T05:16:22.949763+0000","last_active":"2024-09-18T05:16:43.101410+0000","last_peered":"2024-09-18T05:16:43.101410+0000","last_clean":"2024-09-18T05:16:43.101410+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:16:43.101410+0000","last_undegraded":"2024-09-18T05:16:43.101410+0000","last_fullsized":"2024-09-18T05:16:43.101410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002578814,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":2832,"num_read_kb":19521,"num_write":259,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"151'471","reported_seq":5189,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202050+0000","last_change":"2024-09-18T05:16:39.081596+0000","last_active":"2024-09-18T05:16:43.202050+0000","last_peered":"2024-09-18T05:16:43.202050+0000","last_clean":"2024-09-18T05:16:43.202050+0000","last_became_active":"2024-09-18T05:16:39.077761+0000","last_became_peered":"2024-09-18T05:16:39.077761+0000","last_unstale":"2024-09-18T05:16:43.202050+0000","last_undegraded":"2024-09-18T05:16:43.202050+0000","last_fullsized":"2024-09-18T05:16:43.202050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:52.136023+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017471631000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5191,"num_read_kb":29963,"num_write":520,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'416","reported_seq":3721,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202864+0000","last_change":"2024-09-18T05:16:22.947578+0000","last_active":"2024-09-18T05:16:43.202864+0000","last_peered":"2024-09-18T05:16:43.202864+0000","last_clean":"2024-09-18T05:16:43.202864+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:16:43.202864+0000","last_undegraded":"2024-09-18T05:16:43.202864+0000","last_fullsized":"2024-09-18T05:16:43.202864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318949999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4121,"num_read_kb":17361,"num_write":391,"num_write_kb":13003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"151'602","reported_seq":5933,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.203158+0000","last_change":"2024-09-18T05:16:22.948118+0000","last_active":"2024-09-18T05:16:43.203158+0000","last_peered":"2024-09-18T05:16:43.203158+0000","last_clean":"2024-09-18T05:16:43.203158+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:16:43.203158+0000","last_undegraded":"2024-09-18T05:16:43.203158+0000","last_fullsized":"2024-09-18T05:16:43.203158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001596606,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":6945,"num_read_kb":34740,"num_write":596,"num_write_kb":4823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"151'555","reported_seq":9087,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101442+0000","last_change":"2024-09-18T05:16:22.950996+0000","last_active":"2024-09-18T05:16:43.101442+0000","last_peered":"2024-09-18T05:16:43.101442+0000","last_clean":"2024-09-18T05:16:43.101442+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:16:43.101442+0000","last_undegraded":"2024-09-18T05:16:43.101442+0000","last_fullsized":"2024-09-18T05:16:43.101442+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031437349999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9783,"num_read_kb":40662,"num_write":558,"num_write_kb":18337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"150'666","reported_seq":4026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201139+0000","last_change":"2024-09-18T05:16:22.966612+0000","last_active":"2024-09-18T05:16:43.201139+0000","last_peered":"2024-09-18T05:16:43.201139+0000","last_clean":"2024-09-18T05:16:43.201139+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:16:43.201139+0000","last_undegraded":"2024-09-18T05:16:43.201139+0000","last_fullsized":"2024-09-18T05:16:43.201139+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056430399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":7033,"num_read_kb":30921,"num_write":767,"num_write_kb":9608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'442","reported_seq":3800,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202498+0000","last_change":"2024-09-18T05:16:22.946942+0000","last_active":"2024-09-18T05:16:43.202498+0000","last_peered":"2024-09-18T05:16:43.202498+0000","last_clean":"2024-09-18T05:16:43.202498+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:16:43.202498+0000","last_undegraded":"2024-09-18T05:16:43.202498+0000","last_fullsized":"2024-09-18T05:16:43.202498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084174599999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":4545,"num_read_kb":16351,"num_write":465,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"150'667","reported_seq":3026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199197+0000","last_change":"2024-09-18T05:16:22.951854+0000","last_active":"2024-09-18T05:16:43.199197+0000","last_peered":"2024-09-18T05:16:43.199197+0000","last_clean":"2024-09-18T05:16:43.199197+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:16:43.199197+0000","last_undegraded":"2024-09-18T05:16:43.199197+0000","last_fullsized":"2024-09-18T05:16:43.199197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001575814,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":5022,"num_read_kb":16163,"num_write":742,"num_write_kb":7893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"151'854","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202677+0000","last_change":"2024-09-18T05:16:22.946967+0000","last_active":"2024-09-18T05:16:43.202677+0000","last_peered":"2024-09-18T05:16:43.202677+0000","last_clean":"2024-09-18T05:16:43.202677+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:16:43.202677+0000","last_undegraded":"2024-09-18T05:16:43.202677+0000","last_fullsized":"2024-09-18T05:16:43.202677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078209799999999995,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":5820,"num_read_kb":22805,"num_write":1246,"num_write_kb":8989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":358,"num_object_clones":0,"num_object_copies":716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":354,"num_read":182619,"num_read_kb":921779,"num_write":21835,"num_write_kb":363496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6486,"internal_metadata":0},"log_size":19129,"ondisk_log_size":19129,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.88100000000000001},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.143,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94299999999999995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.875}]},{"osd":1,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.88600000000000001,"15min":0.92800000000000005},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1539999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.86599999999999999,"15min":0.91900000000000004},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2809999999999999,"5min":1.583,"15min":1.583},"last":1.0660000000000001}]},{"osd":2,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.073,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.008,"15min":1.036},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2070000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.048}]},{"osd":3,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.208,"5min":1.925,"15min":1.925},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.99099999999999999,"15min":1.0429999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.411,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.2949999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":1.071},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.282,"5min":3.488,"15min":3.488},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.89900000000000002,"15min":0.94199999999999995},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":2.512,"15min":2.512},"last":0.753}]},{"osd":5,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":1.071,"15min":1.1499999999999999},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3959999999999999,"5min":3.069,"15min":3.069},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.05,"15min":1.111},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:16:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.403,"5min":1.615,"15min":1.615},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.091,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6499999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.91500000000000004}]}]},{"osd":6,"up_from":61,"seq":261993005083,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34344,"kb_used_data":2012,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94337496,"statfs":{"total":96636764160,"available":96601595904,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.82299999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.052}]},{"osd":4,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.97899999999999998}]},{"osd":5,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.90300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55276,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316564,"statfs":{"total":96636764160,"available":96580161536,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.131,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.107}]},{"osd":1,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.103,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.82299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1220000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.502,"15min":1.502},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.216,"5min":1.804,"15min":1.804},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.80600000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.345,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85899999999999999,"15min":0.86899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3180000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.024}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4339999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.96299999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.97599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2649999999999999,"5min":1.879,"15min":1.879},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.377,"5min":1.742,"15min":1.742},"last":1.214}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59372,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312468,"statfs":{"total":96636764160,"available":96575967232,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.86499999999999999},"min":{"1min":0.434,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.23,"5min":2.827,"15min":2.827},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":1.0580000000000001}]},{"osd":1,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.48799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0109999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.087},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.88800000000000001,"15min":0.95299999999999996},"min":{"1min":0.47499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.028,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.034}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1859999999999999,"5min":1.365,"15min":1.365},"last":0.97499999999999998}]},{"osd":3,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.48799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1220000000000001,"5min":1.133,"15min":1.133},"last":1.004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.125,"5min":4.282,"15min":4.282},"last":0.90300000000000002}]},{"osd":5,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.50600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.123,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.621},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.38900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed Sep 18 05:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1519999999999999,"5min":1.381,"15min":1.381},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":1.0109999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.413,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77424,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94294416,"statfs":{"total":96636764160,"available":96557481984,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2649999999999999,"5min":1.276,"15min":1.276},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.024,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1579999999999999,"5min":1.379,"15min":1.379},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1459999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.93100000000000005},"min":{"1min":0.5,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90800000000000003,"15min":0.92200000000000004},"min":{"1min":0.71499999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.373,"15min":1.373},"last":0.86199999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.73999999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5740000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.052},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.304,"5min":2.722,"15min":2.722},"last":0.95899999999999996}]}]},{"osd":2,"up_from":123,"seq":528280977421,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30248,"kb_used_data":2012,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341592,"statfs":{"total":96636764160,"available":96605790208,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2068480,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.82299999999999995,"15min":0.72499999999999998},"min":{"1min":0.312,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.087,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0629999999999999,"5min":1.978,"15min":1.978},"last":0.65900000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.3879999999999999,"5min":0.85999999999999999,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":0.79100000000000004}]},{"osd":3,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.92900000000000005,"15min":0.84099999999999997},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3340000000000001,"5min":17.638999999999999,"15min":17.638999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.96899999999999997,"15min":0.82999999999999996},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1970000000000001,"5min":19.489999999999998,"15min":19.489999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.871,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.454,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.90700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0669999999999999,"5min":1.762,"15min":1.762},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.071},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":14.198,"15min":14.198},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.90500000000000003,"15min":0.88700000000000001},"min":{"1min":0.60099999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.874},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3819999999999999,"5min":1.446,"15min":1.446},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.1619999999999999,"15min":1.0940000000000001},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6659999999999999,"5min":14.234,"15min":14.234},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0049999999999999,"15min":1.022},"min":{"1min":0.69099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.496,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.77400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59436,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312404,"statfs":{"total":96636764160,"available":96575901696,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.226,"5min":1.829,"15min":1.829},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.4379999999999999,"5min":2.25,"15min":2.25},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1579999999999999,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84399999999999997,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3899999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.47599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.76300000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90300000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.278,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.877},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.579,"5min":1.911,"15min":1.911},"last":1.141}]},{"osd":6,"last update":"Wed Sep 18 05:16:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.095,"5min":0.90700000000000003,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.073}]},{"osd":7,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97999999999999998,"15min":1.012},"min":{"1min":0.622,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.546,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.054},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0569999999999999,"15min":1.0700000000000001},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4610000000000001,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.0029999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:16:48.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:16:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:16:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-18T05:16:48.604837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":362,"num_object_clones":0,"num_object_copies":724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":362,"num_whiteouts":354,"num_read":182735,"num_read_kb":921879,"num_write":21996,"num_write_kb":365914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19249,"ondisk_log_size":19249,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400476,"kb_used_data":16240,"kb_used_omap":29,"kb_used_meta":384098,"kb_avail":754574244,"statfs":{"total":773094113280,"available":772684025856,"internally_reserved":0,"allocated":16629760,"data_stored":9114916,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":29988,"internal_metadata":393317084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.516552"},"pg_stats":[{"pgid":"3.1f","version":"152'705","reported_seq":2818,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198942+0000","last_change":"2024-09-18T05:16:22.952279+0000","last_active":"2024-09-18T05:16:43.198942+0000","last_peered":"2024-09-18T05:16:43.198942+0000","last_clean":"2024-09-18T05:16:43.198942+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:16:43.198942+0000","last_undegraded":"2024-09-18T05:16:43.198942+0000","last_fullsized":"2024-09-18T05:16:43.198942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069029300000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4139,"num_read_kb":20195,"num_write":907,"num_write_kb":9329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"151'1446","reported_seq":6945,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101179+0000","last_change":"2024-09-18T05:16:22.950489+0000","last_active":"2024-09-18T05:16:43.101179+0000","last_peered":"2024-09-18T05:16:43.101179+0000","last_clean":"2024-09-18T05:16:43.101179+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:16:43.101179+0000","last_undegraded":"2024-09-18T05:16:43.101179+0000","last_fullsized":"2024-09-18T05:16:43.101179+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031115520000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":11552,"num_read_kb":29398,"num_write":2219,"num_write_kb":10724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"151'500","reported_seq":2613,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202135+0000","last_change":"2024-09-18T05:16:39.081650+0000","last_active":"2024-09-18T05:16:43.202135+0000","last_peered":"2024-09-18T05:16:43.202135+0000","last_clean":"2024-09-18T05:16:43.202135+0000","last_became_active":"2024-09-18T05:16:39.078161+0000","last_became_peered":"2024-09-18T05:16:39.078161+0000","last_unstale":"2024-09-18T05:16:43.202135+0000","last_undegraded":"2024-09-18T05:16:43.202135+0000","last_fullsized":"2024-09-18T05:16:43.202135+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:58.056260+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0077051680000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3418,"num_read_kb":20008,"num_write":499,"num_write_kb":11307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"152'957","reported_seq":4756,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201751+0000","last_change":"2024-09-18T05:16:39.081624+0000","last_active":"2024-09-18T05:16:43.201751+0000","last_peered":"2024-09-18T05:16:43.201751+0000","last_clean":"2024-09-18T05:16:43.201751+0000","last_became_active":"2024-09-18T05:16:39.078258+0000","last_became_peered":"2024-09-18T05:16:39.078258+0000","last_unstale":"2024-09-18T05:16:43.201751+0000","last_undegraded":"2024-09-18T05:16:43.201751+0000","last_fullsized":"2024-09-18T05:16:43.201751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:23.450501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078280600000000004,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":14,"num_read":7245,"num_read_kb":33079,"num_write":1238,"num_write_kb":14791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"151'402","reported_seq":2487,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199015+0000","last_change":"2024-09-18T05:16:22.954184+0000","last_active":"2024-09-18T05:16:43.199015+0000","last_peered":"2024-09-18T05:16:43.199015+0000","last_clean":"2024-09-18T05:16:43.199015+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:16:43.199015+0000","last_undegraded":"2024-09-18T05:16:43.199015+0000","last_fullsized":"2024-09-18T05:16:43.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074971399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2723,"num_read_kb":17099,"num_write":364,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"151'429","reported_seq":6379,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.103891+0000","last_change":"2024-09-18T05:16:22.967762+0000","last_active":"2024-09-18T05:16:43.103891+0000","last_peered":"2024-09-18T05:16:43.103891+0000","last_clean":"2024-09-18T05:16:43.103891+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:16:43.103891+0000","last_undegraded":"2024-09-18T05:16:43.103891+0000","last_fullsized":"2024-09-18T05:16:43.103891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071492300000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":5935,"num_read_kb":45781,"num_write":417,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"152'566","reported_seq":5849,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198800+0000","last_change":"2024-09-18T05:16:22.956775+0000","last_active":"2024-09-18T05:16:43.198800+0000","last_peered":"2024-09-18T05:16:43.198800+0000","last_clean":"2024-09-18T05:16:43.198800+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:16:43.198800+0000","last_undegraded":"2024-09-18T05:16:43.198800+0000","last_fullsized":"2024-09-18T05:16:43.198800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055068100000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8335,"num_read_kb":20827,"num_write":497,"num_write_kb":15047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"151'863","reported_seq":2720,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101173+0000","last_change":"2024-09-18T05:16:22.948825+0000","last_active":"2024-09-18T05:16:43.101173+0000","last_peered":"2024-09-18T05:16:43.101173+0000","last_clean":"2024-09-18T05:16:43.101173+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:16:43.101173+0000","last_undegraded":"2024-09-18T05:16:43.101173+0000","last_fullsized":"2024-09-18T05:16:43.101173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001816465,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4198,"num_read_kb":22346,"num_write":1180,"num_write_kb":9146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'583","reported_seq":7223,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199402+0000","last_change":"2024-09-18T05:16:22.953058+0000","last_active":"2024-09-18T05:16:43.199402+0000","last_peered":"2024-09-18T05:16:43.199402+0000","last_clean":"2024-09-18T05:16:43.199402+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:16:43.199402+0000","last_undegraded":"2024-09-18T05:16:43.199402+0000","last_fullsized":"2024-09-18T05:16:43.199402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012193429999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8338,"num_read_kb":33067,"num_write":470,"num_write_kb":10649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'656","reported_seq":8296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202132+0000","last_change":"2024-09-18T05:16:22.963058+0000","last_active":"2024-09-18T05:16:43.202132+0000","last_peered":"2024-09-18T05:16:43.202132+0000","last_clean":"2024-09-18T05:16:43.202132+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:16:43.202132+0000","last_undegraded":"2024-09-18T05:16:43.202132+0000","last_fullsized":"2024-09-18T05:16:43.202132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655983,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9449,"num_read_kb":47880,"num_write":679,"num_write_kb":15057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"151'746","reported_seq":6974,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202806+0000","last_change":"2024-09-18T05:16:22.947810+0000","last_active":"2024-09-18T05:16:43.202806+0000","last_peered":"2024-09-18T05:16:43.202806+0000","last_clean":"2024-09-18T05:16:43.202806+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:16:43.202806+0000","last_undegraded":"2024-09-18T05:16:43.202806+0000","last_fullsized":"2024-09-18T05:16:43.202806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013431739999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":8031,"num_read_kb":49145,"num_write":1033,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"151'399","reported_seq":2296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104237+0000","last_change":"2024-09-18T05:16:22.968983+0000","last_active":"2024-09-18T05:16:43.104237+0000","last_peered":"2024-09-18T05:16:43.104237+0000","last_clean":"2024-09-18T05:16:43.104237+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:16:43.104237+0000","last_undegraded":"2024-09-18T05:16:43.104237+0000","last_fullsized":"2024-09-18T05:16:43.104237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010340900000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":2061,"num_read_kb":19662,"num_write":411,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201271+0000","last_change":"2024-09-18T05:16:02.923317+0000","last_active":"2024-09-18T05:16:43.201271+0000","last_peered":"2024-09-18T05:16:43.201271+0000","last_clean":"2024-09-18T05:16:43.201271+0000","last_became_active":"2024-09-18T05:16:02.922394+0000","last_became_peered":"2024-09-18T05:16:02.922394+0000","last_unstale":"2024-09-18T05:16:43.201271+0000","last_undegraded":"2024-09-18T05:16:43.201271+0000","last_fullsized":"2024-09-18T05:16:43.201271+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:34.150689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"152'577","reported_seq":3709,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199283+0000","last_change":"2024-09-18T05:16:22.953341+0000","last_active":"2024-09-18T05:16:43.199283+0000","last_peered":"2024-09-18T05:16:43.199283+0000","last_clean":"2024-09-18T05:16:43.199283+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:16:43.199283+0000","last_undegraded":"2024-09-18T05:16:43.199283+0000","last_fullsized":"2024-09-18T05:16:43.199283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015023230000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":4591,"num_read_kb":29240,"num_write":682,"num_write_kb":13080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199016+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:16:43.199016+0000","last_peered":"2024-09-18T05:16:43.199016+0000","last_clean":"2024-09-18T05:16:43.199016+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:16:43.199016+0000","last_undegraded":"2024-09-18T05:16:43.199016+0000","last_fullsized":"2024-09-18T05:16:43.199016+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"152'533","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101657+0000","last_change":"2024-09-18T05:16:22.951905+0000","last_active":"2024-09-18T05:16:43.101657+0000","last_peered":"2024-09-18T05:16:43.101657+0000","last_clean":"2024-09-18T05:16:43.101657+0000","last_became_active":"2024-09-18T05:16:19.904499+0000","last_became_peered":"2024-09-18T05:16:19.904499+0000","last_unstale":"2024-09-18T05:16:43.101657+0000","last_undegraded":"2024-09-18T05:16:43.101657+0000","last_fullsized":"2024-09-18T05:16:43.101657+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:10:44.782963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00364015,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3679,"num_read_kb":33211,"num_write":613,"num_write_kb":10118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":7448296,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202988+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:16:43.202988+0000","last_peered":"2024-09-18T05:16:43.202988+0000","last_clean":"2024-09-18T05:16:43.202988+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:16:43.202988+0000","last_undegraded":"2024-09-18T05:16:43.202988+0000","last_fullsized":"2024-09-18T05:16:43.202988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"150'420","reported_seq":6024,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199233+0000","last_change":"2024-09-18T05:16:22.957252+0000","last_active":"2024-09-18T05:16:43.199233+0000","last_peered":"2024-09-18T05:16:43.199233+0000","last_clean":"2024-09-18T05:16:43.199233+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:16:43.199233+0000","last_undegraded":"2024-09-18T05:16:43.199233+0000","last_fullsized":"2024-09-18T05:16:43.199233+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:46.818280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060223399999999999,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":6557,"num_read_kb":27685,"num_write":436,"num_write_kb":9094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199291+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:16:43.199291+0000","last_peered":"2024-09-18T05:16:43.199291+0000","last_clean":"2024-09-18T05:16:43.199291+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:16:43.199291+0000","last_undegraded":"2024-09-18T05:16:43.199291+0000","last_fullsized":"2024-09-18T05:16:43.199291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"151'459","reported_seq":6025,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202438+0000","last_change":"2024-09-18T05:16:39.081593+0000","last_active":"2024-09-18T05:16:43.202438+0000","last_peered":"2024-09-18T05:16:43.202438+0000","last_clean":"2024-09-18T05:16:43.202438+0000","last_became_active":"2024-09-18T05:16:39.077813+0000","last_became_peered":"2024-09-18T05:16:39.077813+0000","last_unstale":"2024-09-18T05:16:43.202438+0000","last_undegraded":"2024-09-18T05:16:43.202438+0000","last_fullsized":"2024-09-18T05:16:43.202438+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:26:16.213994+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.032776543999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5840,"num_read_kb":39783,"num_write":450,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"152'1164","reported_seq":4989,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104129+0000","last_change":"2024-09-18T05:16:22.969058+0000","last_active":"2024-09-18T05:16:43.104129+0000","last_peered":"2024-09-18T05:16:43.104129+0000","last_clean":"2024-09-18T05:16:43.104129+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:16:43.104129+0000","last_undegraded":"2024-09-18T05:16:43.104129+0000","last_fullsized":"2024-09-18T05:16:43.104129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011154260000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":6871,"num_read_kb":44276,"num_write":1455,"num_write_kb":20060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":81,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201766+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201766+0000","last_peered":"2024-09-18T05:16:43.201766+0000","last_clean":"2024-09-18T05:16:43.201766+0000","last_became_active":"2024-09-18T05:16:39.076198+0000","last_became_peered":"2024-09-18T05:16:39.076198+0000","last_unstale":"2024-09-18T05:16:43.201766+0000","last_undegraded":"2024-09-18T05:16:43.201766+0000","last_fullsized":"2024-09-18T05:16:43.201766+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:48:58.557656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'438","reported_seq":4750,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198784+0000","last_change":"2024-09-18T05:16:22.956747+0000","last_active":"2024-09-18T05:16:43.198784+0000","last_peered":"2024-09-18T05:16:43.198784+0000","last_clean":"2024-09-18T05:16:43.198784+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:16:43.198784+0000","last_undegraded":"2024-09-18T05:16:43.198784+0000","last_fullsized":"2024-09-18T05:16:43.198784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:12.320367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037471100000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":4862,"num_read_kb":21776,"num_write":386,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.102497+0000","last_change":"2024-09-18T05:15:55.216600+0000","last_active":"2024-09-18T05:16:43.102497+0000","last_peered":"2024-09-18T05:16:43.102497+0000","last_clean":"2024-09-18T05:16:43.102497+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:16:43.102497+0000","last_undegraded":"2024-09-18T05:16:43.102497+0000","last_fullsized":"2024-09-18T05:16:43.102497+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:42:31.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"151'363","reported_seq":2476,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199170+0000","last_change":"2024-09-18T05:16:22.951266+0000","last_active":"2024-09-18T05:16:43.199170+0000","last_peered":"2024-09-18T05:16:43.199170+0000","last_clean":"2024-09-18T05:16:43.199170+0000","last_became_active":"2024-09-18T05:16:01.899154+0000","last_became_peered":"2024-09-18T05:16:01.899154+0000","last_unstale":"2024-09-18T05:16:43.199170+0000","last_undegraded":"2024-09-18T05:16:43.199170+0000","last_fullsized":"2024-09-18T05:16:43.199170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:00:29.357279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032123,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":2135,"num_read_kb":5505,"num_write":365,"num_write_kb":5251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":2091093,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202445+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:16:43.202445+0000","last_peered":"2024-09-18T05:16:43.202445+0000","last_clean":"2024-09-18T05:16:43.202445+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:16:43.202445+0000","last_undegraded":"2024-09-18T05:16:43.202445+0000","last_fullsized":"2024-09-18T05:16:43.202445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"151'596","reported_seq":5170,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198896+0000","last_change":"2024-09-18T05:16:22.957237+0000","last_active":"2024-09-18T05:16:43.198896+0000","last_peered":"2024-09-18T05:16:43.198896+0000","last_clean":"2024-09-18T05:16:43.198896+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:16:43.198896+0000","last_undegraded":"2024-09-18T05:16:43.198896+0000","last_fullsized":"2024-09-18T05:16:43.198896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:22:34.025479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083719899999999995,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7500,"num_read_kb":38768,"num_write":572,"num_write_kb":10748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":106,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201713+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201713+0000","last_peered":"2024-09-18T05:16:43.201713+0000","last_clean":"2024-09-18T05:16:43.201713+0000","last_became_active":"2024-09-18T05:16:39.075931+0000","last_became_peered":"2024-09-18T05:16:39.075931+0000","last_unstale":"2024-09-18T05:16:43.201713+0000","last_undegraded":"2024-09-18T05:16:43.201713+0000","last_fullsized":"2024-09-18T05:16:43.201713+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:06.991206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202783+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:16:43.202783+0000","last_peered":"2024-09-18T05:16:43.202783+0000","last_clean":"2024-09-18T05:16:43.202783+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:16:43.202783+0000","last_undegraded":"2024-09-18T05:16:43.202783+0000","last_fullsized":"2024-09-18T05:16:43.202783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"152'426","reported_seq":5316,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.100966+0000","last_change":"2024-09-18T05:16:22.948527+0000","last_active":"2024-09-18T05:16:43.100966+0000","last_peered":"2024-09-18T05:16:43.100966+0000","last_clean":"2024-09-18T05:16:43.100966+0000","last_became_active":"2024-09-18T05:16:01.898482+0000","last_became_peered":"2024-09-18T05:16:01.898482+0000","last_unstale":"2024-09-18T05:16:43.100966+0000","last_undegraded":"2024-09-18T05:16:43.100966+0000","last_fullsized":"2024-09-18T05:16:43.100966+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:22.456629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015649310000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6584,"num_read_kb":42729,"num_write":374,"num_write_kb":15931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":15236017,"num_keys_recovered":42,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"151'296","reported_seq":4172,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104036+0000","last_change":"2024-09-18T05:16:22.967630+0000","last_active":"2024-09-18T05:16:43.104036+0000","last_peered":"2024-09-18T05:16:43.104036+0000","last_clean":"2024-09-18T05:16:43.104036+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:16:43.104036+0000","last_undegraded":"2024-09-18T05:16:43.104036+0000","last_fullsized":"2024-09-18T05:16:43.104036+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:06:43.114897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062945099999999995,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3697,"num_read_kb":33449,"num_write":292,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"151'633","reported_seq":2727,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201314+0000","last_change":"2024-09-18T05:16:22.966505+0000","last_active":"2024-09-18T05:16:43.201314+0000","last_peered":"2024-09-18T05:16:43.201314+0000","last_clean":"2024-09-18T05:16:43.201314+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:16:43.201314+0000","last_undegraded":"2024-09-18T05:16:43.201314+0000","last_fullsized":"2024-09-18T05:16:43.201314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000499841,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":3587,"num_read_kb":18383,"num_write":752,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"151'299","reported_seq":3368,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101410+0000","last_change":"2024-09-18T05:16:22.949763+0000","last_active":"2024-09-18T05:16:43.101410+0000","last_peered":"2024-09-18T05:16:43.101410+0000","last_clean":"2024-09-18T05:16:43.101410+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:16:43.101410+0000","last_undegraded":"2024-09-18T05:16:43.101410+0000","last_fullsized":"2024-09-18T05:16:43.101410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002578814,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":2832,"num_read_kb":19521,"num_write":259,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"151'471","reported_seq":5189,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202050+0000","last_change":"2024-09-18T05:16:39.081596+0000","last_active":"2024-09-18T05:16:43.202050+0000","last_peered":"2024-09-18T05:16:43.202050+0000","last_clean":"2024-09-18T05:16:43.202050+0000","last_became_active":"2024-09-18T05:16:39.077761+0000","last_became_peered":"2024-09-18T05:16:39.077761+0000","last_unstale":"2024-09-18T05:16:43.202050+0000","last_undegraded":"2024-09-18T05:16:43.202050+0000","last_fullsized":"2024-09-18T05:16:43.202050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:52.136023+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017471631000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5191,"num_read_kb":29963,"num_write":520,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'416","reported_seq":3721,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202864+0000","last_change":"2024-09-18T05:16:22.947578+0000","last_active":"2024-09-18T05:16:43.202864+0000","last_peered":"2024-09-18T05:16:43.202864+0000","last_clean":"2024-09-18T05:16:43.202864+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:16:43.202864+0000","last_undegraded":"2024-09-18T05:16:43.202864+0000","last_fullsized":"2024-09-18T05:16:43.202864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318949999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4121,"num_read_kb":17361,"num_write":391,"num_write_kb":13003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"151'602","reported_seq":5933,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.203158+0000","last_change":"2024-09-18T05:16:22.948118+0000","last_active":"2024-09-18T05:16:43.203158+0000","last_peered":"2024-09-18T05:16:43.203158+0000","last_clean":"2024-09-18T05:16:43.203158+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:16:43.203158+0000","last_undegraded":"2024-09-18T05:16:43.203158+0000","last_fullsized":"2024-09-18T05:16:43.203158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001596606,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":6945,"num_read_kb":34740,"num_write":596,"num_write_kb":4823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"151'555","reported_seq":9087,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101442+0000","last_change":"2024-09-18T05:16:22.950996+0000","last_active":"2024-09-18T05:16:43.101442+0000","last_peered":"2024-09-18T05:16:43.101442+0000","last_clean":"2024-09-18T05:16:43.101442+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:16:43.101442+0000","last_undegraded":"2024-09-18T05:16:43.101442+0000","last_fullsized":"2024-09-18T05:16:43.101442+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031437349999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9783,"num_read_kb":40662,"num_write":558,"num_write_kb":18337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"150'666","reported_seq":4026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201139+0000","last_change":"2024-09-18T05:16:22.966612+0000","last_active":"2024-09-18T05:16:43.201139+0000","last_peered":"2024-09-18T05:16:43.201139+0000","last_clean":"2024-09-18T05:16:43.201139+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:16:43.201139+0000","last_undegraded":"2024-09-18T05:16:43.201139+0000","last_fullsized":"2024-09-18T05:16:43.201139+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056430399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":7033,"num_read_kb":30921,"num_write":767,"num_write_kb":9608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'442","reported_seq":3800,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202498+0000","last_change":"2024-09-18T05:16:22.946942+0000","last_active":"2024-09-18T05:16:43.202498+0000","last_peered":"2024-09-18T05:16:43.202498+0000","last_clean":"2024-09-18T05:16:43.202498+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:16:43.202498+0000","last_undegraded":"2024-09-18T05:16:43.202498+0000","last_fullsized":"2024-09-18T05:16:43.202498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084174599999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":4545,"num_read_kb":16351,"num_write":465,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"150'667","reported_seq":3026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199197+0000","last_change":"2024-09-18T05:16:22.951854+0000","last_active":"2024-09-18T05:16:43.199197+0000","last_peered":"2024-09-18T05:16:43.199197+0000","last_clean":"2024-09-18T05:16:43.199197+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:16:43.199197+0000","last_undegraded":"2024-09-18T05:16:43.199197+0000","last_fullsized":"2024-09-18T05:16:43.199197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001575814,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":5022,"num_read_kb":16163,"num_write":742,"num_write_kb":7893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"151'854","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202677+0000","last_change":"2024-09-18T05:16:22.946967+0000","last_active":"2024-09-18T05:16:43.202677+0000","last_peered":"2024-09-18T05:16:43.202677+0000","last_clean":"2024-09-18T05:16:43.202677+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:16:43.202677+0000","last_undegraded":"2024-09-18T05:16:43.202677+0000","last_fullsized":"2024-09-18T05:16:43.202677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078209799999999995,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":5820,"num_read_kb":22805,"num_write":1246,"num_write_kb":8989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":358,"num_object_clones":0,"num_object_copies":716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":354,"num_read":182619,"num_read_kb":921779,"num_write":21835,"num_write_kb":363496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6486,"internal_metadata":0},"log_size":19129,"ondisk_log_size":19129,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.88100000000000001},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.143,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94299999999999995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.875}]},{"osd":1,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.88600000000000001,"15min":0.92800000000000005},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1539999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.86599999999999999,"15min":0.91900000000000004},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2809999999999999,"5min":1.583,"15min":1.583},"last":1.0660000000000001}]},{"osd":2,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.073,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.008,"15min":1.036},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2070000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.048}]},{"osd":3,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.208,"5min":1.925,"15min":1.925},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.99099999999999999,"15min":1.0429999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.411,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.2949999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":1.071},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.282,"5min":3.488,"15min":3.488},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.89900000000000002,"15min":0.94199999999999995},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":2.512,"15min":2.512},"last":0.753}]},{"osd":5,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":1.071,"15min":1.1499999999999999},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3959999999999999,"5min":3.069,"15min":3.069},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.05,"15min":1.111},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:16:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.403,"5min":1.615,"15min":1.615},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.091,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6499999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.91500000000000004}]}]},{"osd":6,"up_from":61,"seq":261993005083,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34344,"kb_used_data":2012,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94337496,"statfs":{"total":96636764160,"available":96601595904,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.82299999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.052}]},{"osd":4,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.97899999999999998}]},{"osd":5,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.90300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55276,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316564,"statfs":{"total":96636764160,"available":96580161536,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.131,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.107}]},{"osd":1,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.103,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.82299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1220000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.502,"15min":1.502},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.216,"5min":1.804,"15min":1.804},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.80600000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.345,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85899999999999999,"15min":0.86899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3180000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.024}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4339999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.96299999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.97599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2649999999999999,"5min":1.879,"15min":1.879},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.377,"5min":1.742,"15min":1.742},"last":1.214}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59372,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312468,"statfs":{"total":96636764160,"available":96575967232,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.86499999999999999},"min":{"1min":0.434,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.23,"5min":2.827,"15min":2.827},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":1.0580000000000001}]},{"osd":1,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.48799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0109999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.087},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.88800000000000001,"15min":0.95299999999999996},"min":{"1min":0.47499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.028,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.034}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1859999999999999,"5min":1.365,"15min":1.365},"last":0.97499999999999998}]},{"osd":3,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.48799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1220000000000001,"5min":1.133,"15min":1.133},"last":1.004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.125,"5min":4.282,"15min":4.282},"last":0.90300000000000002}]},{"osd":5,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.50600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.123,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.621},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.38900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed Sep 18 05:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1519999999999999,"5min":1.381,"15min":1.381},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":1.0109999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.413,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77424,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94294416,"statfs":{"total":96636764160,"available":96557481984,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2649999999999999,"5min":1.276,"15min":1.276},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.024,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1579999999999999,"5min":1.379,"15min":1.379},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1459999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.93100000000000005},"min":{"1min":0.5,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90800000000000003,"15min":0.92200000000000004},"min":{"1min":0.71499999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.373,"15min":1.373},"last":0.86199999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.73999999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5740000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.052},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.304,"5min":2.722,"15min":2.722},"last":0.95899999999999996}]}]},{"osd":2,"up_from":123,"seq":528280977421,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30248,"kb_used_data":2012,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341592,"statfs":{"total":96636764160,"available":96605790208,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2068480,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.82299999999999995,"15min":0.72499999999999998},"min":{"1min":0.312,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.087,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0629999999999999,"5min":1.978,"15min":1.978},"last":0.65900000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.3879999999999999,"5min":0.85999999999999999,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":0.79100000000000004}]},{"osd":3,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.92900000000000005,"15min":0.84099999999999997},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3340000000000001,"5min":17.638999999999999,"15min":17.638999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.96899999999999997,"15min":0.82999999999999996},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1970000000000001,"5min":19.489999999999998,"15min":19.489999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.871,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.454,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.90700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0669999999999999,"5min":1.762,"15min":1.762},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.071},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":14.198,"15min":14.198},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.90500000000000003,"15min":0.88700000000000001},"min":{"1min":0.60099999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.874},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3819999999999999,"5min":1.446,"15min":1.446},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.1619999999999999,"15min":1.0940000000000001},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6659999999999999,"5min":14.234,"15min":14.234},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0049999999999999,"15min":1.022},"min":{"1min":0.69099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.496,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.77400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59436,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312404,"statfs":{"total":96636764160,"available":96575901696,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.226,"5min":1.829,"15min":1.829},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.4379999999999999,"5min":2.25,"15min":2.25},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1579999999999999,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84399999999999997,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3899999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.47599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.76300000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90300000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.278,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.877},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.579,"5min":1.911,"15min":1.911},"last":1.141}]},{"osd":6,"last update":"Wed Sep 18 05:16:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.095,"5min":0.90700000000000003,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.073}]},{"osd":7,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97999999999999998,"15min":1.012},"min":{"1min":0.622,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.546,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.054},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0569999999999999,"15min":1.0700000000000001},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4610000000000001,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.0029999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:16:49.135 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-18T05:16:49.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-18T05:16:49.447 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-18T05:16:49.455 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T05:16:49.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:16:49.753 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:49.754 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:16:49.771 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-18T05:16:48.604837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":362,"num_object_clones":0,"num_object_copies":724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":362,"num_whiteouts":354,"num_read":182735,"num_read_kb":921879,"num_write":21996,"num_write_kb":365914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19249,"ondisk_log_size":19249,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400476,"kb_used_data":16240,"kb_used_omap":29,"kb_used_meta":384098,"kb_avail":754574244,"statfs":{"total":773094113280,"available":772684025856,"internally_reserved":0,"allocated":16629760,"data_stored":9114916,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":29988,"internal_metadata":393317084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.516552"},"pg_stats":[{"pgid":"3.1f","version":"152'705","reported_seq":2818,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198942+0000","last_change":"2024-09-18T05:16:22.952279+0000","last_active":"2024-09-18T05:16:43.198942+0000","last_peered":"2024-09-18T05:16:43.198942+0000","last_clean":"2024-09-18T05:16:43.198942+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:16:43.198942+0000","last_undegraded":"2024-09-18T05:16:43.198942+0000","last_fullsized":"2024-09-18T05:16:43.198942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069029300000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4139,"num_read_kb":20195,"num_write":907,"num_write_kb":9329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"151'1446","reported_seq":6945,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101179+0000","last_change":"2024-09-18T05:16:22.950489+0000","last_active":"2024-09-18T05:16:43.101179+0000","last_peered":"2024-09-18T05:16:43.101179+0000","last_clean":"2024-09-18T05:16:43.101179+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:16:43.101179+0000","last_undegraded":"2024-09-18T05:16:43.101179+0000","last_fullsized":"2024-09-18T05:16:43.101179+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031115520000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":11552,"num_read_kb":29398,"num_write":2219,"num_write_kb":10724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"151'500","reported_seq":2613,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202135+0000","last_change":"2024-09-18T05:16:39.081650+0000","last_active":"2024-09-18T05:16:43.202135+0000","last_peered":"2024-09-18T05:16:43.202135+0000","last_clean":"2024-09-18T05:16:43.202135+0000","last_became_active":"2024-09-18T05:16:39.078161+0000","last_became_peered":"2024-09-18T05:16:39.078161+0000","last_unstale":"2024-09-18T05:16:43.202135+0000","last_undegraded":"2024-09-18T05:16:43.202135+0000","last_fullsized":"2024-09-18T05:16:43.202135+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:58.056260+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0077051680000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3418,"num_read_kb":20008,"num_write":499,"num_write_kb":11307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"152'957","reported_seq":4756,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201751+0000","last_change":"2024-09-18T05:16:39.081624+0000","last_active":"2024-09-18T05:16:43.201751+0000","last_peered":"2024-09-18T05:16:43.201751+0000","last_clean":"2024-09-18T05:16:43.201751+0000","last_became_active":"2024-09-18T05:16:39.078258+0000","last_became_peered":"2024-09-18T05:16:39.078258+0000","last_unstale":"2024-09-18T05:16:43.201751+0000","last_undegraded":"2024-09-18T05:16:43.201751+0000","last_fullsized":"2024-09-18T05:16:43.201751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:23.450501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078280600000000004,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":14,"num_read":7245,"num_read_kb":33079,"num_write":1238,"num_write_kb":14791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"151'402","reported_seq":2487,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199015+0000","last_change":"2024-09-18T05:16:22.954184+0000","last_active":"2024-09-18T05:16:43.199015+0000","last_peered":"2024-09-18T05:16:43.199015+0000","last_clean":"2024-09-18T05:16:43.199015+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:16:43.199015+0000","last_undegraded":"2024-09-18T05:16:43.199015+0000","last_fullsized":"2024-09-18T05:16:43.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074971399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2723,"num_read_kb":17099,"num_write":364,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"151'429","reported_seq":6379,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.103891+0000","last_change":"2024-09-18T05:16:22.967762+0000","last_active":"2024-09-18T05:16:43.103891+0000","last_peered":"2024-09-18T05:16:43.103891+0000","last_clean":"2024-09-18T05:16:43.103891+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:16:43.103891+0000","last_undegraded":"2024-09-18T05:16:43.103891+0000","last_fullsized":"2024-09-18T05:16:43.103891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071492300000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":5935,"num_read_kb":45781,"num_write":417,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"152'566","reported_seq":5849,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198800+0000","last_change":"2024-09-18T05:16:22.956775+0000","last_active":"2024-09-18T05:16:43.198800+0000","last_peered":"2024-09-18T05:16:43.198800+0000","last_clean":"2024-09-18T05:16:43.198800+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:16:43.198800+0000","last_undegraded":"2024-09-18T05:16:43.198800+0000","last_fullsized":"2024-09-18T05:16:43.198800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055068100000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8335,"num_read_kb":20827,"num_write":497,"num_write_kb":15047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"151'863","reported_seq":2720,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101173+0000","last_change":"2024-09-18T05:16:22.948825+0000","last_active":"2024-09-18T05:16:43.101173+0000","last_peered":"2024-09-18T05:16:43.101173+0000","last_clean":"2024-09-18T05:16:43.101173+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:16:43.101173+0000","last_undegraded":"2024-09-18T05:16:43.101173+0000","last_fullsized":"2024-09-18T05:16:43.101173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001816465,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4198,"num_read_kb":22346,"num_write":1180,"num_write_kb":9146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'583","reported_seq":7223,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199402+0000","last_change":"2024-09-18T05:16:22.953058+0000","last_active":"2024-09-18T05:16:43.199402+0000","last_peered":"2024-09-18T05:16:43.199402+0000","last_clean":"2024-09-18T05:16:43.199402+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:16:43.199402+0000","last_undegraded":"2024-09-18T05:16:43.199402+0000","last_fullsized":"2024-09-18T05:16:43.199402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012193429999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8338,"num_read_kb":33067,"num_write":470,"num_write_kb":10649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'656","reported_seq":8296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202132+0000","last_change":"2024-09-18T05:16:22.963058+0000","last_active":"2024-09-18T05:16:43.202132+0000","last_peered":"2024-09-18T05:16:43.202132+0000","last_clean":"2024-09-18T05:16:43.202132+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:16:43.202132+0000","last_undegraded":"2024-09-18T05:16:43.202132+0000","last_fullsized":"2024-09-18T05:16:43.202132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655983,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9449,"num_read_kb":47880,"num_write":679,"num_write_kb":15057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"151'746","reported_seq":6974,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202806+0000","last_change":"2024-09-18T05:16:22.947810+0000","last_active":"2024-09-18T05:16:43.202806+0000","last_peered":"2024-09-18T05:16:43.202806+0000","last_clean":"2024-09-18T05:16:43.202806+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:16:43.202806+0000","last_undegraded":"2024-09-18T05:16:43.202806+0000","last_fullsized":"2024-09-18T05:16:43.202806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013431739999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":8031,"num_read_kb":49145,"num_write":1033,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"151'399","reported_seq":2296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104237+0000","last_change":"2024-09-18T05:16:22.968983+0000","last_active":"2024-09-18T05:16:43.104237+0000","last_peered":"2024-09-18T05:16:43.104237+0000","last_clean":"2024-09-18T05:16:43.104237+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:16:43.104237+0000","last_undegraded":"2024-09-18T05:16:43.104237+0000","last_fullsized":"2024-09-18T05:16:43.104237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010340900000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":2061,"num_read_kb":19662,"num_write":411,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201271+0000","last_change":"2024-09-18T05:16:02.923317+0000","last_active":"2024-09-18T05:16:43.201271+0000","last_peered":"2024-09-18T05:16:43.201271+0000","last_clean":"2024-09-18T05:16:43.201271+0000","last_became_active":"2024-09-18T05:16:02.922394+0000","last_became_peered":"2024-09-18T05:16:02.922394+0000","last_unstale":"2024-09-18T05:16:43.201271+0000","last_undegraded":"2024-09-18T05:16:43.201271+0000","last_fullsized":"2024-09-18T05:16:43.201271+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:34.150689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"152'577","reported_seq":3709,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199283+0000","last_change":"2024-09-18T05:16:22.953341+0000","last_active":"2024-09-18T05:16:43.199283+0000","last_peered":"2024-09-18T05:16:43.199283+0000","last_clean":"2024-09-18T05:16:43.199283+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:16:43.199283+0000","last_undegraded":"2024-09-18T05:16:43.199283+0000","last_fullsized":"2024-09-18T05:16:43.199283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015023230000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":4591,"num_read_kb":29240,"num_write":682,"num_write_kb":13080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199016+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:16:43.199016+0000","last_peered":"2024-09-18T05:16:43.199016+0000","last_clean":"2024-09-18T05:16:43.199016+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:16:43.199016+0000","last_undegraded":"2024-09-18T05:16:43.199016+0000","last_fullsized":"2024-09-18T05:16:43.199016+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"152'533","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101657+0000","last_change":"2024-09-18T05:16:22.951905+0000","last_active":"2024-09-18T05:16:43.101657+0000","last_peered":"2024-09-18T05:16:43.101657+0000","last_clean":"2024-09-18T05:16:43.101657+0000","last_became_active":"2024-09-18T05:16:19.904499+0000","last_became_peered":"2024-09-18T05:16:19.904499+0000","last_unstale":"2024-09-18T05:16:43.101657+0000","last_undegraded":"2024-09-18T05:16:43.101657+0000","last_fullsized":"2024-09-18T05:16:43.101657+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:10:44.782963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00364015,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3679,"num_read_kb":33211,"num_write":613,"num_write_kb":10118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":7448296,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202988+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:16:43.202988+0000","last_peered":"2024-09-18T05:16:43.202988+0000","last_clean":"2024-09-18T05:16:43.202988+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:16:43.202988+0000","last_undegraded":"2024-09-18T05:16:43.202988+0000","last_fullsized":"2024-09-18T05:16:43.202988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"150'420","reported_seq":6024,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199233+0000","last_change":"2024-09-18T05:16:22.957252+0000","last_active":"2024-09-18T05:16:43.199233+0000","last_peered":"2024-09-18T05:16:43.199233+0000","last_clean":"2024-09-18T05:16:43.199233+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:16:43.199233+0000","last_undegraded":"2024-09-18T05:16:43.199233+0000","last_fullsized":"2024-09-18T05:16:43.199233+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:46.818280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060223399999999999,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":6557,"num_read_kb":27685,"num_write":436,"num_write_kb":9094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199291+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:16:43.199291+0000","last_peered":"2024-09-18T05:16:43.199291+0000","last_clean":"2024-09-18T05:16:43.199291+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:16:43.199291+0000","last_undegraded":"2024-09-18T05:16:43.199291+0000","last_fullsized":"2024-09-18T05:16:43.199291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"151'459","reported_seq":6025,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202438+0000","last_change":"2024-09-18T05:16:39.081593+0000","last_active":"2024-09-18T05:16:43.202438+0000","last_peered":"2024-09-18T05:16:43.202438+0000","last_clean":"2024-09-18T05:16:43.202438+0000","last_became_active":"2024-09-18T05:16:39.077813+0000","last_became_peered":"2024-09-18T05:16:39.077813+0000","last_unstale":"2024-09-18T05:16:43.202438+0000","last_undegraded":"2024-09-18T05:16:43.202438+0000","last_fullsized":"2024-09-18T05:16:43.202438+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:26:16.213994+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.032776543999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5840,"num_read_kb":39783,"num_write":450,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"152'1164","reported_seq":4989,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104129+0000","last_change":"2024-09-18T05:16:22.969058+0000","last_active":"2024-09-18T05:16:43.104129+0000","last_peered":"2024-09-18T05:16:43.104129+0000","last_clean":"2024-09-18T05:16:43.104129+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:16:43.104129+0000","last_undegraded":"2024-09-18T05:16:43.104129+0000","last_fullsized":"2024-09-18T05:16:43.104129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011154260000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":6871,"num_read_kb":44276,"num_write":1455,"num_write_kb":20060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":81,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201766+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201766+0000","last_peered":"2024-09-18T05:16:43.201766+0000","last_clean":"2024-09-18T05:16:43.201766+0000","last_became_active":"2024-09-18T05:16:39.076198+0000","last_became_peered":"2024-09-18T05:16:39.076198+0000","last_unstale":"2024-09-18T05:16:43.201766+0000","last_undegraded":"2024-09-18T05:16:43.201766+0000","last_fullsized":"2024-09-18T05:16:43.201766+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:48:58.557656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'438","reported_seq":4750,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198784+0000","last_change":"2024-09-18T05:16:22.956747+0000","last_active":"2024-09-18T05:16:43.198784+0000","last_peered":"2024-09-18T05:16:43.198784+0000","last_clean":"2024-09-18T05:16:43.198784+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:16:43.198784+0000","last_undegraded":"2024-09-18T05:16:43.198784+0000","last_fullsized":"2024-09-18T05:16:43.198784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:12.320367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037471100000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":4862,"num_read_kb":21776,"num_write":386,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.102497+0000","last_change":"2024-09-18T05:15:55.216600+0000","last_active":"2024-09-18T05:16:43.102497+0000","last_peered":"2024-09-18T05:16:43.102497+0000","last_clean":"2024-09-18T05:16:43.102497+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:16:43.102497+0000","last_undegraded":"2024-09-18T05:16:43.102497+0000","last_fullsized":"2024-09-18T05:16:43.102497+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:42:31.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"151'363","reported_seq":2476,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199170+0000","last_change":"2024-09-18T05:16:22.951266+0000","last_active":"2024-09-18T05:16:43.199170+0000","last_peered":"2024-09-18T05:16:43.199170+0000","last_clean":"2024-09-18T05:16:43.199170+0000","last_became_active":"2024-09-18T05:16:01.899154+0000","last_became_peered":"2024-09-18T05:16:01.899154+0000","last_unstale":"2024-09-18T05:16:43.199170+0000","last_undegraded":"2024-09-18T05:16:43.199170+0000","last_fullsized":"2024-09-18T05:16:43.199170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:00:29.357279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032123,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":2135,"num_read_kb":5505,"num_write":365,"num_write_kb":5251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":2091093,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202445+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:16:43.202445+0000","last_peered":"2024-09-18T05:16:43.202445+0000","last_clean":"2024-09-18T05:16:43.202445+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:16:43.202445+0000","last_undegraded":"2024-09-18T05:16:43.202445+0000","last_fullsized":"2024-09-18T05:16:43.202445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"151'596","reported_seq":5170,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198896+0000","last_change":"2024-09-18T05:16:22.957237+0000","last_active":"2024-09-18T05:16:43.198896+0000","last_peered":"2024-09-18T05:16:43.198896+0000","last_clean":"2024-09-18T05:16:43.198896+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:16:43.198896+0000","last_undegraded":"2024-09-18T05:16:43.198896+0000","last_fullsized":"2024-09-18T05:16:43.198896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:22:34.025479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083719899999999995,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7500,"num_read_kb":38768,"num_write":572,"num_write_kb":10748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":106,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201713+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201713+0000","last_peered":"2024-09-18T05:16:43.201713+0000","last_clean":"2024-09-18T05:16:43.201713+0000","last_became_active":"2024-09-18T05:16:39.075931+0000","last_became_peered":"2024-09-18T05:16:39.075931+0000","last_unstale":"2024-09-18T05:16:43.201713+0000","last_undegraded":"2024-09-18T05:16:43.201713+0000","last_fullsized":"2024-09-18T05:16:43.201713+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:06.991206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202783+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:16:43.202783+0000","last_peered":"2024-09-18T05:16:43.202783+0000","last_clean":"2024-09-18T05:16:43.202783+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:16:43.202783+0000","last_undegraded":"2024-09-18T05:16:43.202783+0000","last_fullsized":"2024-09-18T05:16:43.202783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"152'426","reported_seq":5316,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.100966+0000","last_change":"2024-09-18T05:16:22.948527+0000","last_active":"2024-09-18T05:16:43.100966+0000","last_peered":"2024-09-18T05:16:43.100966+0000","last_clean":"2024-09-18T05:16:43.100966+0000","last_became_active":"2024-09-18T05:16:01.898482+0000","last_became_peered":"2024-09-18T05:16:01.898482+0000","last_unstale":"2024-09-18T05:16:43.100966+0000","last_undegraded":"2024-09-18T05:16:43.100966+0000","last_fullsized":"2024-09-18T05:16:43.100966+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:22.456629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015649310000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6584,"num_read_kb":42729,"num_write":374,"num_write_kb":15931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":15236017,"num_keys_recovered":42,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"151'296","reported_seq":4172,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104036+0000","last_change":"2024-09-18T05:16:22.967630+0000","last_active":"2024-09-18T05:16:43.104036+0000","last_peered":"2024-09-18T05:16:43.104036+0000","last_clean":"2024-09-18T05:16:43.104036+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:16:43.104036+0000","last_undegraded":"2024-09-18T05:16:43.104036+0000","last_fullsized":"2024-09-18T05:16:43.104036+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:06:43.114897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062945099999999995,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3697,"num_read_kb":33449,"num_write":292,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"151'633","reported_seq":2727,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201314+0000","last_change":"2024-09-18T05:16:22.966505+0000","last_active":"2024-09-18T05:16:43.201314+0000","last_peered":"2024-09-18T05:16:43.201314+0000","last_clean":"2024-09-18T05:16:43.201314+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:16:43.201314+0000","last_undegraded":"2024-09-18T05:16:43.201314+0000","last_fullsized":"2024-09-18T05:16:43.201314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000499841,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":3587,"num_read_kb":18383,"num_write":752,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"151'299","reported_seq":3368,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101410+0000","last_change":"2024-09-18T05:16:22.949763+0000","last_active":"2024-09-18T05:16:43.101410+0000","last_peered":"2024-09-18T05:16:43.101410+0000","last_clean":"2024-09-18T05:16:43.101410+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:16:43.101410+0000","last_undegraded":"2024-09-18T05:16:43.101410+0000","last_fullsized":"2024-09-18T05:16:43.101410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002578814,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":2832,"num_read_kb":19521,"num_write":259,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"151'471","reported_seq":5189,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202050+0000","last_change":"2024-09-18T05:16:39.081596+0000","last_active":"2024-09-18T05:16:43.202050+0000","last_peered":"2024-09-18T05:16:43.202050+0000","last_clean":"2024-09-18T05:16:43.202050+0000","last_became_active":"2024-09-18T05:16:39.077761+0000","last_became_peered":"2024-09-18T05:16:39.077761+0000","last_unstale":"2024-09-18T05:16:43.202050+0000","last_undegraded":"2024-09-18T05:16:43.202050+0000","last_fullsized":"2024-09-18T05:16:43.202050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:52.136023+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017471631000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5191,"num_read_kb":29963,"num_write":520,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'416","reported_seq":3721,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202864+0000","last_change":"2024-09-18T05:16:22.947578+0000","last_active":"2024-09-18T05:16:43.202864+0000","last_peered":"2024-09-18T05:16:43.202864+0000","last_clean":"2024-09-18T05:16:43.202864+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:16:43.202864+0000","last_undegraded":"2024-09-18T05:16:43.202864+0000","last_fullsized":"2024-09-18T05:16:43.202864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318949999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4121,"num_read_kb":17361,"num_write":391,"num_write_kb":13003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"151'602","reported_seq":5933,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.203158+0000","last_change":"2024-09-18T05:16:22.948118+0000","last_active":"2024-09-18T05:16:43.203158+0000","last_peered":"2024-09-18T05:16:43.203158+0000","last_clean":"2024-09-18T05:16:43.203158+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:16:43.203158+0000","last_undegraded":"2024-09-18T05:16:43.203158+0000","last_fullsized":"2024-09-18T05:16:43.203158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001596606,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":6945,"num_read_kb":34740,"num_write":596,"num_write_kb":4823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"151'555","reported_seq":9087,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101442+0000","last_change":"2024-09-18T05:16:22.950996+0000","last_active":"2024-09-18T05:16:43.101442+0000","last_peered":"2024-09-18T05:16:43.101442+0000","last_clean":"2024-09-18T05:16:43.101442+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:16:43.101442+0000","last_undegraded":"2024-09-18T05:16:43.101442+0000","last_fullsized":"2024-09-18T05:16:43.101442+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031437349999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9783,"num_read_kb":40662,"num_write":558,"num_write_kb":18337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"150'666","reported_seq":4026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201139+0000","last_change":"2024-09-18T05:16:22.966612+0000","last_active":"2024-09-18T05:16:43.201139+0000","last_peered":"2024-09-18T05:16:43.201139+0000","last_clean":"2024-09-18T05:16:43.201139+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:16:43.201139+0000","last_undegraded":"2024-09-18T05:16:43.201139+0000","last_fullsized":"2024-09-18T05:16:43.201139+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056430399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":7033,"num_read_kb":30921,"num_write":767,"num_write_kb":9608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'442","reported_seq":3800,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202498+0000","last_change":"2024-09-18T05:16:22.946942+0000","last_active":"2024-09-18T05:16:43.202498+0000","last_peered":"2024-09-18T05:16:43.202498+0000","last_clean":"2024-09-18T05:16:43.202498+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:16:43.202498+0000","last_undegraded":"2024-09-18T05:16:43.202498+0000","last_fullsized":"2024-09-18T05:16:43.202498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084174599999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":4545,"num_read_kb":16351,"num_write":465,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"150'667","reported_seq":3026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199197+0000","last_change":"2024-09-18T05:16:22.951854+0000","last_active":"2024-09-18T05:16:43.199197+0000","last_peered":"2024-09-18T05:16:43.199197+0000","last_clean":"2024-09-18T05:16:43.199197+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:16:43.199197+0000","last_undegraded":"2024-09-18T05:16:43.199197+0000","last_fullsized":"2024-09-18T05:16:43.199197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001575814,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":5022,"num_read_kb":16163,"num_write":742,"num_write_kb":7893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"151'854","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202677+0000","last_change":"2024-09-18T05:16:22.946967+0000","last_active":"2024-09-18T05:16:43.202677+0000","last_peered":"2024-09-18T05:16:43.202677+0000","last_clean":"2024-09-18T05:16:43.202677+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:16:43.202677+0000","last_undegraded":"2024-09-18T05:16:43.202677+0000","last_fullsized":"2024-09-18T05:16:43.202677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078209799999999995,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":5820,"num_read_kb":22805,"num_write":1246,"num_write_kb":8989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":358,"num_object_clones":0,"num_object_copies":716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":354,"num_read":182619,"num_read_kb":921779,"num_write":21835,"num_write_kb":363496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6486,"internal_metadata":0},"log_size":19129,"ondisk_log_size":19129,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.88100000000000001},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.143,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94299999999999995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.875}]},{"osd":1,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.88600000000000001,"15min":0.92800000000000005},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1539999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.86599999999999999,"15min":0.91900000000000004},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2809999999999999,"5min":1.583,"15min":1.583},"last":1.0660000000000001}]},{"osd":2,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.073,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.008,"15min":1.036},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2070000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.048}]},{"osd":3,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.208,"5min":1.925,"15min":1.925},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.99099999999999999,"15min":1.0429999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.411,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.2949999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":1.071},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.282,"5min":3.488,"15min":3.488},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.89900000000000002,"15min":0.94199999999999995},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":2.512,"15min":2.512},"last":0.753}]},{"osd":5,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":1.071,"15min":1.1499999999999999},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3959999999999999,"5min":3.069,"15min":3.069},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.05,"15min":1.111},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:16:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.403,"5min":1.615,"15min":1.615},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.091,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6499999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.91500000000000004}]}]},{"osd":6,"up_from":61,"seq":261993005083,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34344,"kb_used_data":2012,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94337496,"statfs":{"total":96636764160,"available":96601595904,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.82299999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.052}]},{"osd":4,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.97899999999999998}]},{"osd":5,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.90300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55276,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316564,"statfs":{"total":96636764160,"available":96580161536,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.131,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.107}]},{"osd":1,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.103,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.82299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1220000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.502,"15min":1.502},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.216,"5min":1.804,"15min":1.804},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.80600000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.345,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85899999999999999,"15min":0.86899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3180000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.024}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4339999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.96299999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.97599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2649999999999999,"5min":1.879,"15min":1.879},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.377,"5min":1.742,"15min":1.742},"last":1.214}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59372,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312468,"statfs":{"total":96636764160,"available":96575967232,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.86499999999999999},"min":{"1min":0.434,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.23,"5min":2.827,"15min":2.827},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":1.0580000000000001}]},{"osd":1,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.48799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0109999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.087},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.88800000000000001,"15min":0.95299999999999996},"min":{"1min":0.47499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.028,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.034}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1859999999999999,"5min":1.365,"15min":1.365},"last":0.97499999999999998}]},{"osd":3,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.48799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1220000000000001,"5min":1.133,"15min":1.133},"last":1.004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.125,"5min":4.282,"15min":4.282},"last":0.90300000000000002}]},{"osd":5,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.50600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.123,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.621},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.38900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed Sep 18 05:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1519999999999999,"5min":1.381,"15min":1.381},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":1.0109999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.413,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77424,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94294416,"statfs":{"total":96636764160,"available":96557481984,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2649999999999999,"5min":1.276,"15min":1.276},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.024,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1579999999999999,"5min":1.379,"15min":1.379},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1459999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.93100000000000005},"min":{"1min":0.5,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90800000000000003,"15min":0.92200000000000004},"min":{"1min":0.71499999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.373,"15min":1.373},"last":0.86199999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.73999999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5740000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.052},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.304,"5min":2.722,"15min":2.722},"last":0.95899999999999996}]}]},{"osd":2,"up_from":123,"seq":528280977421,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30248,"kb_used_data":2012,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341592,"statfs":{"total":96636764160,"available":96605790208,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2068480,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.82299999999999995,"15min":0.72499999999999998},"min":{"1min":0.312,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.087,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0629999999999999,"5min":1.978,"15min":1.978},"last":0.65900000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.3879999999999999,"5min":0.85999999999999999,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":0.79100000000000004}]},{"osd":3,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.92900000000000005,"15min":0.84099999999999997},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3340000000000001,"5min":17.638999999999999,"15min":17.638999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.96899999999999997,"15min":0.82999999999999996},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1970000000000001,"5min":19.489999999999998,"15min":19.489999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.871,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.454,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.90700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0669999999999999,"5min":1.762,"15min":1.762},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.071},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":14.198,"15min":14.198},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.90500000000000003,"15min":0.88700000000000001},"min":{"1min":0.60099999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.874},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3819999999999999,"5min":1.446,"15min":1.446},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.1619999999999999,"15min":1.0940000000000001},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6659999999999999,"5min":14.234,"15min":14.234},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0049999999999999,"15min":1.022},"min":{"1min":0.69099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.496,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.77400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59436,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312404,"statfs":{"total":96636764160,"available":96575901696,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.226,"5min":1.829,"15min":1.829},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.4379999999999999,"5min":2.25,"15min":2.25},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1579999999999999,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84399999999999997,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3899999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.47599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.76300000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90300000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.278,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.877},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.579,"5min":1.911,"15min":1.911},"last":1.141}]},{"osd":6,"last update":"Wed Sep 18 05:16:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.095,"5min":0.90700000000000003,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.073}]},{"osd":7,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97999999999999998,"15min":1.012},"min":{"1min":0.622,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.546,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.054},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0569999999999999,"15min":1.0700000000000001},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4610000000000001,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.0029999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:16:49.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:16:50.073 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:50.074 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:16:50.095 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-18T05:16:48.604837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":362,"num_object_clones":0,"num_object_copies":724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":362,"num_whiteouts":354,"num_read":182735,"num_read_kb":921879,"num_write":21996,"num_write_kb":365914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19249,"ondisk_log_size":19249,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400476,"kb_used_data":16240,"kb_used_omap":29,"kb_used_meta":384098,"kb_avail":754574244,"statfs":{"total":773094113280,"available":772684025856,"internally_reserved":0,"allocated":16629760,"data_stored":9114916,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":29988,"internal_metadata":393317084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.516552"},"pg_stats":[{"pgid":"3.1f","version":"152'705","reported_seq":2818,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198942+0000","last_change":"2024-09-18T05:16:22.952279+0000","last_active":"2024-09-18T05:16:43.198942+0000","last_peered":"2024-09-18T05:16:43.198942+0000","last_clean":"2024-09-18T05:16:43.198942+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:16:43.198942+0000","last_undegraded":"2024-09-18T05:16:43.198942+0000","last_fullsized":"2024-09-18T05:16:43.198942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069029300000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4139,"num_read_kb":20195,"num_write":907,"num_write_kb":9329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"151'1446","reported_seq":6945,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101179+0000","last_change":"2024-09-18T05:16:22.950489+0000","last_active":"2024-09-18T05:16:43.101179+0000","last_peered":"2024-09-18T05:16:43.101179+0000","last_clean":"2024-09-18T05:16:43.101179+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:16:43.101179+0000","last_undegraded":"2024-09-18T05:16:43.101179+0000","last_fullsized":"2024-09-18T05:16:43.101179+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031115520000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":11552,"num_read_kb":29398,"num_write":2219,"num_write_kb":10724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"151'500","reported_seq":2613,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202135+0000","last_change":"2024-09-18T05:16:39.081650+0000","last_active":"2024-09-18T05:16:43.202135+0000","last_peered":"2024-09-18T05:16:43.202135+0000","last_clean":"2024-09-18T05:16:43.202135+0000","last_became_active":"2024-09-18T05:16:39.078161+0000","last_became_peered":"2024-09-18T05:16:39.078161+0000","last_unstale":"2024-09-18T05:16:43.202135+0000","last_undegraded":"2024-09-18T05:16:43.202135+0000","last_fullsized":"2024-09-18T05:16:43.202135+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:58.056260+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0077051680000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3418,"num_read_kb":20008,"num_write":499,"num_write_kb":11307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"152'957","reported_seq":4756,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201751+0000","last_change":"2024-09-18T05:16:39.081624+0000","last_active":"2024-09-18T05:16:43.201751+0000","last_peered":"2024-09-18T05:16:43.201751+0000","last_clean":"2024-09-18T05:16:43.201751+0000","last_became_active":"2024-09-18T05:16:39.078258+0000","last_became_peered":"2024-09-18T05:16:39.078258+0000","last_unstale":"2024-09-18T05:16:43.201751+0000","last_undegraded":"2024-09-18T05:16:43.201751+0000","last_fullsized":"2024-09-18T05:16:43.201751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:23.450501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078280600000000004,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":14,"num_read":7245,"num_read_kb":33079,"num_write":1238,"num_write_kb":14791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"151'402","reported_seq":2487,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199015+0000","last_change":"2024-09-18T05:16:22.954184+0000","last_active":"2024-09-18T05:16:43.199015+0000","last_peered":"2024-09-18T05:16:43.199015+0000","last_clean":"2024-09-18T05:16:43.199015+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:16:43.199015+0000","last_undegraded":"2024-09-18T05:16:43.199015+0000","last_fullsized":"2024-09-18T05:16:43.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074971399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2723,"num_read_kb":17099,"num_write":364,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"151'429","reported_seq":6379,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.103891+0000","last_change":"2024-09-18T05:16:22.967762+0000","last_active":"2024-09-18T05:16:43.103891+0000","last_peered":"2024-09-18T05:16:43.103891+0000","last_clean":"2024-09-18T05:16:43.103891+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:16:43.103891+0000","last_undegraded":"2024-09-18T05:16:43.103891+0000","last_fullsized":"2024-09-18T05:16:43.103891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071492300000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":5935,"num_read_kb":45781,"num_write":417,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"152'566","reported_seq":5849,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198800+0000","last_change":"2024-09-18T05:16:22.956775+0000","last_active":"2024-09-18T05:16:43.198800+0000","last_peered":"2024-09-18T05:16:43.198800+0000","last_clean":"2024-09-18T05:16:43.198800+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:16:43.198800+0000","last_undegraded":"2024-09-18T05:16:43.198800+0000","last_fullsized":"2024-09-18T05:16:43.198800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055068100000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8335,"num_read_kb":20827,"num_write":497,"num_write_kb":15047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"151'863","reported_seq":2720,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101173+0000","last_change":"2024-09-18T05:16:22.948825+0000","last_active":"2024-09-18T05:16:43.101173+0000","last_peered":"2024-09-18T05:16:43.101173+0000","last_clean":"2024-09-18T05:16:43.101173+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:16:43.101173+0000","last_undegraded":"2024-09-18T05:16:43.101173+0000","last_fullsized":"2024-09-18T05:16:43.101173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001816465,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4198,"num_read_kb":22346,"num_write":1180,"num_write_kb":9146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'583","reported_seq":7223,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199402+0000","last_change":"2024-09-18T05:16:22.953058+0000","last_active":"2024-09-18T05:16:43.199402+0000","last_peered":"2024-09-18T05:16:43.199402+0000","last_clean":"2024-09-18T05:16:43.199402+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:16:43.199402+0000","last_undegraded":"2024-09-18T05:16:43.199402+0000","last_fullsized":"2024-09-18T05:16:43.199402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012193429999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8338,"num_read_kb":33067,"num_write":470,"num_write_kb":10649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'656","reported_seq":8296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202132+0000","last_change":"2024-09-18T05:16:22.963058+0000","last_active":"2024-09-18T05:16:43.202132+0000","last_peered":"2024-09-18T05:16:43.202132+0000","last_clean":"2024-09-18T05:16:43.202132+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:16:43.202132+0000","last_undegraded":"2024-09-18T05:16:43.202132+0000","last_fullsized":"2024-09-18T05:16:43.202132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655983,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9449,"num_read_kb":47880,"num_write":679,"num_write_kb":15057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"151'746","reported_seq":6974,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202806+0000","last_change":"2024-09-18T05:16:22.947810+0000","last_active":"2024-09-18T05:16:43.202806+0000","last_peered":"2024-09-18T05:16:43.202806+0000","last_clean":"2024-09-18T05:16:43.202806+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:16:43.202806+0000","last_undegraded":"2024-09-18T05:16:43.202806+0000","last_fullsized":"2024-09-18T05:16:43.202806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013431739999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":8031,"num_read_kb":49145,"num_write":1033,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"151'399","reported_seq":2296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104237+0000","last_change":"2024-09-18T05:16:22.968983+0000","last_active":"2024-09-18T05:16:43.104237+0000","last_peered":"2024-09-18T05:16:43.104237+0000","last_clean":"2024-09-18T05:16:43.104237+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:16:43.104237+0000","last_undegraded":"2024-09-18T05:16:43.104237+0000","last_fullsized":"2024-09-18T05:16:43.104237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010340900000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":2061,"num_read_kb":19662,"num_write":411,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201271+0000","last_change":"2024-09-18T05:16:02.923317+0000","last_active":"2024-09-18T05:16:43.201271+0000","last_peered":"2024-09-18T05:16:43.201271+0000","last_clean":"2024-09-18T05:16:43.201271+0000","last_became_active":"2024-09-18T05:16:02.922394+0000","last_became_peered":"2024-09-18T05:16:02.922394+0000","last_unstale":"2024-09-18T05:16:43.201271+0000","last_undegraded":"2024-09-18T05:16:43.201271+0000","last_fullsized":"2024-09-18T05:16:43.201271+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:34.150689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"152'577","reported_seq":3709,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199283+0000","last_change":"2024-09-18T05:16:22.953341+0000","last_active":"2024-09-18T05:16:43.199283+0000","last_peered":"2024-09-18T05:16:43.199283+0000","last_clean":"2024-09-18T05:16:43.199283+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:16:43.199283+0000","last_undegraded":"2024-09-18T05:16:43.199283+0000","last_fullsized":"2024-09-18T05:16:43.199283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015023230000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":4591,"num_read_kb":29240,"num_write":682,"num_write_kb":13080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199016+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:16:43.199016+0000","last_peered":"2024-09-18T05:16:43.199016+0000","last_clean":"2024-09-18T05:16:43.199016+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:16:43.199016+0000","last_undegraded":"2024-09-18T05:16:43.199016+0000","last_fullsized":"2024-09-18T05:16:43.199016+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"152'533","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101657+0000","last_change":"2024-09-18T05:16:22.951905+0000","last_active":"2024-09-18T05:16:43.101657+0000","last_peered":"2024-09-18T05:16:43.101657+0000","last_clean":"2024-09-18T05:16:43.101657+0000","last_became_active":"2024-09-18T05:16:19.904499+0000","last_became_peered":"2024-09-18T05:16:19.904499+0000","last_unstale":"2024-09-18T05:16:43.101657+0000","last_undegraded":"2024-09-18T05:16:43.101657+0000","last_fullsized":"2024-09-18T05:16:43.101657+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:10:44.782963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00364015,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3679,"num_read_kb":33211,"num_write":613,"num_write_kb":10118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":7448296,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202988+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:16:43.202988+0000","last_peered":"2024-09-18T05:16:43.202988+0000","last_clean":"2024-09-18T05:16:43.202988+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:16:43.202988+0000","last_undegraded":"2024-09-18T05:16:43.202988+0000","last_fullsized":"2024-09-18T05:16:43.202988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"150'420","reported_seq":6024,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199233+0000","last_change":"2024-09-18T05:16:22.957252+0000","last_active":"2024-09-18T05:16:43.199233+0000","last_peered":"2024-09-18T05:16:43.199233+0000","last_clean":"2024-09-18T05:16:43.199233+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:16:43.199233+0000","last_undegraded":"2024-09-18T05:16:43.199233+0000","last_fullsized":"2024-09-18T05:16:43.199233+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:46.818280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060223399999999999,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":6557,"num_read_kb":27685,"num_write":436,"num_write_kb":9094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199291+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:16:43.199291+0000","last_peered":"2024-09-18T05:16:43.199291+0000","last_clean":"2024-09-18T05:16:43.199291+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:16:43.199291+0000","last_undegraded":"2024-09-18T05:16:43.199291+0000","last_fullsized":"2024-09-18T05:16:43.199291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"151'459","reported_seq":6025,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202438+0000","last_change":"2024-09-18T05:16:39.081593+0000","last_active":"2024-09-18T05:16:43.202438+0000","last_peered":"2024-09-18T05:16:43.202438+0000","last_clean":"2024-09-18T05:16:43.202438+0000","last_became_active":"2024-09-18T05:16:39.077813+0000","last_became_peered":"2024-09-18T05:16:39.077813+0000","last_unstale":"2024-09-18T05:16:43.202438+0000","last_undegraded":"2024-09-18T05:16:43.202438+0000","last_fullsized":"2024-09-18T05:16:43.202438+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:26:16.213994+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.032776543999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5840,"num_read_kb":39783,"num_write":450,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"152'1164","reported_seq":4989,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104129+0000","last_change":"2024-09-18T05:16:22.969058+0000","last_active":"2024-09-18T05:16:43.104129+0000","last_peered":"2024-09-18T05:16:43.104129+0000","last_clean":"2024-09-18T05:16:43.104129+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:16:43.104129+0000","last_undegraded":"2024-09-18T05:16:43.104129+0000","last_fullsized":"2024-09-18T05:16:43.104129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011154260000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":6871,"num_read_kb":44276,"num_write":1455,"num_write_kb":20060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":81,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201766+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201766+0000","last_peered":"2024-09-18T05:16:43.201766+0000","last_clean":"2024-09-18T05:16:43.201766+0000","last_became_active":"2024-09-18T05:16:39.076198+0000","last_became_peered":"2024-09-18T05:16:39.076198+0000","last_unstale":"2024-09-18T05:16:43.201766+0000","last_undegraded":"2024-09-18T05:16:43.201766+0000","last_fullsized":"2024-09-18T05:16:43.201766+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:48:58.557656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'438","reported_seq":4750,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198784+0000","last_change":"2024-09-18T05:16:22.956747+0000","last_active":"2024-09-18T05:16:43.198784+0000","last_peered":"2024-09-18T05:16:43.198784+0000","last_clean":"2024-09-18T05:16:43.198784+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:16:43.198784+0000","last_undegraded":"2024-09-18T05:16:43.198784+0000","last_fullsized":"2024-09-18T05:16:43.198784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:12.320367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037471100000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":4862,"num_read_kb":21776,"num_write":386,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.102497+0000","last_change":"2024-09-18T05:15:55.216600+0000","last_active":"2024-09-18T05:16:43.102497+0000","last_peered":"2024-09-18T05:16:43.102497+0000","last_clean":"2024-09-18T05:16:43.102497+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:16:43.102497+0000","last_undegraded":"2024-09-18T05:16:43.102497+0000","last_fullsized":"2024-09-18T05:16:43.102497+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:42:31.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"151'363","reported_seq":2476,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199170+0000","last_change":"2024-09-18T05:16:22.951266+0000","last_active":"2024-09-18T05:16:43.199170+0000","last_peered":"2024-09-18T05:16:43.199170+0000","last_clean":"2024-09-18T05:16:43.199170+0000","last_became_active":"2024-09-18T05:16:01.899154+0000","last_became_peered":"2024-09-18T05:16:01.899154+0000","last_unstale":"2024-09-18T05:16:43.199170+0000","last_undegraded":"2024-09-18T05:16:43.199170+0000","last_fullsized":"2024-09-18T05:16:43.199170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:00:29.357279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032123,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":2135,"num_read_kb":5505,"num_write":365,"num_write_kb":5251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":2091093,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202445+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:16:43.202445+0000","last_peered":"2024-09-18T05:16:43.202445+0000","last_clean":"2024-09-18T05:16:43.202445+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:16:43.202445+0000","last_undegraded":"2024-09-18T05:16:43.202445+0000","last_fullsized":"2024-09-18T05:16:43.202445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"151'596","reported_seq":5170,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198896+0000","last_change":"2024-09-18T05:16:22.957237+0000","last_active":"2024-09-18T05:16:43.198896+0000","last_peered":"2024-09-18T05:16:43.198896+0000","last_clean":"2024-09-18T05:16:43.198896+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:16:43.198896+0000","last_undegraded":"2024-09-18T05:16:43.198896+0000","last_fullsized":"2024-09-18T05:16:43.198896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:22:34.025479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083719899999999995,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7500,"num_read_kb":38768,"num_write":572,"num_write_kb":10748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":106,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201713+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201713+0000","last_peered":"2024-09-18T05:16:43.201713+0000","last_clean":"2024-09-18T05:16:43.201713+0000","last_became_active":"2024-09-18T05:16:39.075931+0000","last_became_peered":"2024-09-18T05:16:39.075931+0000","last_unstale":"2024-09-18T05:16:43.201713+0000","last_undegraded":"2024-09-18T05:16:43.201713+0000","last_fullsized":"2024-09-18T05:16:43.201713+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:06.991206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202783+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:16:43.202783+0000","last_peered":"2024-09-18T05:16:43.202783+0000","last_clean":"2024-09-18T05:16:43.202783+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:16:43.202783+0000","last_undegraded":"2024-09-18T05:16:43.202783+0000","last_fullsized":"2024-09-18T05:16:43.202783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"152'426","reported_seq":5316,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.100966+0000","last_change":"2024-09-18T05:16:22.948527+0000","last_active":"2024-09-18T05:16:43.100966+0000","last_peered":"2024-09-18T05:16:43.100966+0000","last_clean":"2024-09-18T05:16:43.100966+0000","last_became_active":"2024-09-18T05:16:01.898482+0000","last_became_peered":"2024-09-18T05:16:01.898482+0000","last_unstale":"2024-09-18T05:16:43.100966+0000","last_undegraded":"2024-09-18T05:16:43.100966+0000","last_fullsized":"2024-09-18T05:16:43.100966+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:22.456629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015649310000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6584,"num_read_kb":42729,"num_write":374,"num_write_kb":15931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":15236017,"num_keys_recovered":42,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"151'296","reported_seq":4172,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104036+0000","last_change":"2024-09-18T05:16:22.967630+0000","last_active":"2024-09-18T05:16:43.104036+0000","last_peered":"2024-09-18T05:16:43.104036+0000","last_clean":"2024-09-18T05:16:43.104036+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:16:43.104036+0000","last_undegraded":"2024-09-18T05:16:43.104036+0000","last_fullsized":"2024-09-18T05:16:43.104036+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:06:43.114897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062945099999999995,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3697,"num_read_kb":33449,"num_write":292,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"151'633","reported_seq":2727,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201314+0000","last_change":"2024-09-18T05:16:22.966505+0000","last_active":"2024-09-18T05:16:43.201314+0000","last_peered":"2024-09-18T05:16:43.201314+0000","last_clean":"2024-09-18T05:16:43.201314+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:16:43.201314+0000","last_undegraded":"2024-09-18T05:16:43.201314+0000","last_fullsized":"2024-09-18T05:16:43.201314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000499841,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":3587,"num_read_kb":18383,"num_write":752,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"151'299","reported_seq":3368,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101410+0000","last_change":"2024-09-18T05:16:22.949763+0000","last_active":"2024-09-18T05:16:43.101410+0000","last_peered":"2024-09-18T05:16:43.101410+0000","last_clean":"2024-09-18T05:16:43.101410+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:16:43.101410+0000","last_undegraded":"2024-09-18T05:16:43.101410+0000","last_fullsized":"2024-09-18T05:16:43.101410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002578814,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":2832,"num_read_kb":19521,"num_write":259,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"151'471","reported_seq":5189,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202050+0000","last_change":"2024-09-18T05:16:39.081596+0000","last_active":"2024-09-18T05:16:43.202050+0000","last_peered":"2024-09-18T05:16:43.202050+0000","last_clean":"2024-09-18T05:16:43.202050+0000","last_became_active":"2024-09-18T05:16:39.077761+0000","last_became_peered":"2024-09-18T05:16:39.077761+0000","last_unstale":"2024-09-18T05:16:43.202050+0000","last_undegraded":"2024-09-18T05:16:43.202050+0000","last_fullsized":"2024-09-18T05:16:43.202050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:52.136023+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017471631000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5191,"num_read_kb":29963,"num_write":520,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'416","reported_seq":3721,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202864+0000","last_change":"2024-09-18T05:16:22.947578+0000","last_active":"2024-09-18T05:16:43.202864+0000","last_peered":"2024-09-18T05:16:43.202864+0000","last_clean":"2024-09-18T05:16:43.202864+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:16:43.202864+0000","last_undegraded":"2024-09-18T05:16:43.202864+0000","last_fullsized":"2024-09-18T05:16:43.202864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318949999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4121,"num_read_kb":17361,"num_write":391,"num_write_kb":13003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"151'602","reported_seq":5933,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.203158+0000","last_change":"2024-09-18T05:16:22.948118+0000","last_active":"2024-09-18T05:16:43.203158+0000","last_peered":"2024-09-18T05:16:43.203158+0000","last_clean":"2024-09-18T05:16:43.203158+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:16:43.203158+0000","last_undegraded":"2024-09-18T05:16:43.203158+0000","last_fullsized":"2024-09-18T05:16:43.203158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001596606,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":6945,"num_read_kb":34740,"num_write":596,"num_write_kb":4823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"151'555","reported_seq":9087,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101442+0000","last_change":"2024-09-18T05:16:22.950996+0000","last_active":"2024-09-18T05:16:43.101442+0000","last_peered":"2024-09-18T05:16:43.101442+0000","last_clean":"2024-09-18T05:16:43.101442+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:16:43.101442+0000","last_undegraded":"2024-09-18T05:16:43.101442+0000","last_fullsized":"2024-09-18T05:16:43.101442+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031437349999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9783,"num_read_kb":40662,"num_write":558,"num_write_kb":18337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"150'666","reported_seq":4026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201139+0000","last_change":"2024-09-18T05:16:22.966612+0000","last_active":"2024-09-18T05:16:43.201139+0000","last_peered":"2024-09-18T05:16:43.201139+0000","last_clean":"2024-09-18T05:16:43.201139+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:16:43.201139+0000","last_undegraded":"2024-09-18T05:16:43.201139+0000","last_fullsized":"2024-09-18T05:16:43.201139+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056430399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":7033,"num_read_kb":30921,"num_write":767,"num_write_kb":9608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'442","reported_seq":3800,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202498+0000","last_change":"2024-09-18T05:16:22.946942+0000","last_active":"2024-09-18T05:16:43.202498+0000","last_peered":"2024-09-18T05:16:43.202498+0000","last_clean":"2024-09-18T05:16:43.202498+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:16:43.202498+0000","last_undegraded":"2024-09-18T05:16:43.202498+0000","last_fullsized":"2024-09-18T05:16:43.202498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084174599999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":4545,"num_read_kb":16351,"num_write":465,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"150'667","reported_seq":3026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199197+0000","last_change":"2024-09-18T05:16:22.951854+0000","last_active":"2024-09-18T05:16:43.199197+0000","last_peered":"2024-09-18T05:16:43.199197+0000","last_clean":"2024-09-18T05:16:43.199197+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:16:43.199197+0000","last_undegraded":"2024-09-18T05:16:43.199197+0000","last_fullsized":"2024-09-18T05:16:43.199197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001575814,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":5022,"num_read_kb":16163,"num_write":742,"num_write_kb":7893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"151'854","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202677+0000","last_change":"2024-09-18T05:16:22.946967+0000","last_active":"2024-09-18T05:16:43.202677+0000","last_peered":"2024-09-18T05:16:43.202677+0000","last_clean":"2024-09-18T05:16:43.202677+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:16:43.202677+0000","last_undegraded":"2024-09-18T05:16:43.202677+0000","last_fullsized":"2024-09-18T05:16:43.202677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078209799999999995,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":5820,"num_read_kb":22805,"num_write":1246,"num_write_kb":8989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":358,"num_object_clones":0,"num_object_copies":716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":354,"num_read":182619,"num_read_kb":921779,"num_write":21835,"num_write_kb":363496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6486,"internal_metadata":0},"log_size":19129,"ondisk_log_size":19129,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.88100000000000001},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.143,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94299999999999995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.875}]},{"osd":1,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.88600000000000001,"15min":0.92800000000000005},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1539999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.86599999999999999,"15min":0.91900000000000004},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2809999999999999,"5min":1.583,"15min":1.583},"last":1.0660000000000001}]},{"osd":2,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.073,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.008,"15min":1.036},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2070000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.048}]},{"osd":3,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.208,"5min":1.925,"15min":1.925},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.99099999999999999,"15min":1.0429999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.411,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.2949999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":1.071},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.282,"5min":3.488,"15min":3.488},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.89900000000000002,"15min":0.94199999999999995},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":2.512,"15min":2.512},"last":0.753}]},{"osd":5,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":1.071,"15min":1.1499999999999999},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3959999999999999,"5min":3.069,"15min":3.069},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.05,"15min":1.111},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:16:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.403,"5min":1.615,"15min":1.615},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.091,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6499999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.91500000000000004}]}]},{"osd":6,"up_from":61,"seq":261993005083,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34344,"kb_used_data":2012,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94337496,"statfs":{"total":96636764160,"available":96601595904,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.82299999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.052}]},{"osd":4,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.97899999999999998}]},{"osd":5,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.90300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55276,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316564,"statfs":{"total":96636764160,"available":96580161536,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.131,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.107}]},{"osd":1,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.103,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.82299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1220000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.502,"15min":1.502},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.216,"5min":1.804,"15min":1.804},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.80600000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.345,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85899999999999999,"15min":0.86899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3180000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.024}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4339999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.96299999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.97599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2649999999999999,"5min":1.879,"15min":1.879},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.377,"5min":1.742,"15min":1.742},"last":1.214}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59372,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312468,"statfs":{"total":96636764160,"available":96575967232,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.86499999999999999},"min":{"1min":0.434,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.23,"5min":2.827,"15min":2.827},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":1.0580000000000001}]},{"osd":1,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.48799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0109999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.087},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.88800000000000001,"15min":0.95299999999999996},"min":{"1min":0.47499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.028,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.034}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1859999999999999,"5min":1.365,"15min":1.365},"last":0.97499999999999998}]},{"osd":3,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.48799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1220000000000001,"5min":1.133,"15min":1.133},"last":1.004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.125,"5min":4.282,"15min":4.282},"last":0.90300000000000002}]},{"osd":5,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.50600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.123,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.621},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.38900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed Sep 18 05:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1519999999999999,"5min":1.381,"15min":1.381},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":1.0109999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.413,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77424,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94294416,"statfs":{"total":96636764160,"available":96557481984,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2649999999999999,"5min":1.276,"15min":1.276},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.024,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1579999999999999,"5min":1.379,"15min":1.379},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1459999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.93100000000000005},"min":{"1min":0.5,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90800000000000003,"15min":0.92200000000000004},"min":{"1min":0.71499999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.373,"15min":1.373},"last":0.86199999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.73999999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5740000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.052},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.304,"5min":2.722,"15min":2.722},"last":0.95899999999999996}]}]},{"osd":2,"up_from":123,"seq":528280977421,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30248,"kb_used_data":2012,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341592,"statfs":{"total":96636764160,"available":96605790208,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2068480,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.82299999999999995,"15min":0.72499999999999998},"min":{"1min":0.312,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.087,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0629999999999999,"5min":1.978,"15min":1.978},"last":0.65900000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.3879999999999999,"5min":0.85999999999999999,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":0.79100000000000004}]},{"osd":3,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.92900000000000005,"15min":0.84099999999999997},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3340000000000001,"5min":17.638999999999999,"15min":17.638999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.96899999999999997,"15min":0.82999999999999996},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1970000000000001,"5min":19.489999999999998,"15min":19.489999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.871,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.454,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.90700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0669999999999999,"5min":1.762,"15min":1.762},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.071},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":14.198,"15min":14.198},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.90500000000000003,"15min":0.88700000000000001},"min":{"1min":0.60099999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.874},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3819999999999999,"5min":1.446,"15min":1.446},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.1619999999999999,"15min":1.0940000000000001},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6659999999999999,"5min":14.234,"15min":14.234},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0049999999999999,"15min":1.022},"min":{"1min":0.69099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.496,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.77400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59436,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312404,"statfs":{"total":96636764160,"available":96575901696,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.226,"5min":1.829,"15min":1.829},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.4379999999999999,"5min":2.25,"15min":2.25},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1579999999999999,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84399999999999997,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3899999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.47599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.76300000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90300000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.278,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.877},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.579,"5min":1.911,"15min":1.911},"last":1.141}]},{"osd":6,"last update":"Wed Sep 18 05:16:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.095,"5min":0.90700000000000003,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.073}]},{"osd":7,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97999999999999998,"15min":1.012},"min":{"1min":0.622,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.546,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.054},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0569999999999999,"15min":1.0700000000000001},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4610000000000001,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.0029999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:16:50.098 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T05:16:50.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:16:50.387 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:50.388 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:16:50.404 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-18T05:16:48.604837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":362,"num_object_clones":0,"num_object_copies":724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":362,"num_whiteouts":354,"num_read":182735,"num_read_kb":921879,"num_write":21996,"num_write_kb":365914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19249,"ondisk_log_size":19249,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400476,"kb_used_data":16240,"kb_used_omap":29,"kb_used_meta":384098,"kb_avail":754574244,"statfs":{"total":773094113280,"available":772684025856,"internally_reserved":0,"allocated":16629760,"data_stored":9114916,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":29988,"internal_metadata":393317084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.516552"},"pg_stats":[{"pgid":"3.1f","version":"152'705","reported_seq":2818,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198942+0000","last_change":"2024-09-18T05:16:22.952279+0000","last_active":"2024-09-18T05:16:43.198942+0000","last_peered":"2024-09-18T05:16:43.198942+0000","last_clean":"2024-09-18T05:16:43.198942+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:16:43.198942+0000","last_undegraded":"2024-09-18T05:16:43.198942+0000","last_fullsized":"2024-09-18T05:16:43.198942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:56:58.879064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069029300000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4139,"num_read_kb":20195,"num_write":907,"num_write_kb":9329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"151'1446","reported_seq":6945,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101179+0000","last_change":"2024-09-18T05:16:22.950489+0000","last_active":"2024-09-18T05:16:43.101179+0000","last_peered":"2024-09-18T05:16:43.101179+0000","last_clean":"2024-09-18T05:16:43.101179+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:16:43.101179+0000","last_undegraded":"2024-09-18T05:16:43.101179+0000","last_fullsized":"2024-09-18T05:16:43.101179+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031115520000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":11552,"num_read_kb":29398,"num_write":2219,"num_write_kb":10724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"151'500","reported_seq":2613,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202135+0000","last_change":"2024-09-18T05:16:39.081650+0000","last_active":"2024-09-18T05:16:43.202135+0000","last_peered":"2024-09-18T05:16:43.202135+0000","last_clean":"2024-09-18T05:16:43.202135+0000","last_became_active":"2024-09-18T05:16:39.078161+0000","last_became_peered":"2024-09-18T05:16:39.078161+0000","last_unstale":"2024-09-18T05:16:43.202135+0000","last_undegraded":"2024-09-18T05:16:43.202135+0000","last_fullsized":"2024-09-18T05:16:43.202135+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:58.056260+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0077051680000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3418,"num_read_kb":20008,"num_write":499,"num_write_kb":11307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"152'957","reported_seq":4756,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201751+0000","last_change":"2024-09-18T05:16:39.081624+0000","last_active":"2024-09-18T05:16:43.201751+0000","last_peered":"2024-09-18T05:16:43.201751+0000","last_clean":"2024-09-18T05:16:43.201751+0000","last_became_active":"2024-09-18T05:16:39.078258+0000","last_became_peered":"2024-09-18T05:16:39.078258+0000","last_unstale":"2024-09-18T05:16:43.201751+0000","last_undegraded":"2024-09-18T05:16:43.201751+0000","last_fullsized":"2024-09-18T05:16:43.201751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:23.450501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078280600000000004,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":14,"num_read":7245,"num_read_kb":33079,"num_write":1238,"num_write_kb":14791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"151'402","reported_seq":2487,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199015+0000","last_change":"2024-09-18T05:16:22.954184+0000","last_active":"2024-09-18T05:16:43.199015+0000","last_peered":"2024-09-18T05:16:43.199015+0000","last_clean":"2024-09-18T05:16:43.199015+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:16:43.199015+0000","last_undegraded":"2024-09-18T05:16:43.199015+0000","last_fullsized":"2024-09-18T05:16:43.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:34.765936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074971399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2723,"num_read_kb":17099,"num_write":364,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"151'429","reported_seq":6379,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.103891+0000","last_change":"2024-09-18T05:16:22.967762+0000","last_active":"2024-09-18T05:16:43.103891+0000","last_peered":"2024-09-18T05:16:43.103891+0000","last_clean":"2024-09-18T05:16:43.103891+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:16:43.103891+0000","last_undegraded":"2024-09-18T05:16:43.103891+0000","last_fullsized":"2024-09-18T05:16:43.103891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071492300000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":5935,"num_read_kb":45781,"num_write":417,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"152'566","reported_seq":5849,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198800+0000","last_change":"2024-09-18T05:16:22.956775+0000","last_active":"2024-09-18T05:16:43.198800+0000","last_peered":"2024-09-18T05:16:43.198800+0000","last_clean":"2024-09-18T05:16:43.198800+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:16:43.198800+0000","last_undegraded":"2024-09-18T05:16:43.198800+0000","last_fullsized":"2024-09-18T05:16:43.198800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055068100000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8335,"num_read_kb":20827,"num_write":497,"num_write_kb":15047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"151'863","reported_seq":2720,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101173+0000","last_change":"2024-09-18T05:16:22.948825+0000","last_active":"2024-09-18T05:16:43.101173+0000","last_peered":"2024-09-18T05:16:43.101173+0000","last_clean":"2024-09-18T05:16:43.101173+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:16:43.101173+0000","last_undegraded":"2024-09-18T05:16:43.101173+0000","last_fullsized":"2024-09-18T05:16:43.101173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001816465,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4198,"num_read_kb":22346,"num_write":1180,"num_write_kb":9146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'583","reported_seq":7223,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199402+0000","last_change":"2024-09-18T05:16:22.953058+0000","last_active":"2024-09-18T05:16:43.199402+0000","last_peered":"2024-09-18T05:16:43.199402+0000","last_clean":"2024-09-18T05:16:43.199402+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:16:43.199402+0000","last_undegraded":"2024-09-18T05:16:43.199402+0000","last_fullsized":"2024-09-18T05:16:43.199402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:00:18.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012193429999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8338,"num_read_kb":33067,"num_write":470,"num_write_kb":10649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'656","reported_seq":8296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202132+0000","last_change":"2024-09-18T05:16:22.963058+0000","last_active":"2024-09-18T05:16:43.202132+0000","last_peered":"2024-09-18T05:16:43.202132+0000","last_clean":"2024-09-18T05:16:43.202132+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:16:43.202132+0000","last_undegraded":"2024-09-18T05:16:43.202132+0000","last_fullsized":"2024-09-18T05:16:43.202132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655983,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9449,"num_read_kb":47880,"num_write":679,"num_write_kb":15057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"151'746","reported_seq":6974,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202806+0000","last_change":"2024-09-18T05:16:22.947810+0000","last_active":"2024-09-18T05:16:43.202806+0000","last_peered":"2024-09-18T05:16:43.202806+0000","last_clean":"2024-09-18T05:16:43.202806+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:16:43.202806+0000","last_undegraded":"2024-09-18T05:16:43.202806+0000","last_fullsized":"2024-09-18T05:16:43.202806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013431739999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":8031,"num_read_kb":49145,"num_write":1033,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"151'399","reported_seq":2296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104237+0000","last_change":"2024-09-18T05:16:22.968983+0000","last_active":"2024-09-18T05:16:43.104237+0000","last_peered":"2024-09-18T05:16:43.104237+0000","last_clean":"2024-09-18T05:16:43.104237+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:16:43.104237+0000","last_undegraded":"2024-09-18T05:16:43.104237+0000","last_fullsized":"2024-09-18T05:16:43.104237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010340900000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":2061,"num_read_kb":19662,"num_write":411,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201271+0000","last_change":"2024-09-18T05:16:02.923317+0000","last_active":"2024-09-18T05:16:43.201271+0000","last_peered":"2024-09-18T05:16:43.201271+0000","last_clean":"2024-09-18T05:16:43.201271+0000","last_became_active":"2024-09-18T05:16:02.922394+0000","last_became_peered":"2024-09-18T05:16:02.922394+0000","last_unstale":"2024-09-18T05:16:43.201271+0000","last_undegraded":"2024-09-18T05:16:43.201271+0000","last_fullsized":"2024-09-18T05:16:43.201271+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:34.150689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"152'577","reported_seq":3709,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199283+0000","last_change":"2024-09-18T05:16:22.953341+0000","last_active":"2024-09-18T05:16:43.199283+0000","last_peered":"2024-09-18T05:16:43.199283+0000","last_clean":"2024-09-18T05:16:43.199283+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:16:43.199283+0000","last_undegraded":"2024-09-18T05:16:43.199283+0000","last_fullsized":"2024-09-18T05:16:43.199283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:52.147554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015023230000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":4591,"num_read_kb":29240,"num_write":682,"num_write_kb":13080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199016+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:16:43.199016+0000","last_peered":"2024-09-18T05:16:43.199016+0000","last_clean":"2024-09-18T05:16:43.199016+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:16:43.199016+0000","last_undegraded":"2024-09-18T05:16:43.199016+0000","last_fullsized":"2024-09-18T05:16:43.199016+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"152'533","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101657+0000","last_change":"2024-09-18T05:16:22.951905+0000","last_active":"2024-09-18T05:16:43.101657+0000","last_peered":"2024-09-18T05:16:43.101657+0000","last_clean":"2024-09-18T05:16:43.101657+0000","last_became_active":"2024-09-18T05:16:19.904499+0000","last_became_peered":"2024-09-18T05:16:19.904499+0000","last_unstale":"2024-09-18T05:16:43.101657+0000","last_undegraded":"2024-09-18T05:16:43.101657+0000","last_fullsized":"2024-09-18T05:16:43.101657+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:10:44.782963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00364015,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3679,"num_read_kb":33211,"num_write":613,"num_write_kb":10118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":7448296,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202988+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:16:43.202988+0000","last_peered":"2024-09-18T05:16:43.202988+0000","last_clean":"2024-09-18T05:16:43.202988+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:16:43.202988+0000","last_undegraded":"2024-09-18T05:16:43.202988+0000","last_fullsized":"2024-09-18T05:16:43.202988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"150'420","reported_seq":6024,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199233+0000","last_change":"2024-09-18T05:16:22.957252+0000","last_active":"2024-09-18T05:16:43.199233+0000","last_peered":"2024-09-18T05:16:43.199233+0000","last_clean":"2024-09-18T05:16:43.199233+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:16:43.199233+0000","last_undegraded":"2024-09-18T05:16:43.199233+0000","last_fullsized":"2024-09-18T05:16:43.199233+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:46.818280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060223399999999999,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":6557,"num_read_kb":27685,"num_write":436,"num_write_kb":9094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199291+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:16:43.199291+0000","last_peered":"2024-09-18T05:16:43.199291+0000","last_clean":"2024-09-18T05:16:43.199291+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:16:43.199291+0000","last_undegraded":"2024-09-18T05:16:43.199291+0000","last_fullsized":"2024-09-18T05:16:43.199291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"151'459","reported_seq":6025,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202438+0000","last_change":"2024-09-18T05:16:39.081593+0000","last_active":"2024-09-18T05:16:43.202438+0000","last_peered":"2024-09-18T05:16:43.202438+0000","last_clean":"2024-09-18T05:16:43.202438+0000","last_became_active":"2024-09-18T05:16:39.077813+0000","last_became_peered":"2024-09-18T05:16:39.077813+0000","last_unstale":"2024-09-18T05:16:43.202438+0000","last_undegraded":"2024-09-18T05:16:43.202438+0000","last_fullsized":"2024-09-18T05:16:43.202438+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:26:16.213994+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.032776543999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5840,"num_read_kb":39783,"num_write":450,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"152'1164","reported_seq":4989,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104129+0000","last_change":"2024-09-18T05:16:22.969058+0000","last_active":"2024-09-18T05:16:43.104129+0000","last_peered":"2024-09-18T05:16:43.104129+0000","last_clean":"2024-09-18T05:16:43.104129+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:16:43.104129+0000","last_undegraded":"2024-09-18T05:16:43.104129+0000","last_fullsized":"2024-09-18T05:16:43.104129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011154260000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":6871,"num_read_kb":44276,"num_write":1455,"num_write_kb":20060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":81,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201766+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201766+0000","last_peered":"2024-09-18T05:16:43.201766+0000","last_clean":"2024-09-18T05:16:43.201766+0000","last_became_active":"2024-09-18T05:16:39.076198+0000","last_became_peered":"2024-09-18T05:16:39.076198+0000","last_unstale":"2024-09-18T05:16:43.201766+0000","last_undegraded":"2024-09-18T05:16:43.201766+0000","last_fullsized":"2024-09-18T05:16:43.201766+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:48:58.557656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'438","reported_seq":4750,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198784+0000","last_change":"2024-09-18T05:16:22.956747+0000","last_active":"2024-09-18T05:16:43.198784+0000","last_peered":"2024-09-18T05:16:43.198784+0000","last_clean":"2024-09-18T05:16:43.198784+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:16:43.198784+0000","last_undegraded":"2024-09-18T05:16:43.198784+0000","last_fullsized":"2024-09-18T05:16:43.198784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:12.320367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037471100000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":4862,"num_read_kb":21776,"num_write":386,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.102497+0000","last_change":"2024-09-18T05:15:55.216600+0000","last_active":"2024-09-18T05:16:43.102497+0000","last_peered":"2024-09-18T05:16:43.102497+0000","last_clean":"2024-09-18T05:16:43.102497+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:16:43.102497+0000","last_undegraded":"2024-09-18T05:16:43.102497+0000","last_fullsized":"2024-09-18T05:16:43.102497+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:42:31.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"151'363","reported_seq":2476,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199170+0000","last_change":"2024-09-18T05:16:22.951266+0000","last_active":"2024-09-18T05:16:43.199170+0000","last_peered":"2024-09-18T05:16:43.199170+0000","last_clean":"2024-09-18T05:16:43.199170+0000","last_became_active":"2024-09-18T05:16:01.899154+0000","last_became_peered":"2024-09-18T05:16:01.899154+0000","last_unstale":"2024-09-18T05:16:43.199170+0000","last_undegraded":"2024-09-18T05:16:43.199170+0000","last_fullsized":"2024-09-18T05:16:43.199170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:00:29.357279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032123,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":2135,"num_read_kb":5505,"num_write":365,"num_write_kb":5251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":2091093,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202445+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:16:43.202445+0000","last_peered":"2024-09-18T05:16:43.202445+0000","last_clean":"2024-09-18T05:16:43.202445+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:16:43.202445+0000","last_undegraded":"2024-09-18T05:16:43.202445+0000","last_fullsized":"2024-09-18T05:16:43.202445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"151'596","reported_seq":5170,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198896+0000","last_change":"2024-09-18T05:16:22.957237+0000","last_active":"2024-09-18T05:16:43.198896+0000","last_peered":"2024-09-18T05:16:43.198896+0000","last_clean":"2024-09-18T05:16:43.198896+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:16:43.198896+0000","last_undegraded":"2024-09-18T05:16:43.198896+0000","last_fullsized":"2024-09-18T05:16:43.198896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:22:34.025479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083719899999999995,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7500,"num_read_kb":38768,"num_write":572,"num_write_kb":10748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":106,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201713+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201713+0000","last_peered":"2024-09-18T05:16:43.201713+0000","last_clean":"2024-09-18T05:16:43.201713+0000","last_became_active":"2024-09-18T05:16:39.075931+0000","last_became_peered":"2024-09-18T05:16:39.075931+0000","last_unstale":"2024-09-18T05:16:43.201713+0000","last_undegraded":"2024-09-18T05:16:43.201713+0000","last_fullsized":"2024-09-18T05:16:43.201713+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:06.991206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202783+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:16:43.202783+0000","last_peered":"2024-09-18T05:16:43.202783+0000","last_clean":"2024-09-18T05:16:43.202783+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:16:43.202783+0000","last_undegraded":"2024-09-18T05:16:43.202783+0000","last_fullsized":"2024-09-18T05:16:43.202783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"152'426","reported_seq":5316,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.100966+0000","last_change":"2024-09-18T05:16:22.948527+0000","last_active":"2024-09-18T05:16:43.100966+0000","last_peered":"2024-09-18T05:16:43.100966+0000","last_clean":"2024-09-18T05:16:43.100966+0000","last_became_active":"2024-09-18T05:16:01.898482+0000","last_became_peered":"2024-09-18T05:16:01.898482+0000","last_unstale":"2024-09-18T05:16:43.100966+0000","last_undegraded":"2024-09-18T05:16:43.100966+0000","last_fullsized":"2024-09-18T05:16:43.100966+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:22.456629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015649310000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6584,"num_read_kb":42729,"num_write":374,"num_write_kb":15931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":15236017,"num_keys_recovered":42,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"151'296","reported_seq":4172,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104036+0000","last_change":"2024-09-18T05:16:22.967630+0000","last_active":"2024-09-18T05:16:43.104036+0000","last_peered":"2024-09-18T05:16:43.104036+0000","last_clean":"2024-09-18T05:16:43.104036+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:16:43.104036+0000","last_undegraded":"2024-09-18T05:16:43.104036+0000","last_fullsized":"2024-09-18T05:16:43.104036+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:06:43.114897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062945099999999995,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3697,"num_read_kb":33449,"num_write":292,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"151'633","reported_seq":2727,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201314+0000","last_change":"2024-09-18T05:16:22.966505+0000","last_active":"2024-09-18T05:16:43.201314+0000","last_peered":"2024-09-18T05:16:43.201314+0000","last_clean":"2024-09-18T05:16:43.201314+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:16:43.201314+0000","last_undegraded":"2024-09-18T05:16:43.201314+0000","last_fullsized":"2024-09-18T05:16:43.201314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000499841,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":3587,"num_read_kb":18383,"num_write":752,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"151'299","reported_seq":3368,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101410+0000","last_change":"2024-09-18T05:16:22.949763+0000","last_active":"2024-09-18T05:16:43.101410+0000","last_peered":"2024-09-18T05:16:43.101410+0000","last_clean":"2024-09-18T05:16:43.101410+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:16:43.101410+0000","last_undegraded":"2024-09-18T05:16:43.101410+0000","last_fullsized":"2024-09-18T05:16:43.101410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002578814,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":2832,"num_read_kb":19521,"num_write":259,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"151'471","reported_seq":5189,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202050+0000","last_change":"2024-09-18T05:16:39.081596+0000","last_active":"2024-09-18T05:16:43.202050+0000","last_peered":"2024-09-18T05:16:43.202050+0000","last_clean":"2024-09-18T05:16:43.202050+0000","last_became_active":"2024-09-18T05:16:39.077761+0000","last_became_peered":"2024-09-18T05:16:39.077761+0000","last_unstale":"2024-09-18T05:16:43.202050+0000","last_undegraded":"2024-09-18T05:16:43.202050+0000","last_fullsized":"2024-09-18T05:16:43.202050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:52.136023+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017471631000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5191,"num_read_kb":29963,"num_write":520,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'416","reported_seq":3721,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202864+0000","last_change":"2024-09-18T05:16:22.947578+0000","last_active":"2024-09-18T05:16:43.202864+0000","last_peered":"2024-09-18T05:16:43.202864+0000","last_clean":"2024-09-18T05:16:43.202864+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:16:43.202864+0000","last_undegraded":"2024-09-18T05:16:43.202864+0000","last_fullsized":"2024-09-18T05:16:43.202864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318949999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4121,"num_read_kb":17361,"num_write":391,"num_write_kb":13003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"151'602","reported_seq":5933,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.203158+0000","last_change":"2024-09-18T05:16:22.948118+0000","last_active":"2024-09-18T05:16:43.203158+0000","last_peered":"2024-09-18T05:16:43.203158+0000","last_clean":"2024-09-18T05:16:43.203158+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:16:43.203158+0000","last_undegraded":"2024-09-18T05:16:43.203158+0000","last_fullsized":"2024-09-18T05:16:43.203158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001596606,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":6945,"num_read_kb":34740,"num_write":596,"num_write_kb":4823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"151'555","reported_seq":9087,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101442+0000","last_change":"2024-09-18T05:16:22.950996+0000","last_active":"2024-09-18T05:16:43.101442+0000","last_peered":"2024-09-18T05:16:43.101442+0000","last_clean":"2024-09-18T05:16:43.101442+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:16:43.101442+0000","last_undegraded":"2024-09-18T05:16:43.101442+0000","last_fullsized":"2024-09-18T05:16:43.101442+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031437349999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9783,"num_read_kb":40662,"num_write":558,"num_write_kb":18337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"150'666","reported_seq":4026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201139+0000","last_change":"2024-09-18T05:16:22.966612+0000","last_active":"2024-09-18T05:16:43.201139+0000","last_peered":"2024-09-18T05:16:43.201139+0000","last_clean":"2024-09-18T05:16:43.201139+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:16:43.201139+0000","last_undegraded":"2024-09-18T05:16:43.201139+0000","last_fullsized":"2024-09-18T05:16:43.201139+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056430399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":7033,"num_read_kb":30921,"num_write":767,"num_write_kb":9608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'442","reported_seq":3800,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202498+0000","last_change":"2024-09-18T05:16:22.946942+0000","last_active":"2024-09-18T05:16:43.202498+0000","last_peered":"2024-09-18T05:16:43.202498+0000","last_clean":"2024-09-18T05:16:43.202498+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:16:43.202498+0000","last_undegraded":"2024-09-18T05:16:43.202498+0000","last_fullsized":"2024-09-18T05:16:43.202498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084174599999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":4545,"num_read_kb":16351,"num_write":465,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"150'667","reported_seq":3026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199197+0000","last_change":"2024-09-18T05:16:22.951854+0000","last_active":"2024-09-18T05:16:43.199197+0000","last_peered":"2024-09-18T05:16:43.199197+0000","last_clean":"2024-09-18T05:16:43.199197+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:16:43.199197+0000","last_undegraded":"2024-09-18T05:16:43.199197+0000","last_fullsized":"2024-09-18T05:16:43.199197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:11:59.565963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001575814,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":5022,"num_read_kb":16163,"num_write":742,"num_write_kb":7893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"151'854","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202677+0000","last_change":"2024-09-18T05:16:22.946967+0000","last_active":"2024-09-18T05:16:43.202677+0000","last_peered":"2024-09-18T05:16:43.202677+0000","last_clean":"2024-09-18T05:16:43.202677+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:16:43.202677+0000","last_undegraded":"2024-09-18T05:16:43.202677+0000","last_fullsized":"2024-09-18T05:16:43.202677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078209799999999995,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":5820,"num_read_kb":22805,"num_write":1246,"num_write_kb":8989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":358,"num_object_clones":0,"num_object_copies":716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":354,"num_read":182619,"num_read_kb":921779,"num_write":21835,"num_write_kb":363496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6486,"internal_metadata":0},"log_size":19129,"ondisk_log_size":19129,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.88100000000000001},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.143,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94299999999999995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.875}]},{"osd":1,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.88600000000000001,"15min":0.92800000000000005},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1539999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.86599999999999999,"15min":0.91900000000000004},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2809999999999999,"5min":1.583,"15min":1.583},"last":1.0660000000000001}]},{"osd":2,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.073,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.008,"15min":1.036},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2070000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.048}]},{"osd":3,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.208,"5min":1.925,"15min":1.925},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.99099999999999999,"15min":1.0429999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.411,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.2949999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":1.071},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.282,"5min":3.488,"15min":3.488},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.89900000000000002,"15min":0.94199999999999995},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":2.512,"15min":2.512},"last":0.753}]},{"osd":5,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":1.071,"15min":1.1499999999999999},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3959999999999999,"5min":3.069,"15min":3.069},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.05,"15min":1.111},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:16:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.403,"5min":1.615,"15min":1.615},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.091,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6499999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.91500000000000004}]}]},{"osd":6,"up_from":61,"seq":261993005083,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34344,"kb_used_data":2012,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94337496,"statfs":{"total":96636764160,"available":96601595904,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.82299999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.052}]},{"osd":4,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.97899999999999998}]},{"osd":5,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:15:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.90300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55276,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316564,"statfs":{"total":96636764160,"available":96580161536,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.131,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.107}]},{"osd":1,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.103,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.82299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1220000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.502,"15min":1.502},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.216,"5min":1.804,"15min":1.804},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.80600000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.345,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85899999999999999,"15min":0.86899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3180000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.024}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4339999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.96299999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.97599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2649999999999999,"5min":1.879,"15min":1.879},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.377,"5min":1.742,"15min":1.742},"last":1.214}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59372,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312468,"statfs":{"total":96636764160,"available":96575967232,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.86499999999999999},"min":{"1min":0.434,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.23,"5min":2.827,"15min":2.827},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":1.0580000000000001}]},{"osd":1,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.48799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0109999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.087},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.88800000000000001,"15min":0.95299999999999996},"min":{"1min":0.47499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.028,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.034}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1859999999999999,"5min":1.365,"15min":1.365},"last":0.97499999999999998}]},{"osd":3,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.48799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1220000000000001,"5min":1.133,"15min":1.133},"last":1.004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.125,"5min":4.282,"15min":4.282},"last":0.90300000000000002}]},{"osd":5,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.50600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.123,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.621},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.38900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed Sep 18 05:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1519999999999999,"5min":1.381,"15min":1.381},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":1.0109999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.413,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77424,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94294416,"statfs":{"total":96636764160,"available":96557481984,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2649999999999999,"5min":1.276,"15min":1.276},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.024,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1579999999999999,"5min":1.379,"15min":1.379},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1459999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.93100000000000005},"min":{"1min":0.5,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90800000000000003,"15min":0.92200000000000004},"min":{"1min":0.71499999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.373,"15min":1.373},"last":0.86199999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.73999999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5740000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.052},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.304,"5min":2.722,"15min":2.722},"last":0.95899999999999996}]}]},{"osd":2,"up_from":123,"seq":528280977421,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30248,"kb_used_data":2012,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341592,"statfs":{"total":96636764160,"available":96605790208,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2068480,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.82299999999999995,"15min":0.72499999999999998},"min":{"1min":0.312,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.087,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0629999999999999,"5min":1.978,"15min":1.978},"last":0.65900000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.3879999999999999,"5min":0.85999999999999999,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":0.79100000000000004}]},{"osd":3,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.92900000000000005,"15min":0.84099999999999997},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3340000000000001,"5min":17.638999999999999,"15min":17.638999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.96899999999999997,"15min":0.82999999999999996},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1970000000000001,"5min":19.489999999999998,"15min":19.489999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.871,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.454,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.90700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0669999999999999,"5min":1.762,"15min":1.762},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.071},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":14.198,"15min":14.198},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.90500000000000003,"15min":0.88700000000000001},"min":{"1min":0.60099999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.874},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3819999999999999,"5min":1.446,"15min":1.446},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.1619999999999999,"15min":1.0940000000000001},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6659999999999999,"5min":14.234,"15min":14.234},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0049999999999999,"15min":1.022},"min":{"1min":0.69099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.496,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.77400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59436,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312404,"statfs":{"total":96636764160,"available":96575901696,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.226,"5min":1.829,"15min":1.829},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.4379999999999999,"5min":2.25,"15min":2.25},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1579999999999999,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84399999999999997,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3899999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.47599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.76300000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90300000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.278,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.877},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.579,"5min":1.911,"15min":1.911},"last":1.141}]},{"osd":6,"last update":"Wed Sep 18 05:16:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.095,"5min":0.90700000000000003,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.073}]},{"osd":7,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97999999999999998,"15min":1.012},"min":{"1min":0.622,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.546,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.054},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0569999999999999,"15min":1.0700000000000001},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4610000000000001,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.0029999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:16:50.408 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T05:16:50.707 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:50.707 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":171,"fsid":"04ac0d2c-34bd-46ad-a307-a4eb23236eb4","created":"2024-09-18T05:13:15.193498+0000","modified":"2024-09-18T05:16:44.105283+0000","last_up_change":"2024-09-18T05:15:54.176883+0000","last_in_change":"2024-09-18T05:13:18.221936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T05:13:28.629114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T05:13:34.103981+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-18T05:13:44.114945+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":95,"snap_epoch":152,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2a580f7-2bbc-46c3-b6b5-5a9e93539d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6801","nonce":1558450642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6803","nonce":1558450642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6807","nonce":1558450642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1558450642},{"type":"v1","addr":"172.21.15.17:6805","nonce":1558450642}]},"public_addr":"172.21.15.17:6801/1558450642","cluster_addr":"172.21.15.17:6803/1558450642","heartbeat_back_addr":"172.21.15.17:6807/1558450642","heartbeat_front_addr":"172.21.15.17:6805/1558450642","state":["exists","up"]},{"osd":1,"uuid":"260da429-e6eb-446b-95a0-dcf4581bb584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6809","nonce":3444575073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6811","nonce":3444575073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6815","nonce":3444575073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3444575073},{"type":"v1","addr":"172.21.15.17:6813","nonce":3444575073}]},"public_addr":"172.21.15.17:6809/3444575073","cluster_addr":"172.21.15.17:6811/3444575073","heartbeat_back_addr":"172.21.15.17:6815/3444575073","heartbeat_front_addr":"172.21.15.17:6813/3444575073","state":["exists","up"]},{"osd":2,"uuid":"0cf5d53a-552d-4775-8437-86af3465b1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":100,"up_from":123,"up_thru":136,"down_at":101,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6817","nonce":1738914066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6819","nonce":1738914066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6823","nonce":1738914066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1738914066},{"type":"v1","addr":"172.21.15.17:6821","nonce":1738914066}]},"public_addr":"172.21.15.17:6817/1738914066","cluster_addr":"172.21.15.17:6819/1738914066","heartbeat_back_addr":"172.21.15.17:6823/1738914066","heartbeat_front_addr":"172.21.15.17:6821/1738914066","state":["exists","up"]},{"osd":3,"uuid":"73bc18b6-4972-4164-a294-b6372bcf9f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6825","nonce":3763834627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6827","nonce":3763834627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6831","nonce":3763834627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3763834627},{"type":"v1","addr":"172.21.15.17:6829","nonce":3763834627}]},"public_addr":"172.21.15.17:6825/3763834627","cluster_addr":"172.21.15.17:6827/3763834627","heartbeat_back_addr":"172.21.15.17:6831/3763834627","heartbeat_front_addr":"172.21.15.17:6829/3763834627","state":["exists","up"]},{"osd":4,"uuid":"536c8ef2-eca6-44b4-a70c-06f191eb5ff1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6802","nonce":1703780253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6806","nonce":1703780253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6819","nonce":1703780253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":1703780253},{"type":"v1","addr":"172.21.15.86:6812","nonce":1703780253}]},"public_addr":"172.21.15.86:6802/1703780253","cluster_addr":"172.21.15.86:6806/1703780253","heartbeat_back_addr":"172.21.15.86:6819/1703780253","heartbeat_front_addr":"172.21.15.86:6812/1703780253","state":["exists","up"]},{"osd":5,"uuid":"4341bba4-2913-4352-89d4-36fa18ee39cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6811","nonce":3348904742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6816","nonce":3348904742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6823","nonce":3348904742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":3348904742},{"type":"v1","addr":"172.21.15.86:6820","nonce":3348904742}]},"public_addr":"172.21.15.86:6811/3348904742","cluster_addr":"172.21.15.86:6816/3348904742","heartbeat_back_addr":"172.21.15.86:6823/3348904742","heartbeat_front_addr":"172.21.15.86:6820/3348904742","state":["exists","up"]},{"osd":6,"uuid":"e47d4aad-9c4b-43a9-9b32-2db463ec2a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":47,"up_from":61,"up_thru":131,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6801","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6803","nonce":3446120186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6807","nonce":3446120186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6821","nonce":3446120186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3446120186},{"type":"v1","addr":"172.21.15.86:6814","nonce":3446120186}]},"public_addr":"172.21.15.86:6803/3446120186","cluster_addr":"172.21.15.86:6807/3446120186","heartbeat_back_addr":"172.21.15.86:6821/3446120186","heartbeat_front_addr":"172.21.15.86:6814/3446120186","state":["exists","up"]},{"osd":7,"uuid":"686d275c-e592-44c1-87f9-ac9718f3a112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6825","nonce":1345159853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6827","nonce":1345159853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6831","nonce":1345159853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1345159853},{"type":"v1","addr":"172.21.15.86:6829","nonce":1345159853}]},"public_addr":"172.21.15.86:6825/1345159853","cluster_addr":"172.21.15.86:6827/1345159853","heartbeat_back_addr":"172.21.15.86:6831/1345159853","heartbeat_front_addr":"172.21.15.86:6829/1345159853","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.758535+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.800715+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.783374+0000","dead_epoch":101},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.779519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.893837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.776852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.919808+0000","dead_epoch":48},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T05:13:23.883599+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[1,5]}],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T05:16:51.727 INFO:tasks.ceph:Scrubbing osd.0 2024-09-18T05:16:51.728 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-18T05:16:51.893 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:51.894 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T05:16:51.894 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:51.911 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-18T05:16:52.200 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2024-09-18T05:16:52.218 INFO:tasks.ceph:Scrubbing osd.1 2024-09-18T05:16:52.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-18T05:16:52.367 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:52.367 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T05:16:52.368 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:52.383 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-18T05:16:52.670 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2024-09-18T05:16:52.689 INFO:tasks.ceph:Scrubbing osd.2 2024-09-18T05:16:52.690 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-18T05:16:52.847 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:52.847 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T05:16:52.847 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:52.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-18T05:16:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2024-09-18T05:16:53.171 INFO:tasks.ceph:Scrubbing osd.3 2024-09-18T05:16:53.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-18T05:16:53.311 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T05:16:53.311 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:53.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-18T05:16:53.610 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2024-09-18T05:16:53.628 INFO:tasks.ceph:Scrubbing osd.4 2024-09-18T05:16:53.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-18T05:16:53.778 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:53.778 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T05:16:53.778 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:53.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-18T05:16:54.086 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 4 to deep-scrub 2024-09-18T05:16:54.106 INFO:tasks.ceph:Scrubbing osd.5 2024-09-18T05:16:54.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-18T05:16:54.258 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:54.258 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T05:16:54.258 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:54.275 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-18T05:16:54.560 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 5 to deep-scrub 2024-09-18T05:16:54.580 INFO:tasks.ceph:Scrubbing osd.6 2024-09-18T05:16:54.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-18T05:16:54.731 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:54.731 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T05:16:54.732 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:54.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-18T05:16:55.025 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 6 to deep-scrub 2024-09-18T05:16:55.043 INFO:tasks.ceph:Scrubbing osd.7 2024-09-18T05:16:55.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-18T05:16:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-18T05:16:55.184 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T05:16:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-18T05:16:55.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-18T05:16:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 7 to deep-scrub 2024-09-18T05:16:55.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:16:55.807 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:16:55.808 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:16:55.826 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-09-18T05:16:54.606591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":362,"num_object_clones":0,"num_object_copies":724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":362,"num_whiteouts":354,"num_read":182735,"num_read_kb":921879,"num_write":21996,"num_write_kb":365914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19249,"ondisk_log_size":19249,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400476,"kb_used_data":16240,"kb_used_omap":29,"kb_used_meta":384098,"kb_avail":754574244,"statfs":{"total":773094113280,"available":772684025856,"internally_reserved":0,"allocated":16629760,"data_stored":9114916,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":29988,"internal_metadata":393317084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.497532"},"pg_stats":[{"pgid":"3.1f","version":"152'705","reported_seq":2819,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.113215+0000","last_change":"2024-09-18T05:16:22.952279+0000","last_active":"2024-09-18T05:16:44.113215+0000","last_peered":"2024-09-18T05:16:44.113215+0000","last_clean":"2024-09-18T05:16:44.113215+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:16:44.113215+0000","last_undegraded":"2024-09-18T05:16:44.113215+0000","last_fullsized":"2024-09-18T05:16:44.113215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069029300000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4139,"num_read_kb":20195,"num_write":907,"num_write_kb":9329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"151'1446","reported_seq":6945,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101179+0000","last_change":"2024-09-18T05:16:22.950489+0000","last_active":"2024-09-18T05:16:43.101179+0000","last_peered":"2024-09-18T05:16:43.101179+0000","last_clean":"2024-09-18T05:16:43.101179+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:16:43.101179+0000","last_undegraded":"2024-09-18T05:16:43.101179+0000","last_fullsized":"2024-09-18T05:16:43.101179+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:21.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031115520000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":11552,"num_read_kb":29398,"num_write":2219,"num_write_kb":10724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"151'500","reported_seq":2613,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202135+0000","last_change":"2024-09-18T05:16:39.081650+0000","last_active":"2024-09-18T05:16:43.202135+0000","last_peered":"2024-09-18T05:16:43.202135+0000","last_clean":"2024-09-18T05:16:43.202135+0000","last_became_active":"2024-09-18T05:16:39.078161+0000","last_became_peered":"2024-09-18T05:16:39.078161+0000","last_unstale":"2024-09-18T05:16:43.202135+0000","last_undegraded":"2024-09-18T05:16:43.202135+0000","last_fullsized":"2024-09-18T05:16:43.202135+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:44:58.056260+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0077051680000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3418,"num_read_kb":20008,"num_write":499,"num_write_kb":11307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"152'957","reported_seq":4756,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201751+0000","last_change":"2024-09-18T05:16:39.081624+0000","last_active":"2024-09-18T05:16:43.201751+0000","last_peered":"2024-09-18T05:16:43.201751+0000","last_clean":"2024-09-18T05:16:43.201751+0000","last_became_active":"2024-09-18T05:16:39.078258+0000","last_became_peered":"2024-09-18T05:16:39.078258+0000","last_unstale":"2024-09-18T05:16:43.201751+0000","last_undegraded":"2024-09-18T05:16:43.201751+0000","last_fullsized":"2024-09-18T05:16:43.201751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:23.450501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078280600000000004,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":14,"num_read":7245,"num_read_kb":33079,"num_write":1238,"num_write_kb":14791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"151'402","reported_seq":2488,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.113656+0000","last_change":"2024-09-18T05:16:22.954184+0000","last_active":"2024-09-18T05:16:44.113656+0000","last_peered":"2024-09-18T05:16:44.113656+0000","last_clean":"2024-09-18T05:16:44.113656+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:16:44.113656+0000","last_undegraded":"2024-09-18T05:16:44.113656+0000","last_fullsized":"2024-09-18T05:16:44.113656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074971399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2723,"num_read_kb":17099,"num_write":364,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"151'429","reported_seq":6379,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.103891+0000","last_change":"2024-09-18T05:16:22.967762+0000","last_active":"2024-09-18T05:16:43.103891+0000","last_peered":"2024-09-18T05:16:43.103891+0000","last_clean":"2024-09-18T05:16:43.103891+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:16:43.103891+0000","last_undegraded":"2024-09-18T05:16:43.103891+0000","last_fullsized":"2024-09-18T05:16:43.103891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:50.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071492300000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":5935,"num_read_kb":45781,"num_write":417,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"152'566","reported_seq":5849,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198800+0000","last_change":"2024-09-18T05:16:22.956775+0000","last_active":"2024-09-18T05:16:43.198800+0000","last_peered":"2024-09-18T05:16:43.198800+0000","last_clean":"2024-09-18T05:16:43.198800+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:16:43.198800+0000","last_undegraded":"2024-09-18T05:16:43.198800+0000","last_fullsized":"2024-09-18T05:16:43.198800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:17:33.793075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055068100000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8335,"num_read_kb":20827,"num_write":497,"num_write_kb":15047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"151'863","reported_seq":2720,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101173+0000","last_change":"2024-09-18T05:16:22.948825+0000","last_active":"2024-09-18T05:16:43.101173+0000","last_peered":"2024-09-18T05:16:43.101173+0000","last_clean":"2024-09-18T05:16:43.101173+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:16:43.101173+0000","last_undegraded":"2024-09-18T05:16:43.101173+0000","last_fullsized":"2024-09-18T05:16:43.101173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:52:53.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001816465,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4198,"num_read_kb":22346,"num_write":1180,"num_write_kb":9146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'583","reported_seq":7224,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.113466+0000","last_change":"2024-09-18T05:16:22.953058+0000","last_active":"2024-09-18T05:16:44.113466+0000","last_peered":"2024-09-18T05:16:44.113466+0000","last_clean":"2024-09-18T05:16:44.113466+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:16:44.113466+0000","last_undegraded":"2024-09-18T05:16:44.113466+0000","last_fullsized":"2024-09-18T05:16:44.113466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012193429999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8338,"num_read_kb":33067,"num_write":470,"num_write_kb":10649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'656","reported_seq":8296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202132+0000","last_change":"2024-09-18T05:16:22.963058+0000","last_active":"2024-09-18T05:16:43.202132+0000","last_peered":"2024-09-18T05:16:43.202132+0000","last_clean":"2024-09-18T05:16:43.202132+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:16:43.202132+0000","last_undegraded":"2024-09-18T05:16:43.202132+0000","last_fullsized":"2024-09-18T05:16:43.202132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:01:33.447407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655983,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9449,"num_read_kb":47880,"num_write":679,"num_write_kb":15057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"151'746","reported_seq":6974,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202806+0000","last_change":"2024-09-18T05:16:22.947810+0000","last_active":"2024-09-18T05:16:43.202806+0000","last_peered":"2024-09-18T05:16:43.202806+0000","last_clean":"2024-09-18T05:16:43.202806+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:16:43.202806+0000","last_undegraded":"2024-09-18T05:16:43.202806+0000","last_fullsized":"2024-09-18T05:16:43.202806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:31.794131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013431739999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":8031,"num_read_kb":49145,"num_write":1033,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"151'399","reported_seq":2296,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104237+0000","last_change":"2024-09-18T05:16:22.968983+0000","last_active":"2024-09-18T05:16:43.104237+0000","last_peered":"2024-09-18T05:16:43.104237+0000","last_clean":"2024-09-18T05:16:43.104237+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:16:43.104237+0000","last_undegraded":"2024-09-18T05:16:43.104237+0000","last_fullsized":"2024-09-18T05:16:43.104237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:25.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010340900000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":2061,"num_read_kb":19662,"num_write":411,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.621023+0000","last_change":"2024-09-18T05:16:02.923317+0000","last_active":"2024-09-18T05:16:44.621023+0000","last_peered":"2024-09-18T05:16:44.621023+0000","last_clean":"2024-09-18T05:16:44.621023+0000","last_became_active":"2024-09-18T05:16:02.922394+0000","last_became_peered":"2024-09-18T05:16:02.922394+0000","last_unstale":"2024-09-18T05:16:44.621023+0000","last_undegraded":"2024-09-18T05:16:44.621023+0000","last_fullsized":"2024-09-18T05:16:44.621023+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:34.150689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"152'577","reported_seq":3710,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.113318+0000","last_change":"2024-09-18T05:16:22.953341+0000","last_active":"2024-09-18T05:16:44.113318+0000","last_peered":"2024-09-18T05:16:44.113318+0000","last_clean":"2024-09-18T05:16:44.113318+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:16:44.113318+0000","last_undegraded":"2024-09-18T05:16:44.113318+0000","last_fullsized":"2024-09-18T05:16:44.113318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015023230000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":4591,"num_read_kb":29240,"num_write":682,"num_write_kb":13080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199016+0000","last_change":"2024-09-18T05:14:41.098275+0000","last_active":"2024-09-18T05:16:43.199016+0000","last_peered":"2024-09-18T05:16:43.199016+0000","last_clean":"2024-09-18T05:16:43.199016+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:16:43.199016+0000","last_undegraded":"2024-09-18T05:16:43.199016+0000","last_fullsized":"2024-09-18T05:16:43.199016+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:52.778975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"152'533","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101657+0000","last_change":"2024-09-18T05:16:22.951905+0000","last_active":"2024-09-18T05:16:43.101657+0000","last_peered":"2024-09-18T05:16:43.101657+0000","last_clean":"2024-09-18T05:16:43.101657+0000","last_became_active":"2024-09-18T05:16:19.904499+0000","last_became_peered":"2024-09-18T05:16:19.904499+0000","last_unstale":"2024-09-18T05:16:43.101657+0000","last_undegraded":"2024-09-18T05:16:43.101657+0000","last_fullsized":"2024-09-18T05:16:43.101657+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:10:44.782963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00364015,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3679,"num_read_kb":33211,"num_write":613,"num_write_kb":10118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":7448296,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202988+0000","last_change":"2024-09-18T05:13:37.986618+0000","last_active":"2024-09-18T05:16:43.202988+0000","last_peered":"2024-09-18T05:16:43.202988+0000","last_clean":"2024-09-18T05:16:43.202988+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:16:43.202988+0000","last_undegraded":"2024-09-18T05:16:43.202988+0000","last_fullsized":"2024-09-18T05:16:43.202988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:46.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"150'420","reported_seq":6024,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199233+0000","last_change":"2024-09-18T05:16:22.957252+0000","last_active":"2024-09-18T05:16:43.199233+0000","last_peered":"2024-09-18T05:16:43.199233+0000","last_clean":"2024-09-18T05:16:43.199233+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:16:43.199233+0000","last_undegraded":"2024-09-18T05:16:43.199233+0000","last_fullsized":"2024-09-18T05:16:43.199233+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:46.818280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060223399999999999,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":6557,"num_read_kb":27685,"num_write":436,"num_write_kb":9094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.199291+0000","last_change":"2024-09-18T05:13:37.896648+0000","last_active":"2024-09-18T05:16:43.199291+0000","last_peered":"2024-09-18T05:16:43.199291+0000","last_clean":"2024-09-18T05:16:43.199291+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:16:43.199291+0000","last_undegraded":"2024-09-18T05:16:43.199291+0000","last_fullsized":"2024-09-18T05:16:43.199291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:45.531657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"151'459","reported_seq":6025,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202438+0000","last_change":"2024-09-18T05:16:39.081593+0000","last_active":"2024-09-18T05:16:43.202438+0000","last_peered":"2024-09-18T05:16:43.202438+0000","last_clean":"2024-09-18T05:16:43.202438+0000","last_became_active":"2024-09-18T05:16:39.077813+0000","last_became_peered":"2024-09-18T05:16:39.077813+0000","last_unstale":"2024-09-18T05:16:43.202438+0000","last_undegraded":"2024-09-18T05:16:43.202438+0000","last_fullsized":"2024-09-18T05:16:43.202438+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:26:16.213994+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.032776543999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5840,"num_read_kb":39783,"num_write":450,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"152'1164","reported_seq":4989,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104129+0000","last_change":"2024-09-18T05:16:22.969058+0000","last_active":"2024-09-18T05:16:43.104129+0000","last_peered":"2024-09-18T05:16:43.104129+0000","last_clean":"2024-09-18T05:16:43.104129+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:16:43.104129+0000","last_undegraded":"2024-09-18T05:16:43.104129+0000","last_fullsized":"2024-09-18T05:16:43.104129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:45:54.839626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011154260000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":6871,"num_read_kb":44276,"num_write":1455,"num_write_kb":20060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":81,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201766+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201766+0000","last_peered":"2024-09-18T05:16:43.201766+0000","last_clean":"2024-09-18T05:16:43.201766+0000","last_became_active":"2024-09-18T05:16:39.076198+0000","last_became_peered":"2024-09-18T05:16:39.076198+0000","last_unstale":"2024-09-18T05:16:43.201766+0000","last_undegraded":"2024-09-18T05:16:43.201766+0000","last_fullsized":"2024-09-18T05:16:43.201766+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:48:58.557656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'438","reported_seq":4750,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198784+0000","last_change":"2024-09-18T05:16:22.956747+0000","last_active":"2024-09-18T05:16:43.198784+0000","last_peered":"2024-09-18T05:16:43.198784+0000","last_clean":"2024-09-18T05:16:43.198784+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:16:43.198784+0000","last_undegraded":"2024-09-18T05:16:43.198784+0000","last_fullsized":"2024-09-18T05:16:43.198784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:45:12.320367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037471100000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":4862,"num_read_kb":21776,"num_write":386,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":116,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.618755+0000","last_change":"2024-09-18T05:15:55.216600+0000","last_active":"2024-09-18T05:16:44.618755+0000","last_peered":"2024-09-18T05:16:44.618755+0000","last_clean":"2024-09-18T05:16:44.618755+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:16:44.618755+0000","last_undegraded":"2024-09-18T05:16:44.618755+0000","last_fullsized":"2024-09-18T05:16:44.618755+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"151'363","reported_seq":2477,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.113066+0000","last_change":"2024-09-18T05:16:22.951266+0000","last_active":"2024-09-18T05:16:44.113066+0000","last_peered":"2024-09-18T05:16:44.113066+0000","last_clean":"2024-09-18T05:16:44.113066+0000","last_became_active":"2024-09-18T05:16:01.899154+0000","last_became_peered":"2024-09-18T05:16:01.899154+0000","last_unstale":"2024-09-18T05:16:44.113066+0000","last_undegraded":"2024-09-18T05:16:44.113066+0000","last_fullsized":"2024-09-18T05:16:44.113066+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032123,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":2135,"num_read_kb":5505,"num_write":365,"num_write_kb":5251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":2091093,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202445+0000","last_change":"2024-09-18T05:13:37.986282+0000","last_active":"2024-09-18T05:16:43.202445+0000","last_peered":"2024-09-18T05:16:43.202445+0000","last_clean":"2024-09-18T05:16:43.202445+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:16:43.202445+0000","last_undegraded":"2024-09-18T05:16:43.202445+0000","last_fullsized":"2024-09-18T05:16:43.202445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:12.938972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"151'596","reported_seq":5170,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.198896+0000","last_change":"2024-09-18T05:16:22.957237+0000","last_active":"2024-09-18T05:16:43.198896+0000","last_peered":"2024-09-18T05:16:43.198896+0000","last_clean":"2024-09-18T05:16:43.198896+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:16:43.198896+0000","last_undegraded":"2024-09-18T05:16:43.198896+0000","last_fullsized":"2024-09-18T05:16:43.198896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:22:34.025479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083719899999999995,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7500,"num_read_kb":38768,"num_write":572,"num_write_kb":10748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":106,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201713+0000","last_change":"2024-09-18T05:16:39.076850+0000","last_active":"2024-09-18T05:16:43.201713+0000","last_peered":"2024-09-18T05:16:43.201713+0000","last_clean":"2024-09-18T05:16:43.201713+0000","last_became_active":"2024-09-18T05:16:39.075931+0000","last_became_peered":"2024-09-18T05:16:39.075931+0000","last_unstale":"2024-09-18T05:16:43.201713+0000","last_undegraded":"2024-09-18T05:16:43.201713+0000","last_fullsized":"2024-09-18T05:16:43.201713+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:34.847939+0000","last_clean_scrub_stamp":"2024-09-18T05:13:34.847939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:06.991206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202783+0000","last_change":"2024-09-18T05:13:29.842735+0000","last_active":"2024-09-18T05:16:43.202783+0000","last_peered":"2024-09-18T05:16:43.202783+0000","last_clean":"2024-09-18T05:16:43.202783+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:16:43.202783+0000","last_undegraded":"2024-09-18T05:16:43.202783+0000","last_fullsized":"2024-09-18T05:16:43.202783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:28.816532+0000","last_clean_scrub_stamp":"2024-09-18T05:13:28.816532+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:43:50.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"152'426","reported_seq":5316,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.100966+0000","last_change":"2024-09-18T05:16:22.948527+0000","last_active":"2024-09-18T05:16:43.100966+0000","last_peered":"2024-09-18T05:16:43.100966+0000","last_clean":"2024-09-18T05:16:43.100966+0000","last_became_active":"2024-09-18T05:16:01.898482+0000","last_became_peered":"2024-09-18T05:16:01.898482+0000","last_unstale":"2024-09-18T05:16:43.100966+0000","last_undegraded":"2024-09-18T05:16:43.100966+0000","last_fullsized":"2024-09-18T05:16:43.100966+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:22.456629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015649310000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6584,"num_read_kb":42729,"num_write":374,"num_write_kb":15931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":15236017,"num_keys_recovered":42,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"151'296","reported_seq":4172,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.104036+0000","last_change":"2024-09-18T05:16:22.967630+0000","last_active":"2024-09-18T05:16:43.104036+0000","last_peered":"2024-09-18T05:16:43.104036+0000","last_clean":"2024-09-18T05:16:43.104036+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:16:43.104036+0000","last_undegraded":"2024-09-18T05:16:43.104036+0000","last_fullsized":"2024-09-18T05:16:43.104036+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:06:43.114897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062945099999999995,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3697,"num_read_kb":33449,"num_write":292,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"151'633","reported_seq":2728,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.620957+0000","last_change":"2024-09-18T05:16:22.966505+0000","last_active":"2024-09-18T05:16:44.620957+0000","last_peered":"2024-09-18T05:16:44.620957+0000","last_clean":"2024-09-18T05:16:44.620957+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:16:44.620957+0000","last_undegraded":"2024-09-18T05:16:44.620957+0000","last_fullsized":"2024-09-18T05:16:44.620957+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:44:32.406136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000499841,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":3587,"num_read_kb":18383,"num_write":752,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"151'299","reported_seq":3368,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101410+0000","last_change":"2024-09-18T05:16:22.949763+0000","last_active":"2024-09-18T05:16:43.101410+0000","last_peered":"2024-09-18T05:16:43.101410+0000","last_clean":"2024-09-18T05:16:43.101410+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:16:43.101410+0000","last_undegraded":"2024-09-18T05:16:43.101410+0000","last_fullsized":"2024-09-18T05:16:43.101410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:49.424531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002578814,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":2832,"num_read_kb":19521,"num_write":259,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"151'471","reported_seq":5189,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202050+0000","last_change":"2024-09-18T05:16:39.081596+0000","last_active":"2024-09-18T05:16:43.202050+0000","last_peered":"2024-09-18T05:16:43.202050+0000","last_clean":"2024-09-18T05:16:43.202050+0000","last_became_active":"2024-09-18T05:16:39.077761+0000","last_became_peered":"2024-09-18T05:16:39.077761+0000","last_unstale":"2024-09-18T05:16:43.202050+0000","last_undegraded":"2024-09-18T05:16:43.202050+0000","last_fullsized":"2024-09-18T05:16:43.202050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:52.136023+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017471631000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5191,"num_read_kb":29963,"num_write":520,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'416","reported_seq":3721,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202864+0000","last_change":"2024-09-18T05:16:22.947578+0000","last_active":"2024-09-18T05:16:43.202864+0000","last_peered":"2024-09-18T05:16:43.202864+0000","last_clean":"2024-09-18T05:16:43.202864+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:16:43.202864+0000","last_undegraded":"2024-09-18T05:16:43.202864+0000","last_fullsized":"2024-09-18T05:16:43.202864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:14:44.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318949999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4121,"num_read_kb":17361,"num_write":391,"num_write_kb":13003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"151'602","reported_seq":5933,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.203158+0000","last_change":"2024-09-18T05:16:22.948118+0000","last_active":"2024-09-18T05:16:43.203158+0000","last_peered":"2024-09-18T05:16:43.203158+0000","last_clean":"2024-09-18T05:16:43.203158+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:16:43.203158+0000","last_undegraded":"2024-09-18T05:16:43.203158+0000","last_fullsized":"2024-09-18T05:16:43.203158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:06.939394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001596606,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":6945,"num_read_kb":34740,"num_write":596,"num_write_kb":4823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"151'555","reported_seq":9087,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.101442+0000","last_change":"2024-09-18T05:16:22.950996+0000","last_active":"2024-09-18T05:16:43.101442+0000","last_peered":"2024-09-18T05:16:43.101442+0000","last_clean":"2024-09-18T05:16:43.101442+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:16:43.101442+0000","last_undegraded":"2024-09-18T05:16:43.101442+0000","last_fullsized":"2024-09-18T05:16:43.101442+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:25:11.122981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031437349999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9783,"num_read_kb":40662,"num_write":558,"num_write_kb":18337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"150'666","reported_seq":4026,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.201139+0000","last_change":"2024-09-18T05:16:22.966612+0000","last_active":"2024-09-18T05:16:43.201139+0000","last_peered":"2024-09-18T05:16:43.201139+0000","last_clean":"2024-09-18T05:16:43.201139+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:16:43.201139+0000","last_undegraded":"2024-09-18T05:16:43.201139+0000","last_fullsized":"2024-09-18T05:16:43.201139+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:32.891180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056430399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":7033,"num_read_kb":30921,"num_write":767,"num_write_kb":9608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'442","reported_seq":3800,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202498+0000","last_change":"2024-09-18T05:16:22.946942+0000","last_active":"2024-09-18T05:16:43.202498+0000","last_peered":"2024-09-18T05:16:43.202498+0000","last_clean":"2024-09-18T05:16:43.202498+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:16:43.202498+0000","last_undegraded":"2024-09-18T05:16:43.202498+0000","last_fullsized":"2024-09-18T05:16:43.202498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:11.872291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084174599999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":4545,"num_read_kb":16351,"num_write":465,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"150'667","reported_seq":3027,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.113262+0000","last_change":"2024-09-18T05:16:22.951854+0000","last_active":"2024-09-18T05:16:44.113262+0000","last_peered":"2024-09-18T05:16:44.113262+0000","last_clean":"2024-09-18T05:16:44.113262+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:16:44.113262+0000","last_undegraded":"2024-09-18T05:16:44.113262+0000","last_fullsized":"2024-09-18T05:16:44.113262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001575814,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":5022,"num_read_kb":16163,"num_write":742,"num_write_kb":7893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"151'854","reported_seq":3183,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-18T05:16:43.202677+0000","last_change":"2024-09-18T05:16:22.946967+0000","last_active":"2024-09-18T05:16:43.202677+0000","last_peered":"2024-09-18T05:16:43.202677+0000","last_clean":"2024-09-18T05:16:43.202677+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:16:43.202677+0000","last_undegraded":"2024-09-18T05:16:43.202677+0000","last_fullsized":"2024-09-18T05:16:43.202677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:05.361822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078209799999999995,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":5820,"num_read_kb":22805,"num_write":1246,"num_write_kb":8989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":358,"num_object_clones":0,"num_object_copies":716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":354,"num_read":182619,"num_read_kb":921779,"num_write":21835,"num_write_kb":363496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6486,"internal_metadata":0},"log_size":19129,"ondisk_log_size":19129,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.88100000000000001},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.143,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94299999999999995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.88600000000000001,"15min":0.92800000000000005},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1539999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.86599999999999999,"15min":0.91900000000000004},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2809999999999999,"5min":1.583,"15min":1.583},"last":0.78900000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:15:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.073,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.008,"15min":1.036},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2070000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.91200000000000003}]},{"osd":3,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.208,"5min":1.925,"15min":1.925},"last":1.099},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.99099999999999999,"15min":1.0429999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.411,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.1399999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":1.071},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.282,"5min":3.488,"15min":3.488},"last":1.175},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.89900000000000002,"15min":0.94199999999999995},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":2.512,"15min":2.512},"last":1.222}]},{"osd":5,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":1.071,"15min":1.1499999999999999},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3959999999999999,"5min":3.069,"15min":3.069},"last":1.256},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.05,"15min":1.111},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":1.2829999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:16:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.403,"5min":1.615,"15min":1.615},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.091,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6499999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3400000000000001}]}]},{"osd":6,"up_from":61,"seq":261993005085,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34344,"kb_used_data":2012,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94337496,"statfs":{"total":96636764160,"available":96601595904,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.71299999999999997,"15min":0.68700000000000006},"min":{"1min":0.48499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.72199999999999998,"15min":0.69399999999999995},"min":{"1min":0.58299999999999996,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.72399999999999998}]},{"osd":1,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.71799999999999997,"15min":0.69799999999999995},"min":{"1min":0.52300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.80500000000000005,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.238,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.84699999999999998,"15min":0.82499999999999996},"min":{"1min":0.496,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.89100000000000001}]},{"osd":4,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.73699999999999999,"15min":0.71599999999999997},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.496,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.042}]},{"osd":5,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.81100000000000005,"15min":0.78900000000000003},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":1.3280000000000001,"5min":1.494,"15min":1.494},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.89300000000000002,"15min":0.871},"min":{"1min":0.50900000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.0209999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.82699999999999996,"15min":0.80300000000000005},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.014,"5min":0.877,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.94499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55276,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316564,"statfs":{"total":96636764160,"available":96580161536,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.879},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.131,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.56200000000000006}]},{"osd":1,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.103,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.82299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1220000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Sep 18 05:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92100000000000004}]},{"osd":3,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.502,"15min":1.502},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.216,"5min":1.804,"15min":1.804},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.80600000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.345,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85899999999999999,"15min":0.86899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3180000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.99199999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4339999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0149999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.97599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2649999999999999,"5min":1.879,"15min":1.879},"last":1.141},{"interface":"front","average":{"1min":0.995,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.377,"5min":1.742,"15min":1.742},"last":1.044}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59372,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312468,"statfs":{"total":96636764160,"available":96575967232,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.86499999999999999},"min":{"1min":0.434,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.23,"5min":2.827,"15min":2.827},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.84399999999999997}]},{"osd":1,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.48799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0109999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.879},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.88800000000000001,"15min":0.95299999999999996},"min":{"1min":0.47499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.028,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.0649999999999999}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0509999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1859999999999999,"5min":1.365,"15min":1.365},"last":0.57999999999999996}]},{"osd":3,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.48799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1220000000000001,"5min":1.133,"15min":1.133},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.125,"5min":4.282,"15min":4.282},"last":0.90700000000000003}]},{"osd":5,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.50600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.123,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.38900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.1930000000000001}]},{"osd":6,"last update":"Wed Sep 18 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.437,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1299999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.83399999999999996,"15min":0.82699999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.0940000000000001}]},{"osd":7,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1519999999999999,"5min":1.381,"15min":1.381},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":1.0109999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.413,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.1679999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77424,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94294416,"statfs":{"total":96636764160,"available":96557481984,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2649999999999999,"5min":1.276,"15min":1.276},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.024,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.29899999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.379},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1579999999999999,"5min":1.379,"15min":1.379},"last":0.316}]},{"osd":2,"last update":"Wed Sep 18 05:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1459999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.93100000000000005},"min":{"1min":0.5,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.748}]},{"osd":5,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90800000000000003,"15min":0.92200000000000004},"min":{"1min":0.71499999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.373,"15min":1.373},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.91300000000000003,"15min":0.88500000000000001},"min":{"1min":0.69899999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88200000000000001,"15min":0.871},"min":{"1min":0.63400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.73999999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5740000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.052},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.304,"5min":2.722,"15min":2.722},"last":0.78300000000000003}]}]},{"osd":2,"up_from":123,"seq":528280977422,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30248,"kb_used_data":2012,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341592,"statfs":{"total":96636764160,"available":96605790208,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2068480,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.82299999999999995,"15min":0.72499999999999998},"min":{"1min":0.312,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.087,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0629999999999999,"5min":1.978,"15min":1.978},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.442},{"interface":"front","average":{"1min":1.3879999999999999,"5min":0.85999999999999999,"15min":0.77200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.92900000000000005,"15min":0.84099999999999997},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3340000000000001,"5min":17.638999999999999,"15min":17.638999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.96899999999999997,"15min":0.82999999999999996},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1970000000000001,"5min":19.489999999999998,"15min":19.489999999999998},"last":0.52500000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.871,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.454,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.90700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0669999999999999,"5min":1.762,"15min":1.762},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.071},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":14.198,"15min":14.198},"last":0.96099999999999997}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.90500000000000003,"15min":0.88700000000000001},"min":{"1min":0.60099999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3819999999999999,"5min":1.446,"15min":1.446},"last":0.78800000000000003}]},{"osd":7,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.1619999999999999,"15min":1.0940000000000001},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6659999999999999,"5min":14.234,"15min":14.234},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0049999999999999,"15min":1.022},"min":{"1min":0.69099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.496,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.71899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59436,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312404,"statfs":{"total":96636764160,"available":96575901696,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.226,"5min":1.829,"15min":1.829},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.4379999999999999,"5min":2.25,"15min":2.25},"last":0.78700000000000003}]},{"osd":2,"last update":"Wed Sep 18 05:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.86499999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1579999999999999,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.91700000000000004}]},{"osd":4,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84399999999999997,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3899999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.47599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":1.038}]},{"osd":5,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90300000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.278,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.579,"5min":1.911,"15min":1.911},"last":1.014}]},{"osd":6,"last update":"Wed Sep 18 05:16:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.095,"5min":0.90700000000000003,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.97099999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97999999999999998,"15min":1.012},"min":{"1min":0.622,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.546,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0569999999999999,"15min":1.0700000000000001},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4610000000000001,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.139}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:16:55.832 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.832 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.832 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.832 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.832 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.833 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.833 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.833 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.833 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.833 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.833 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.833 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.833 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T05:13:34.847939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=34, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.833 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.834 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T05:13:34.847939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=34, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.834 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.834 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T05:13:34.847939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=34, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.834 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.834 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T05:13:34.847939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=34, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.834 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.834 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.834 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T05:13:34.847939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=34, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.835 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.835 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T05:13:34.847939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=34, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.835 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.835 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T05:13:34.847939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=34, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.835 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.835 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T05:13:34.847939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=34, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.835 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T05:13:28.816532+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=28, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.835 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.836 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.836 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.836 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.836 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.836 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.836 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.836 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.836 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.836 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.837 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.837 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:16:55.837 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T05:17:15.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:17:16.161 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:17:16.162 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:17:16.180 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-18T05:17:14.612718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":362,"num_object_clones":0,"num_object_copies":724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":362,"num_whiteouts":354,"num_read":182735,"num_read_kb":921879,"num_write":21996,"num_write_kb":365914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19532,"ondisk_log_size":19532,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":412720,"kb_used_data":16240,"kb_used_omap":29,"kb_used_meta":396386,"kb_avail":754562000,"statfs":{"total":773094113280,"available":772671488000,"internally_reserved":0,"allocated":16629760,"data_stored":9114916,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":29988,"internal_metadata":405899996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003580"},"pg_stats":[{"pgid":"3.1f","version":"152'705","reported_seq":2819,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.113215+0000","last_change":"2024-09-18T05:16:22.952279+0000","last_active":"2024-09-18T05:16:44.113215+0000","last_peered":"2024-09-18T05:16:44.113215+0000","last_clean":"2024-09-18T05:16:44.113215+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:16:44.113215+0000","last_undegraded":"2024-09-18T05:16:44.113215+0000","last_fullsized":"2024-09-18T05:16:44.113215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069029300000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4139,"num_read_kb":20195,"num_write":907,"num_write_kb":9329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"171'1463","reported_seq":6974,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:57.492127+0000","last_change":"2024-09-18T05:16:57.492403+0000","last_active":"2024-09-18T05:16:57.492127+0000","last_peered":"2024-09-18T05:16:57.492127+0000","last_clean":"2024-09-18T05:16:57.492127+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:16:57.492127+0000","last_undegraded":"2024-09-18T05:16:57.492127+0000","last_fullsized":"2024-09-18T05:16:57.492127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'1463","last_scrub_stamp":"2024-09-18T05:16:57.492072+0000","last_deep_scrub":"171'1463","last_deep_scrub_stamp":"2024-09-18T05:16:57.492072+0000","last_clean_scrub_stamp":"2024-09-18T05:16:57.492072+0000","objects_scrubbed":17,"log_size":1463,"log_dups_size":0,"ondisk_log_size":1463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:24.432482+0000","scrub_duration":0.034140325999999999,"objects_trimmed":0,"snaptrim_duration":0.0031115520000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":11552,"num_read_kb":29398,"num_write":2219,"num_write_kb":10724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"171'513","reported_seq":2638,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:09.943933+0000","last_change":"2024-09-18T05:17:09.944268+0000","last_active":"2024-09-18T05:17:09.943933+0000","last_peered":"2024-09-18T05:17:09.943933+0000","last_clean":"2024-09-18T05:17:09.943933+0000","last_became_active":"2024-09-18T05:16:39.078161+0000","last_became_peered":"2024-09-18T05:16:39.078161+0000","last_unstale":"2024-09-18T05:17:09.943933+0000","last_undegraded":"2024-09-18T05:17:09.943933+0000","last_fullsized":"2024-09-18T05:17:09.943933+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'513","last_scrub_stamp":"2024-09-18T05:17:09.943875+0000","last_deep_scrub":"171'513","last_deep_scrub_stamp":"2024-09-18T05:17:09.943875+0000","last_clean_scrub_stamp":"2024-09-18T05:17:09.943875+0000","objects_scrubbed":13,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:36:08.406285+0000","scrub_duration":0.025935287000000001,"objects_trimmed":4,"snaptrim_duration":0.0077051680000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3418,"num_read_kb":20008,"num_write":499,"num_write_kb":11307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"171'972","reported_seq":4783,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:03.060910+0000","last_change":"2024-09-18T05:17:03.061160+0000","last_active":"2024-09-18T05:17:03.060910+0000","last_peered":"2024-09-18T05:17:03.060910+0000","last_clean":"2024-09-18T05:17:03.060910+0000","last_became_active":"2024-09-18T05:16:39.078258+0000","last_became_peered":"2024-09-18T05:16:39.078258+0000","last_unstale":"2024-09-18T05:17:03.060910+0000","last_undegraded":"2024-09-18T05:17:03.060910+0000","last_fullsized":"2024-09-18T05:17:03.060910+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'972","last_scrub_stamp":"2024-09-18T05:17:03.060858+0000","last_deep_scrub":"171'972","last_deep_scrub_stamp":"2024-09-18T05:17:03.060858+0000","last_clean_scrub_stamp":"2024-09-18T05:17:03.060858+0000","objects_scrubbed":15,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:32.065736+0000","scrub_duration":0.030523504,"objects_trimmed":0,"snaptrim_duration":0.00078280600000000004,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":14,"num_read":7245,"num_read_kb":33079,"num_write":1238,"num_write_kb":14791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"171'415","reported_seq":2512,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:52.930616+0000","last_change":"2024-09-18T05:16:52.930717+0000","last_active":"2024-09-18T05:16:52.930616+0000","last_peered":"2024-09-18T05:16:52.930616+0000","last_clean":"2024-09-18T05:16:52.930616+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:16:52.930616+0000","last_undegraded":"2024-09-18T05:16:52.930616+0000","last_fullsized":"2024-09-18T05:16:52.930616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'415","last_scrub_stamp":"2024-09-18T05:16:52.930592+0000","last_deep_scrub":"171'415","last_deep_scrub_stamp":"2024-09-18T05:16:52.930592+0000","last_clean_scrub_stamp":"2024-09-18T05:16:52.930592+0000","objects_scrubbed":13,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:55.212951+0000","scrub_duration":0.014658572999999999,"objects_trimmed":0,"snaptrim_duration":0.00074971399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2723,"num_read_kb":17099,"num_write":364,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"171'439","reported_seq":6401,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:54.264843+0000","last_change":"2024-09-18T05:16:54.265083+0000","last_active":"2024-09-18T05:16:54.264843+0000","last_peered":"2024-09-18T05:16:54.264843+0000","last_clean":"2024-09-18T05:16:54.264843+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:16:54.264843+0000","last_undegraded":"2024-09-18T05:16:54.264843+0000","last_fullsized":"2024-09-18T05:16:54.264843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'439","last_scrub_stamp":"2024-09-18T05:16:54.264789+0000","last_deep_scrub":"171'439","last_deep_scrub_stamp":"2024-09-18T05:16:54.264789+0000","last_clean_scrub_stamp":"2024-09-18T05:16:54.264789+0000","objects_scrubbed":10,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:39.765243+0000","scrub_duration":0.019087366000000001,"objects_trimmed":0,"snaptrim_duration":0.00071492300000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":5935,"num_read_kb":45781,"num_write":417,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"171'573","reported_seq":5868,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:04.321206+0000","last_change":"2024-09-18T05:17:04.321444+0000","last_active":"2024-09-18T05:17:04.321206+0000","last_peered":"2024-09-18T05:17:04.321206+0000","last_clean":"2024-09-18T05:17:04.321206+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:17:04.321206+0000","last_undegraded":"2024-09-18T05:17:04.321206+0000","last_fullsized":"2024-09-18T05:17:04.321206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'573","last_scrub_stamp":"2024-09-18T05:17:04.321146+0000","last_deep_scrub":"171'573","last_deep_scrub_stamp":"2024-09-18T05:17:04.321146+0000","last_clean_scrub_stamp":"2024-09-18T05:17:04.321146+0000","objects_scrubbed":7,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:31.034603+0000","scrub_duration":0.016110459000000001,"objects_trimmed":0,"snaptrim_duration":0.00055068100000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8335,"num_read_kb":20827,"num_write":497,"num_write_kb":15047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"171'872","reported_seq":2741,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:06.471782+0000","last_change":"2024-09-18T05:17:06.472014+0000","last_active":"2024-09-18T05:17:06.471782+0000","last_peered":"2024-09-18T05:17:06.471782+0000","last_clean":"2024-09-18T05:17:06.471782+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:17:06.471782+0000","last_undegraded":"2024-09-18T05:17:06.471782+0000","last_fullsized":"2024-09-18T05:17:06.471782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'872","last_scrub_stamp":"2024-09-18T05:17:06.471724+0000","last_deep_scrub":"171'872","last_deep_scrub_stamp":"2024-09-18T05:17:06.471724+0000","last_clean_scrub_stamp":"2024-09-18T05:17:06.471724+0000","objects_scrubbed":9,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:24.248512+0000","scrub_duration":0.020940740999999999,"objects_trimmed":0,"snaptrim_duration":0.001816465,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4198,"num_read_kb":22346,"num_write":1180,"num_write_kb":9146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'583","reported_seq":7224,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.113466+0000","last_change":"2024-09-18T05:16:22.953058+0000","last_active":"2024-09-18T05:16:44.113466+0000","last_peered":"2024-09-18T05:16:44.113466+0000","last_clean":"2024-09-18T05:16:44.113466+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:16:44.113466+0000","last_undegraded":"2024-09-18T05:16:44.113466+0000","last_fullsized":"2024-09-18T05:16:44.113466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012193429999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8338,"num_read_kb":33067,"num_write":470,"num_write_kb":10649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"171'670","reported_seq":8322,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:57.964335+0000","last_change":"2024-09-18T05:16:57.964581+0000","last_active":"2024-09-18T05:16:57.964335+0000","last_peered":"2024-09-18T05:16:57.964335+0000","last_clean":"2024-09-18T05:16:57.964335+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:16:57.964335+0000","last_undegraded":"2024-09-18T05:16:57.964335+0000","last_fullsized":"2024-09-18T05:16:57.964335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'670","last_scrub_stamp":"2024-09-18T05:16:57.964279+0000","last_deep_scrub":"171'670","last_deep_scrub_stamp":"2024-09-18T05:16:57.964279+0000","last_clean_scrub_stamp":"2024-09-18T05:16:57.964279+0000","objects_scrubbed":14,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:29:58.075238+0000","scrub_duration":0.031062447,"objects_trimmed":0,"snaptrim_duration":0.001655983,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9449,"num_read_kb":47880,"num_write":679,"num_write_kb":15057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"151'746","reported_seq":6975,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.112802+0000","last_change":"2024-09-18T05:16:22.947810+0000","last_active":"2024-09-18T05:16:44.112802+0000","last_peered":"2024-09-18T05:16:44.112802+0000","last_clean":"2024-09-18T05:16:44.112802+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:16:44.112802+0000","last_undegraded":"2024-09-18T05:16:44.112802+0000","last_fullsized":"2024-09-18T05:16:44.112802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013431739999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":8031,"num_read_kb":49145,"num_write":1033,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"171'416","reported_seq":2325,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:57.296699+0000","last_change":"2024-09-18T05:16:57.296977+0000","last_active":"2024-09-18T05:16:57.296699+0000","last_peered":"2024-09-18T05:16:57.296699+0000","last_clean":"2024-09-18T05:16:57.296699+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:16:57.296699+0000","last_undegraded":"2024-09-18T05:16:57.296699+0000","last_fullsized":"2024-09-18T05:16:57.296699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'416","last_scrub_stamp":"2024-09-18T05:16:57.296647+0000","last_deep_scrub":"171'416","last_deep_scrub_stamp":"2024-09-18T05:16:57.296647+0000","last_clean_scrub_stamp":"2024-09-18T05:16:57.296647+0000","objects_scrubbed":17,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:32:44.726478+0000","scrub_duration":0.030451261,"objects_trimmed":0,"snaptrim_duration":0.0010340900000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":2061,"num_read_kb":19662,"num_write":411,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:57.925395+0000","last_change":"2024-09-18T05:16:57.925609+0000","last_active":"2024-09-18T05:16:57.925395+0000","last_peered":"2024-09-18T05:16:57.925395+0000","last_clean":"2024-09-18T05:16:57.925395+0000","last_became_active":"2024-09-18T05:16:02.922394+0000","last_became_peered":"2024-09-18T05:16:02.922394+0000","last_unstale":"2024-09-18T05:16:57.925395+0000","last_undegraded":"2024-09-18T05:16:57.925395+0000","last_fullsized":"2024-09-18T05:16:57.925395+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:16:57.925347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:16:57.925347+0000","last_clean_scrub_stamp":"2024-09-18T05:16:57.925347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:27:42.985142+0000","scrub_duration":0.0031287429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"171'590","reported_seq":3734,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:04.982901+0000","last_change":"2024-09-18T05:17:04.983230+0000","last_active":"2024-09-18T05:17:04.982901+0000","last_peered":"2024-09-18T05:17:04.982901+0000","last_clean":"2024-09-18T05:17:04.982901+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:17:04.982901+0000","last_undegraded":"2024-09-18T05:17:04.982901+0000","last_fullsized":"2024-09-18T05:17:04.982901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'590","last_scrub_stamp":"2024-09-18T05:17:04.982843+0000","last_deep_scrub":"171'590","last_deep_scrub_stamp":"2024-09-18T05:17:04.982843+0000","last_clean_scrub_stamp":"2024-09-18T05:17:04.982843+0000","objects_scrubbed":13,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:55.303414+0000","scrub_duration":0.027041757999999999,"objects_trimmed":0,"snaptrim_duration":0.0015023230000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":4591,"num_read_kb":29240,"num_write":682,"num_write_kb":13080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":191,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:00.365741+0000","last_change":"2024-09-18T05:17:00.365957+0000","last_active":"2024-09-18T05:17:00.365741+0000","last_peered":"2024-09-18T05:17:00.365741+0000","last_clean":"2024-09-18T05:17:00.365741+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:17:00.365741+0000","last_undegraded":"2024-09-18T05:17:00.365741+0000","last_fullsized":"2024-09-18T05:17:00.365741+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:17:00.365690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:17:00.365690+0000","last_clean_scrub_stamp":"2024-09-18T05:17:00.365690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:20.852991+0000","scrub_duration":0.003365654,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"152'533","reported_seq":3184,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.112508+0000","last_change":"2024-09-18T05:16:22.951905+0000","last_active":"2024-09-18T05:16:44.112508+0000","last_peered":"2024-09-18T05:16:44.112508+0000","last_clean":"2024-09-18T05:16:44.112508+0000","last_became_active":"2024-09-18T05:16:19.904499+0000","last_became_peered":"2024-09-18T05:16:19.904499+0000","last_unstale":"2024-09-18T05:16:44.112508+0000","last_undegraded":"2024-09-18T05:16:44.112508+0000","last_fullsized":"2024-09-18T05:16:44.112508+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00364015,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3679,"num_read_kb":33211,"num_write":613,"num_write_kb":10118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":7448296,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":176,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:00.046137+0000","last_change":"2024-09-18T05:17:00.046345+0000","last_active":"2024-09-18T05:17:00.046137+0000","last_peered":"2024-09-18T05:17:00.046137+0000","last_clean":"2024-09-18T05:17:00.046137+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:17:00.046137+0000","last_undegraded":"2024-09-18T05:17:00.046137+0000","last_fullsized":"2024-09-18T05:17:00.046137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:17:00.046092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:17:00.046092+0000","last_clean_scrub_stamp":"2024-09-18T05:17:00.046092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:47:38.098660+0000","scrub_duration":0.003556708,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"171'433","reported_seq":6049,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:05.323131+0000","last_change":"2024-09-18T05:17:05.323398+0000","last_active":"2024-09-18T05:17:05.323131+0000","last_peered":"2024-09-18T05:17:05.323131+0000","last_clean":"2024-09-18T05:17:05.323131+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:17:05.323131+0000","last_undegraded":"2024-09-18T05:17:05.323131+0000","last_fullsized":"2024-09-18T05:17:05.323131+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'433","last_scrub_stamp":"2024-09-18T05:17:05.323074+0000","last_deep_scrub":"171'433","last_deep_scrub_stamp":"2024-09-18T05:17:05.323074+0000","last_clean_scrub_stamp":"2024-09-18T05:17:05.323074+0000","objects_scrubbed":13,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:19.569461+0000","scrub_duration":0.026754501,"objects_trimmed":0,"snaptrim_duration":0.00060223399999999999,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":6557,"num_read_kb":27685,"num_write":436,"num_write_kb":9094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:55.214180+0000","last_change":"2024-09-18T05:16:55.214272+0000","last_active":"2024-09-18T05:16:55.214180+0000","last_peered":"2024-09-18T05:16:55.214180+0000","last_clean":"2024-09-18T05:16:55.214180+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:16:55.214180+0000","last_undegraded":"2024-09-18T05:16:55.214180+0000","last_fullsized":"2024-09-18T05:16:55.214180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:16:55.214162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:16:55.214162+0000","last_clean_scrub_stamp":"2024-09-18T05:16:55.214162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:40:43.819334+0000","scrub_duration":0.0012876960000000001,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"171'471","reported_seq":6049,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:10.959165+0000","last_change":"2024-09-18T05:17:10.959465+0000","last_active":"2024-09-18T05:17:10.959165+0000","last_peered":"2024-09-18T05:17:10.959165+0000","last_clean":"2024-09-18T05:17:10.959165+0000","last_became_active":"2024-09-18T05:16:39.077813+0000","last_became_peered":"2024-09-18T05:16:39.077813+0000","last_unstale":"2024-09-18T05:17:10.959165+0000","last_undegraded":"2024-09-18T05:17:10.959165+0000","last_fullsized":"2024-09-18T05:17:10.959165+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'471","last_scrub_stamp":"2024-09-18T05:17:10.959110+0000","last_deep_scrub":"171'471","last_deep_scrub_stamp":"2024-09-18T05:17:10.959110+0000","last_clean_scrub_stamp":"2024-09-18T05:17:10.959110+0000","objects_scrubbed":12,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:28:12.771791+0000","scrub_duration":0.020566137000000002,"objects_trimmed":5,"snaptrim_duration":0.032776543999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5840,"num_read_kb":39783,"num_write":450,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"171'1174","reported_seq":5011,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:00.222286+0000","last_change":"2024-09-18T05:17:00.222511+0000","last_active":"2024-09-18T05:17:00.222286+0000","last_peered":"2024-09-18T05:17:00.222286+0000","last_clean":"2024-09-18T05:17:00.222286+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:17:00.222286+0000","last_undegraded":"2024-09-18T05:17:00.222286+0000","last_fullsized":"2024-09-18T05:17:00.222286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'1174","last_scrub_stamp":"2024-09-18T05:17:00.222231+0000","last_deep_scrub":"171'1174","last_deep_scrub_stamp":"2024-09-18T05:17:00.222231+0000","last_clean_scrub_stamp":"2024-09-18T05:17:00.222231+0000","objects_scrubbed":10,"log_size":1174,"log_dups_size":0,"ondisk_log_size":1174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:05.065617+0000","scrub_duration":0.021028214,"objects_trimmed":0,"snaptrim_duration":0.0011154260000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":6871,"num_read_kb":44276,"num_write":1455,"num_write_kb":20060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"171'3","reported_seq":94,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:04.962404+0000","last_change":"2024-09-18T05:17:04.962609+0000","last_active":"2024-09-18T05:17:04.962404+0000","last_peered":"2024-09-18T05:17:04.962404+0000","last_clean":"2024-09-18T05:17:04.962404+0000","last_became_active":"2024-09-18T05:16:39.076198+0000","last_became_peered":"2024-09-18T05:16:39.076198+0000","last_unstale":"2024-09-18T05:17:04.962404+0000","last_undegraded":"2024-09-18T05:17:04.962404+0000","last_fullsized":"2024-09-18T05:17:04.962404+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'3","last_scrub_stamp":"2024-09-18T05:17:04.962350+0000","last_deep_scrub":"171'3","last_deep_scrub_stamp":"2024-09-18T05:17:04.962350+0000","last_clean_scrub_stamp":"2024-09-18T05:17:04.962350+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:57:46.095840+0000","scrub_duration":0.0063283330000000002,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"171'449","reported_seq":4773,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:11.332623+0000","last_change":"2024-09-18T05:17:11.332844+0000","last_active":"2024-09-18T05:17:11.332623+0000","last_peered":"2024-09-18T05:17:11.332623+0000","last_clean":"2024-09-18T05:17:11.332623+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:17:11.332623+0000","last_undegraded":"2024-09-18T05:17:11.332623+0000","last_fullsized":"2024-09-18T05:17:11.332623+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'449","last_scrub_stamp":"2024-09-18T05:17:11.332566+0000","last_deep_scrub":"171'449","last_deep_scrub_stamp":"2024-09-18T05:17:11.332566+0000","last_clean_scrub_stamp":"2024-09-18T05:17:11.332566+0000","objects_scrubbed":11,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:57.648711+0000","scrub_duration":0.021995516999999999,"objects_trimmed":0,"snaptrim_duration":0.00037471100000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":4862,"num_read_kb":21776,"num_write":386,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":127,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:55.206252+0000","last_change":"2024-09-18T05:16:55.206324+0000","last_active":"2024-09-18T05:16:55.206252+0000","last_peered":"2024-09-18T05:16:55.206252+0000","last_clean":"2024-09-18T05:16:55.206252+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:16:55.206252+0000","last_undegraded":"2024-09-18T05:16:55.206252+0000","last_fullsized":"2024-09-18T05:16:55.206252+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:16:55.206234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:16:55.206234+0000","last_clean_scrub_stamp":"2024-09-18T05:16:55.206234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:26.452829+0000","scrub_duration":0.0012158449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'373","reported_seq":2498,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:10.919392+0000","last_change":"2024-09-18T05:17:10.919631+0000","last_active":"2024-09-18T05:17:10.919392+0000","last_peered":"2024-09-18T05:17:10.919392+0000","last_clean":"2024-09-18T05:17:10.919392+0000","last_became_active":"2024-09-18T05:16:01.899154+0000","last_became_peered":"2024-09-18T05:16:01.899154+0000","last_unstale":"2024-09-18T05:17:10.919392+0000","last_undegraded":"2024-09-18T05:17:10.919392+0000","last_fullsized":"2024-09-18T05:17:10.919392+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'373","last_scrub_stamp":"2024-09-18T05:17:10.919334+0000","last_deep_scrub":"171'373","last_deep_scrub_stamp":"2024-09-18T05:17:10.919334+0000","last_clean_scrub_stamp":"2024-09-18T05:17:10.919334+0000","objects_scrubbed":10,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:11:38.572288+0000","scrub_duration":0.017685843999999999,"objects_trimmed":0,"snaptrim_duration":0.001032123,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":2135,"num_read_kb":5505,"num_write":365,"num_write_kb":5251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":2091093,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":176,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:04.111497+0000","last_change":"2024-09-18T05:17:04.111743+0000","last_active":"2024-09-18T05:17:04.111497+0000","last_peered":"2024-09-18T05:17:04.111497+0000","last_clean":"2024-09-18T05:17:04.111497+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:17:04.111497+0000","last_undegraded":"2024-09-18T05:17:04.111497+0000","last_fullsized":"2024-09-18T05:17:04.111497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:17:04.111443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:17:04.111443+0000","last_clean_scrub_stamp":"2024-09-18T05:17:04.111443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:15:15.039621+0000","scrub_duration":0.0034084929999999999,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"151'596","reported_seq":5171,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.619267+0000","last_change":"2024-09-18T05:16:22.957237+0000","last_active":"2024-09-18T05:16:44.619267+0000","last_peered":"2024-09-18T05:16:44.619267+0000","last_clean":"2024-09-18T05:16:44.619267+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:16:44.619267+0000","last_undegraded":"2024-09-18T05:16:44.619267+0000","last_fullsized":"2024-09-18T05:16:44.619267+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083719899999999995,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7500,"num_read_kb":38768,"num_write":572,"num_write_kb":10748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"171'2","reported_seq":119,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:00.017271+0000","last_change":"2024-09-18T05:17:00.017500+0000","last_active":"2024-09-18T05:17:00.017271+0000","last_peered":"2024-09-18T05:17:00.017271+0000","last_clean":"2024-09-18T05:17:00.017271+0000","last_became_active":"2024-09-18T05:16:39.075931+0000","last_became_peered":"2024-09-18T05:16:39.075931+0000","last_unstale":"2024-09-18T05:17:00.017271+0000","last_undegraded":"2024-09-18T05:17:00.017271+0000","last_fullsized":"2024-09-18T05:17:00.017271+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'2","last_scrub_stamp":"2024-09-18T05:17:00.017215+0000","last_deep_scrub":"171'2","last_deep_scrub_stamp":"2024-09-18T05:17:00.017215+0000","last_clean_scrub_stamp":"2024-09-18T05:17:00.017215+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:59:47.669547+0000","scrub_duration":0.005610383,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"171'119","reported_seq":326,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:59.001705+0000","last_change":"2024-09-18T05:16:59.001963+0000","last_active":"2024-09-18T05:16:59.001705+0000","last_peered":"2024-09-18T05:16:59.001705+0000","last_clean":"2024-09-18T05:16:59.001705+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:16:59.001705+0000","last_undegraded":"2024-09-18T05:16:59.001705+0000","last_fullsized":"2024-09-18T05:16:59.001705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'119","last_scrub_stamp":"2024-09-18T05:16:59.001653+0000","last_deep_scrub":"171'119","last_deep_scrub_stamp":"2024-09-18T05:16:59.001653+0000","last_clean_scrub_stamp":"2024-09-18T05:16:59.001653+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:09:27.286983+0000","scrub_duration":0.0084990529999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"171'437","reported_seq":5339,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:11.381095+0000","last_change":"2024-09-18T05:17:11.381400+0000","last_active":"2024-09-18T05:17:11.381095+0000","last_peered":"2024-09-18T05:17:11.381095+0000","last_clean":"2024-09-18T05:17:11.381095+0000","last_became_active":"2024-09-18T05:16:01.898482+0000","last_became_peered":"2024-09-18T05:16:01.898482+0000","last_unstale":"2024-09-18T05:17:11.381095+0000","last_undegraded":"2024-09-18T05:17:11.381095+0000","last_fullsized":"2024-09-18T05:17:11.381095+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'437","last_scrub_stamp":"2024-09-18T05:17:11.381040+0000","last_deep_scrub":"171'437","last_deep_scrub_stamp":"2024-09-18T05:17:11.381040+0000","last_clean_scrub_stamp":"2024-09-18T05:17:11.381040+0000","objects_scrubbed":11,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:34.897161+0000","scrub_duration":0.021446930999999999,"objects_trimmed":0,"snaptrim_duration":0.0015649310000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6584,"num_read_kb":42729,"num_write":374,"num_write_kb":15931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":15236017,"num_keys_recovered":42,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"171'303","reported_seq":4191,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:56.256016+0000","last_change":"2024-09-18T05:16:56.256252+0000","last_active":"2024-09-18T05:16:56.256016+0000","last_peered":"2024-09-18T05:16:56.256016+0000","last_clean":"2024-09-18T05:16:56.256016+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:16:56.256016+0000","last_undegraded":"2024-09-18T05:16:56.256016+0000","last_fullsized":"2024-09-18T05:16:56.256016+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'303","last_scrub_stamp":"2024-09-18T05:16:56.255960+0000","last_deep_scrub":"171'303","last_deep_scrub_stamp":"2024-09-18T05:16:56.255960+0000","last_clean_scrub_stamp":"2024-09-18T05:16:56.255960+0000","objects_scrubbed":7,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:12:34.680995+0000","scrub_duration":0.017312154999999999,"objects_trimmed":0,"snaptrim_duration":0.00062945099999999995,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3697,"num_read_kb":33449,"num_write":292,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"171'641","reported_seq":2748,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:05.052377+0000","last_change":"2024-09-18T05:17:05.052585+0000","last_active":"2024-09-18T05:17:05.052377+0000","last_peered":"2024-09-18T05:17:05.052377+0000","last_clean":"2024-09-18T05:17:05.052377+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:17:05.052377+0000","last_undegraded":"2024-09-18T05:17:05.052377+0000","last_fullsized":"2024-09-18T05:17:05.052377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'641","last_scrub_stamp":"2024-09-18T05:17:05.052325+0000","last_deep_scrub":"171'641","last_deep_scrub_stamp":"2024-09-18T05:17:05.052325+0000","last_clean_scrub_stamp":"2024-09-18T05:17:05.052325+0000","objects_scrubbed":8,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:30:32.380522+0000","scrub_duration":0.015833809000000001,"objects_trimmed":0,"snaptrim_duration":0.000499841,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":3587,"num_read_kb":18383,"num_write":752,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"171'308","reported_seq":3389,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:08.387852+0000","last_change":"2024-09-18T05:17:08.388137+0000","last_active":"2024-09-18T05:17:08.387852+0000","last_peered":"2024-09-18T05:17:08.387852+0000","last_clean":"2024-09-18T05:17:08.387852+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:17:08.387852+0000","last_undegraded":"2024-09-18T05:17:08.387852+0000","last_fullsized":"2024-09-18T05:17:08.387852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'308","last_scrub_stamp":"2024-09-18T05:17:08.387798+0000","last_deep_scrub":"171'308","last_deep_scrub_stamp":"2024-09-18T05:17:08.387798+0000","last_clean_scrub_stamp":"2024-09-18T05:17:08.387798+0000","objects_scrubbed":9,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:18.571108+0000","scrub_duration":0.017115952,"objects_trimmed":0,"snaptrim_duration":0.002578814,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":2832,"num_read_kb":19521,"num_write":259,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"151'471","reported_seq":5190,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.622313+0000","last_change":"2024-09-18T05:16:39.081596+0000","last_active":"2024-09-18T05:16:44.622313+0000","last_peered":"2024-09-18T05:16:44.622313+0000","last_clean":"2024-09-18T05:16:44.622313+0000","last_became_active":"2024-09-18T05:16:39.077761+0000","last_became_peered":"2024-09-18T05:16:39.077761+0000","last_unstale":"2024-09-18T05:16:44.622313+0000","last_undegraded":"2024-09-18T05:16:44.622313+0000","last_fullsized":"2024-09-18T05:16:44.622313+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017471631000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5191,"num_read_kb":29963,"num_write":520,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'416","reported_seq":3722,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.112928+0000","last_change":"2024-09-18T05:16:22.947578+0000","last_active":"2024-09-18T05:16:44.112928+0000","last_peered":"2024-09-18T05:16:44.112928+0000","last_clean":"2024-09-18T05:16:44.112928+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:16:44.112928+0000","last_undegraded":"2024-09-18T05:16:44.112928+0000","last_fullsized":"2024-09-18T05:16:44.112928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318949999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4121,"num_read_kb":17361,"num_write":391,"num_write_kb":13003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"151'602","reported_seq":5934,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:44.113043+0000","last_change":"2024-09-18T05:16:22.948118+0000","last_active":"2024-09-18T05:16:44.113043+0000","last_peered":"2024-09-18T05:16:44.113043+0000","last_clean":"2024-09-18T05:16:44.113043+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:16:44.113043+0000","last_undegraded":"2024-09-18T05:16:44.113043+0000","last_fullsized":"2024-09-18T05:16:44.113043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:13:44.856822+0000","last_clean_scrub_stamp":"2024-09-18T05:13:44.856822+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001596606,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":6945,"num_read_kb":34740,"num_write":596,"num_write_kb":4823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"171'569","reported_seq":9113,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:09.423861+0000","last_change":"2024-09-18T05:17:09.424089+0000","last_active":"2024-09-18T05:17:09.423861+0000","last_peered":"2024-09-18T05:17:09.423861+0000","last_clean":"2024-09-18T05:17:09.423861+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:17:09.423861+0000","last_undegraded":"2024-09-18T05:17:09.423861+0000","last_fullsized":"2024-09-18T05:17:09.423861+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'569","last_scrub_stamp":"2024-09-18T05:17:09.423808+0000","last_deep_scrub":"171'569","last_deep_scrub_stamp":"2024-09-18T05:17:09.423808+0000","last_clean_scrub_stamp":"2024-09-18T05:17:09.423808+0000","objects_scrubbed":14,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:46.436515+0000","scrub_duration":0.02248143,"objects_trimmed":0,"snaptrim_duration":0.0031437349999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9783,"num_read_kb":40662,"num_write":558,"num_write_kb":18337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"171'679","reported_seq":4052,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:56.917842+0000","last_change":"2024-09-18T05:16:56.917842+0000","last_active":"2024-09-18T05:16:56.917842+0000","last_peered":"2024-09-18T05:16:56.917842+0000","last_clean":"2024-09-18T05:16:56.917842+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:16:56.917842+0000","last_undegraded":"2024-09-18T05:16:56.917842+0000","last_fullsized":"2024-09-18T05:16:56.917842+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'679","last_scrub_stamp":"2024-09-18T05:16:56.917543+0000","last_deep_scrub":"171'679","last_deep_scrub_stamp":"2024-09-18T05:16:56.917543+0000","last_clean_scrub_stamp":"2024-09-18T05:16:56.917543+0000","objects_scrubbed":13,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:10:19.664679+0000","scrub_duration":0.023328648,"objects_trimmed":0,"snaptrim_duration":0.00056430399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":7033,"num_read_kb":30921,"num_write":767,"num_write_kb":9608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"171'450","reported_seq":3820,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:07.098390+0000","last_change":"2024-09-18T05:17:07.098648+0000","last_active":"2024-09-18T05:17:07.098390+0000","last_peered":"2024-09-18T05:17:07.098390+0000","last_clean":"2024-09-18T05:17:07.098390+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:17:07.098390+0000","last_undegraded":"2024-09-18T05:17:07.098390+0000","last_fullsized":"2024-09-18T05:17:07.098390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'450","last_scrub_stamp":"2024-09-18T05:17:07.098334+0000","last_deep_scrub":"171'450","last_deep_scrub_stamp":"2024-09-18T05:17:07.098334+0000","last_clean_scrub_stamp":"2024-09-18T05:17:07.098334+0000","objects_scrubbed":8,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:57:41.559054+0000","scrub_duration":0.017292932,"objects_trimmed":0,"snaptrim_duration":0.00084174599999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":4545,"num_read_kb":16351,"num_write":465,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"171'678","reported_seq":3049,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:08.936622+0000","last_change":"2024-09-18T05:17:08.936856+0000","last_active":"2024-09-18T05:17:08.936622+0000","last_peered":"2024-09-18T05:17:08.936622+0000","last_clean":"2024-09-18T05:17:08.936622+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:17:08.936622+0000","last_undegraded":"2024-09-18T05:17:08.936622+0000","last_fullsized":"2024-09-18T05:17:08.936622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'678","last_scrub_stamp":"2024-09-18T05:17:08.936563+0000","last_deep_scrub":"171'678","last_deep_scrub_stamp":"2024-09-18T05:17:08.936563+0000","last_clean_scrub_stamp":"2024-09-18T05:17:08.936563+0000","objects_scrubbed":11,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:18.247837+0000","scrub_duration":0.019207728,"objects_trimmed":0,"snaptrim_duration":0.001575814,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":5022,"num_read_kb":16163,"num_write":742,"num_write_kb":7893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"171'868","reported_seq":3209,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:09.054791+0000","last_change":"2024-09-18T05:17:09.055013+0000","last_active":"2024-09-18T05:17:09.054791+0000","last_peered":"2024-09-18T05:17:09.054791+0000","last_clean":"2024-09-18T05:17:09.054791+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:17:09.054791+0000","last_undegraded":"2024-09-18T05:17:09.054791+0000","last_fullsized":"2024-09-18T05:17:09.054791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'868","last_scrub_stamp":"2024-09-18T05:17:09.054737+0000","last_deep_scrub":"171'868","last_deep_scrub_stamp":"2024-09-18T05:17:09.054737+0000","last_clean_scrub_stamp":"2024-09-18T05:17:09.054737+0000","objects_scrubbed":14,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:30.389676+0000","scrub_duration":0.027712745,"objects_trimmed":0,"snaptrim_duration":0.00078209799999999995,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":5820,"num_read_kb":22805,"num_write":1246,"num_write_kb":8989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":358,"num_object_clones":0,"num_object_copies":716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":354,"num_read":182619,"num_read_kb":921779,"num_write":21835,"num_write_kb":363496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6486,"internal_metadata":0},"log_size":19408,"ondisk_log_size":19408,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55332,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316508,"statfs":{"total":96636764160,"available":96580104192,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.88100000000000001},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.143,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94299999999999995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.1379999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.88600000000000001,"15min":0.92800000000000005},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1539999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.417},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.86599999999999999,"15min":0.91900000000000004},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2809999999999999,"5min":1.583,"15min":1.583},"last":1.1679999999999999}]},{"osd":2,"last update":"Wed Sep 18 05:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.266},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.2869999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.208,"5min":1.925,"15min":1.925},"last":1.22},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.99099999999999999,"15min":1.0429999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.411,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.4630000000000001}]},{"osd":4,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":1.071},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.282,"5min":3.488,"15min":3.488},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.89900000000000002,"15min":0.94199999999999995},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":2.512,"15min":2.512},"last":1.097}]},{"osd":5,"last update":"Wed Sep 18 05:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":1.071,"15min":1.1499999999999999},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3959999999999999,"5min":3.069,"15min":3.069},"last":0.754},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.05,"15min":1.111},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:16:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.403,"5min":1.615,"15min":1.615},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.091,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6499999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3420000000000001}]}]},{"osd":6,"up_from":61,"seq":261993005089,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34340,"kb_used_data":2012,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94337500,"statfs":{"total":96636764160,"available":96601600000,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.71299999999999997,"15min":0.68700000000000006},"min":{"1min":0.48499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.72199999999999998,"15min":0.69399999999999995},"min":{"1min":0.58299999999999996,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.0469999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.71799999999999997,"15min":0.69799999999999995},"min":{"1min":0.52300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.99299999999999999}]},{"osd":2,"last update":"Wed Sep 18 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.80500000000000005,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.238,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.84699999999999998,"15min":0.82499999999999996},"min":{"1min":0.496,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.65400000000000003}]},{"osd":4,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.73699999999999999,"15min":0.71599999999999997},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.496,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.81100000000000005,"15min":0.78900000000000003},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":1.3280000000000001,"5min":1.494,"15min":1.494},"last":0.753},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.89300000000000002,"15min":0.871},"min":{"1min":0.50900000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.0229999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.82699999999999996,"15min":0.80300000000000005},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.014,"5min":0.877,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.89700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55272,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316568,"statfs":{"total":96636764160,"available":96580165632,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.131,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.103,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.82299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1220000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0069999999999999}]},{"osd":2,"last update":"Wed Sep 18 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.89400000000000002}]},{"osd":3,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.502,"15min":1.502},"last":1.226},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.216,"5min":1.804,"15min":1.804},"last":1.177}]},{"osd":4,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.80600000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.345,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85899999999999999,"15min":0.86899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3180000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.264}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4339999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.089}]},{"osd":7,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.97599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2649999999999999,"5min":1.879,"15min":1.879},"last":1.3779999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.377,"5min":1.742,"15min":1.742},"last":1.3340000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63464,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":61438,"kb_avail":94308376,"statfs":{"total":96636764160,"available":96571777024,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":62912966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.86499999999999999},"min":{"1min":0.434,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.23,"5min":2.827,"15min":2.827},"last":0.748},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":1.1519999999999999}]},{"osd":1,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.48799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0109999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.88800000000000001,"15min":0.95299999999999996},"min":{"1min":0.47499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.028,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.95899999999999996}]},{"osd":2,"last update":"Wed Sep 18 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":1.0960000000000001}]},{"osd":3,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.48799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1220000000000001,"5min":1.133,"15min":1.133},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.125,"5min":4.282,"15min":4.282},"last":1.1879999999999999}]},{"osd":5,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.50600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.123,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.38900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.0509999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.437,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1299999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.83399999999999996,"15min":0.82699999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.85599999999999998}]},{"osd":7,"last update":"Wed Sep 18 05:16:28 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1519999999999999,"5min":1.381,"15min":1.381},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":1.0109999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.413,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.248}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81508,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94290332,"statfs":{"total":96636764160,"available":96553299968,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":81394120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2649999999999999,"5min":1.276,"15min":1.276},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.024,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.92900000000000005}]},{"osd":1,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1579999999999999,"5min":1.379,"15min":1.379},"last":0.96599999999999997}]},{"osd":2,"last update":"Wed Sep 18 05:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.88700000000000001}]},{"osd":4,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1459999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.121},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.93100000000000005},"min":{"1min":0.5,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.036}]},{"osd":5,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90800000000000003,"15min":0.92200000000000004},"min":{"1min":0.71499999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.373,"15min":1.373},"last":1.169}]},{"osd":6,"last update":"Wed Sep 18 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.91300000000000003,"15min":0.88500000000000001},"min":{"1min":0.69899999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.214},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88200000000000001,"15min":0.871},"min":{"1min":0.63400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.2849999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.73999999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5740000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.052},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.304,"5min":2.722,"15min":2.722},"last":1.339}]}]},{"osd":2,"up_from":123,"seq":528280977426,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30244,"kb_used_data":2012,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341596,"statfs":{"total":96636764160,"available":96605794304,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.94199999999999995}]},{"osd":1,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.76900000000000002}]},{"osd":4,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.056},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":1.2350000000000001}]},{"osd":5,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.145},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.167}]},{"osd":6,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.026},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.284}]},{"osd":7,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.2050000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":2068480,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.82299999999999995,"15min":0.72499999999999998},"min":{"1min":0.312,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.087,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0629999999999999,"5min":1.978,"15min":1.978},"last":1.1100000000000001}]},{"osd":2,"last update":"Wed Sep 18 05:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.622},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.97199999999999998}]},{"osd":3,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.92900000000000005,"15min":0.84099999999999997},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3340000000000001,"5min":17.638999999999999,"15min":17.638999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.96899999999999997,"15min":0.82999999999999996},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1970000000000001,"5min":19.489999999999998,"15min":19.489999999999998},"last":0.79300000000000004}]},{"osd":4,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.871,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.454,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.75}]},{"osd":5,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.90700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0669999999999999,"5min":1.762,"15min":1.762},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.071},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":14.198,"15min":14.198},"last":1.0880000000000001}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.90500000000000003,"15min":0.88700000000000001},"min":{"1min":0.60099999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3819999999999999,"5min":1.446,"15min":1.446},"last":0.83499999999999996}]},{"osd":7,"last update":"Wed Sep 18 05:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.1619999999999999,"15min":1.0940000000000001},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6659999999999999,"5min":14.234,"15min":14.234},"last":0.871},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0049999999999999,"15min":1.022},"min":{"1min":0.69099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.496,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.0660000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59428,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312412,"statfs":{"total":96636764160,"available":96575909888,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.226,"5min":1.829,"15min":1.829},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.4379999999999999,"5min":2.25,"15min":2.25},"last":0.746}]},{"osd":2,"last update":"Wed Sep 18 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.81000000000000005}]},{"osd":3,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1579999999999999,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.66300000000000003}]},{"osd":4,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84399999999999997,"15min":0.875},"min":{"1min":0.56799999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3899999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.47599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3560000000000001,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":0.71699999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90300000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.278,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.579,"5min":1.911,"15min":1.911},"last":0.86599999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:16:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.095,"5min":0.90700000000000003,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.96599999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97999999999999998,"15min":1.012},"min":{"1min":0.622,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.546,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0569999999999999,"15min":1.0700000000000001},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4610000000000001,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":0.99199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:17:16.183 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:17:16.184 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:17:16.184 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:17:16.184 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:17:16.184 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:17:16.184 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:17:16.185 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:17:16.185 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T05:13:44.856822+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=13, tm_sec=44, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=5, tm_min=16, tm_sec=50, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T05:17:16.185 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T05:17:36.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T05:17:36.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-18T05:17:36.508 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-18T05:17:36.526 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-18T05:17:34.618778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":362,"num_object_clones":0,"num_object_copies":724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":362,"num_whiteouts":354,"num_read":182735,"num_read_kb":921879,"num_write":21996,"num_write_kb":365914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19611,"ondisk_log_size":19611,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":412720,"kb_used_data":16240,"kb_used_omap":29,"kb_used_meta":396386,"kb_avail":754562000,"statfs":{"total":773094113280,"available":772671488000,"internally_reserved":0,"allocated":16629760,"data_stored":9114916,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":29988,"internal_metadata":405899996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003589"},"pg_stats":[{"pgid":"3.1f","version":"171'712","reported_seq":2837,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:23.925238+0000","last_change":"2024-09-18T05:17:23.925531+0000","last_active":"2024-09-18T05:17:23.925238+0000","last_peered":"2024-09-18T05:17:23.925238+0000","last_clean":"2024-09-18T05:17:23.925238+0000","last_became_active":"2024-09-18T05:13:45.882593+0000","last_became_peered":"2024-09-18T05:13:45.882593+0000","last_unstale":"2024-09-18T05:17:23.925238+0000","last_undegraded":"2024-09-18T05:17:23.925238+0000","last_fullsized":"2024-09-18T05:17:23.925238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'712","last_scrub_stamp":"2024-09-18T05:17:23.925178+0000","last_deep_scrub":"171'712","last_deep_scrub_stamp":"2024-09-18T05:17:23.925178+0000","last_clean_scrub_stamp":"2024-09-18T05:17:23.925178+0000","objects_scrubbed":7,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:33.066866+0000","scrub_duration":0.015566971000000001,"objects_trimmed":0,"snaptrim_duration":0.00069029300000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4139,"num_read_kb":20195,"num_write":907,"num_write_kb":9329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"171'1463","reported_seq":6974,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:57.492127+0000","last_change":"2024-09-18T05:16:57.492403+0000","last_active":"2024-09-18T05:16:57.492127+0000","last_peered":"2024-09-18T05:16:57.492127+0000","last_clean":"2024-09-18T05:16:57.492127+0000","last_became_active":"2024-09-18T05:14:44.121388+0000","last_became_peered":"2024-09-18T05:14:44.121388+0000","last_unstale":"2024-09-18T05:16:57.492127+0000","last_undegraded":"2024-09-18T05:16:57.492127+0000","last_fullsized":"2024-09-18T05:16:57.492127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'1463","last_scrub_stamp":"2024-09-18T05:16:57.492072+0000","last_deep_scrub":"171'1463","last_deep_scrub_stamp":"2024-09-18T05:16:57.492072+0000","last_clean_scrub_stamp":"2024-09-18T05:16:57.492072+0000","objects_scrubbed":17,"log_size":1463,"log_dups_size":0,"ondisk_log_size":1463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:24.432482+0000","scrub_duration":0.034140325999999999,"objects_trimmed":0,"snaptrim_duration":0.0031115520000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":11552,"num_read_kb":29398,"num_write":2219,"num_write_kb":10724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"171'513","reported_seq":2638,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:09.943933+0000","last_change":"2024-09-18T05:17:09.944268+0000","last_active":"2024-09-18T05:17:09.943933+0000","last_peered":"2024-09-18T05:17:09.943933+0000","last_clean":"2024-09-18T05:17:09.943933+0000","last_became_active":"2024-09-18T05:16:39.078161+0000","last_became_peered":"2024-09-18T05:16:39.078161+0000","last_unstale":"2024-09-18T05:17:09.943933+0000","last_undegraded":"2024-09-18T05:17:09.943933+0000","last_fullsized":"2024-09-18T05:17:09.943933+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'513","last_scrub_stamp":"2024-09-18T05:17:09.943875+0000","last_deep_scrub":"171'513","last_deep_scrub_stamp":"2024-09-18T05:17:09.943875+0000","last_clean_scrub_stamp":"2024-09-18T05:17:09.943875+0000","objects_scrubbed":13,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:36:08.406285+0000","scrub_duration":0.025935287000000001,"objects_trimmed":4,"snaptrim_duration":0.0077051680000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3418,"num_read_kb":20008,"num_write":499,"num_write_kb":11307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"171'972","reported_seq":4783,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:03.060910+0000","last_change":"2024-09-18T05:17:03.061160+0000","last_active":"2024-09-18T05:17:03.060910+0000","last_peered":"2024-09-18T05:17:03.060910+0000","last_clean":"2024-09-18T05:17:03.060910+0000","last_became_active":"2024-09-18T05:16:39.078258+0000","last_became_peered":"2024-09-18T05:16:39.078258+0000","last_unstale":"2024-09-18T05:17:03.060910+0000","last_undegraded":"2024-09-18T05:17:03.060910+0000","last_fullsized":"2024-09-18T05:17:03.060910+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'972","last_scrub_stamp":"2024-09-18T05:17:03.060858+0000","last_deep_scrub":"171'972","last_deep_scrub_stamp":"2024-09-18T05:17:03.060858+0000","last_clean_scrub_stamp":"2024-09-18T05:17:03.060858+0000","objects_scrubbed":15,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:32.065736+0000","scrub_duration":0.030523504,"objects_trimmed":0,"snaptrim_duration":0.00078280600000000004,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":14,"num_read":7245,"num_read_kb":33079,"num_write":1238,"num_write_kb":14791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"171'415","reported_seq":2512,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:52.930616+0000","last_change":"2024-09-18T05:16:52.930717+0000","last_active":"2024-09-18T05:16:52.930616+0000","last_peered":"2024-09-18T05:16:52.930616+0000","last_clean":"2024-09-18T05:16:52.930616+0000","last_became_active":"2024-09-18T05:13:45.872529+0000","last_became_peered":"2024-09-18T05:13:45.872529+0000","last_unstale":"2024-09-18T05:16:52.930616+0000","last_undegraded":"2024-09-18T05:16:52.930616+0000","last_fullsized":"2024-09-18T05:16:52.930616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'415","last_scrub_stamp":"2024-09-18T05:16:52.930592+0000","last_deep_scrub":"171'415","last_deep_scrub_stamp":"2024-09-18T05:16:52.930592+0000","last_clean_scrub_stamp":"2024-09-18T05:16:52.930592+0000","objects_scrubbed":13,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:55.212951+0000","scrub_duration":0.014658572999999999,"objects_trimmed":0,"snaptrim_duration":0.00074971399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2723,"num_read_kb":17099,"num_write":364,"num_write_kb":11470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"171'439","reported_seq":6401,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:54.264843+0000","last_change":"2024-09-18T05:16:54.265083+0000","last_active":"2024-09-18T05:16:54.264843+0000","last_peered":"2024-09-18T05:16:54.264843+0000","last_clean":"2024-09-18T05:16:54.264843+0000","last_became_active":"2024-09-18T05:13:45.875705+0000","last_became_peered":"2024-09-18T05:13:45.875705+0000","last_unstale":"2024-09-18T05:16:54.264843+0000","last_undegraded":"2024-09-18T05:16:54.264843+0000","last_fullsized":"2024-09-18T05:16:54.264843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'439","last_scrub_stamp":"2024-09-18T05:16:54.264789+0000","last_deep_scrub":"171'439","last_deep_scrub_stamp":"2024-09-18T05:16:54.264789+0000","last_clean_scrub_stamp":"2024-09-18T05:16:54.264789+0000","objects_scrubbed":10,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:39.765243+0000","scrub_duration":0.019087366000000001,"objects_trimmed":0,"snaptrim_duration":0.00071492300000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":5935,"num_read_kb":45781,"num_write":417,"num_write_kb":14748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"171'573","reported_seq":5868,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:04.321206+0000","last_change":"2024-09-18T05:17:04.321444+0000","last_active":"2024-09-18T05:17:04.321206+0000","last_peered":"2024-09-18T05:17:04.321206+0000","last_clean":"2024-09-18T05:17:04.321206+0000","last_became_active":"2024-09-18T05:13:45.871098+0000","last_became_peered":"2024-09-18T05:13:45.871098+0000","last_unstale":"2024-09-18T05:17:04.321206+0000","last_undegraded":"2024-09-18T05:17:04.321206+0000","last_fullsized":"2024-09-18T05:17:04.321206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'573","last_scrub_stamp":"2024-09-18T05:17:04.321146+0000","last_deep_scrub":"171'573","last_deep_scrub_stamp":"2024-09-18T05:17:04.321146+0000","last_clean_scrub_stamp":"2024-09-18T05:17:04.321146+0000","objects_scrubbed":7,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:31.034603+0000","scrub_duration":0.016110459000000001,"objects_trimmed":0,"snaptrim_duration":0.00055068100000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8335,"num_read_kb":20827,"num_write":497,"num_write_kb":15047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"171'872","reported_seq":2741,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:06.471782+0000","last_change":"2024-09-18T05:17:06.472014+0000","last_active":"2024-09-18T05:17:06.471782+0000","last_peered":"2024-09-18T05:17:06.471782+0000","last_clean":"2024-09-18T05:17:06.471782+0000","last_became_active":"2024-09-18T05:13:45.871522+0000","last_became_peered":"2024-09-18T05:13:45.871522+0000","last_unstale":"2024-09-18T05:17:06.471782+0000","last_undegraded":"2024-09-18T05:17:06.471782+0000","last_fullsized":"2024-09-18T05:17:06.471782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'872","last_scrub_stamp":"2024-09-18T05:17:06.471724+0000","last_deep_scrub":"171'872","last_deep_scrub_stamp":"2024-09-18T05:17:06.471724+0000","last_clean_scrub_stamp":"2024-09-18T05:17:06.471724+0000","objects_scrubbed":9,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:24.248512+0000","scrub_duration":0.020940740999999999,"objects_trimmed":0,"snaptrim_duration":0.001816465,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4198,"num_read_kb":22346,"num_write":1180,"num_write_kb":9146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"171'591","reported_seq":7243,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:12.951642+0000","last_change":"2024-09-18T05:17:12.951900+0000","last_active":"2024-09-18T05:17:12.951642+0000","last_peered":"2024-09-18T05:17:12.951642+0000","last_clean":"2024-09-18T05:17:12.951642+0000","last_became_active":"2024-09-18T05:13:45.882229+0000","last_became_peered":"2024-09-18T05:13:45.882229+0000","last_unstale":"2024-09-18T05:17:12.951642+0000","last_undegraded":"2024-09-18T05:17:12.951642+0000","last_fullsized":"2024-09-18T05:17:12.951642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'591","last_scrub_stamp":"2024-09-18T05:17:12.951590+0000","last_deep_scrub":"171'591","last_deep_scrub_stamp":"2024-09-18T05:17:12.951590+0000","last_clean_scrub_stamp":"2024-09-18T05:17:12.951590+0000","objects_scrubbed":8,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:59.475806+0000","scrub_duration":0.018567431999999998,"objects_trimmed":0,"snaptrim_duration":0.0012193429999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8338,"num_read_kb":33067,"num_write":470,"num_write_kb":10649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"171'670","reported_seq":8322,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:57.964335+0000","last_change":"2024-09-18T05:16:57.964581+0000","last_active":"2024-09-18T05:16:57.964335+0000","last_peered":"2024-09-18T05:16:57.964335+0000","last_clean":"2024-09-18T05:16:57.964335+0000","last_became_active":"2024-09-18T05:13:45.889065+0000","last_became_peered":"2024-09-18T05:13:45.889065+0000","last_unstale":"2024-09-18T05:16:57.964335+0000","last_undegraded":"2024-09-18T05:16:57.964335+0000","last_fullsized":"2024-09-18T05:16:57.964335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'670","last_scrub_stamp":"2024-09-18T05:16:57.964279+0000","last_deep_scrub":"171'670","last_deep_scrub_stamp":"2024-09-18T05:16:57.964279+0000","last_clean_scrub_stamp":"2024-09-18T05:16:57.964279+0000","objects_scrubbed":14,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:29:58.075238+0000","scrub_duration":0.031062447,"objects_trimmed":0,"snaptrim_duration":0.001655983,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9449,"num_read_kb":47880,"num_write":679,"num_write_kb":15057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"171'756","reported_seq":6996,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:16.019933+0000","last_change":"2024-09-18T05:17:16.020154+0000","last_active":"2024-09-18T05:17:16.019933+0000","last_peered":"2024-09-18T05:17:16.019933+0000","last_clean":"2024-09-18T05:17:16.019933+0000","last_became_active":"2024-09-18T05:13:45.892190+0000","last_became_peered":"2024-09-18T05:13:45.892190+0000","last_unstale":"2024-09-18T05:17:16.019933+0000","last_undegraded":"2024-09-18T05:17:16.019933+0000","last_fullsized":"2024-09-18T05:17:16.019933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'756","last_scrub_stamp":"2024-09-18T05:17:16.019881+0000","last_deep_scrub":"171'756","last_deep_scrub_stamp":"2024-09-18T05:17:16.019881+0000","last_clean_scrub_stamp":"2024-09-18T05:17:16.019881+0000","objects_scrubbed":10,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:05.803534+0000","scrub_duration":0.017619872000000002,"objects_trimmed":0,"snaptrim_duration":0.0013431739999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":8031,"num_read_kb":49145,"num_write":1033,"num_write_kb":21188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"171'416","reported_seq":2325,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:57.296699+0000","last_change":"2024-09-18T05:16:57.296977+0000","last_active":"2024-09-18T05:16:57.296699+0000","last_peered":"2024-09-18T05:16:57.296699+0000","last_clean":"2024-09-18T05:16:57.296699+0000","last_became_active":"2024-09-18T05:13:45.893331+0000","last_became_peered":"2024-09-18T05:13:45.893331+0000","last_unstale":"2024-09-18T05:16:57.296699+0000","last_undegraded":"2024-09-18T05:16:57.296699+0000","last_fullsized":"2024-09-18T05:16:57.296699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'416","last_scrub_stamp":"2024-09-18T05:16:57.296647+0000","last_deep_scrub":"171'416","last_deep_scrub_stamp":"2024-09-18T05:16:57.296647+0000","last_clean_scrub_stamp":"2024-09-18T05:16:57.296647+0000","objects_scrubbed":17,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:32:44.726478+0000","scrub_duration":0.030451261,"objects_trimmed":0,"snaptrim_duration":0.0010340900000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":2061,"num_read_kb":19662,"num_write":411,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:57.925395+0000","last_change":"2024-09-18T05:16:57.925609+0000","last_active":"2024-09-18T05:16:57.925395+0000","last_peered":"2024-09-18T05:16:57.925395+0000","last_clean":"2024-09-18T05:16:57.925395+0000","last_became_active":"2024-09-18T05:16:02.922394+0000","last_became_peered":"2024-09-18T05:16:02.922394+0000","last_unstale":"2024-09-18T05:16:57.925395+0000","last_undegraded":"2024-09-18T05:16:57.925395+0000","last_fullsized":"2024-09-18T05:16:57.925395+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:16:57.925347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:16:57.925347+0000","last_clean_scrub_stamp":"2024-09-18T05:16:57.925347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:27:42.985142+0000","scrub_duration":0.0031287429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"171'590","reported_seq":3734,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:04.982901+0000","last_change":"2024-09-18T05:17:04.983230+0000","last_active":"2024-09-18T05:17:04.982901+0000","last_peered":"2024-09-18T05:17:04.982901+0000","last_clean":"2024-09-18T05:17:04.982901+0000","last_became_active":"2024-09-18T05:13:45.874130+0000","last_became_peered":"2024-09-18T05:13:45.874130+0000","last_unstale":"2024-09-18T05:17:04.982901+0000","last_undegraded":"2024-09-18T05:17:04.982901+0000","last_fullsized":"2024-09-18T05:17:04.982901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'590","last_scrub_stamp":"2024-09-18T05:17:04.982843+0000","last_deep_scrub":"171'590","last_deep_scrub_stamp":"2024-09-18T05:17:04.982843+0000","last_clean_scrub_stamp":"2024-09-18T05:17:04.982843+0000","objects_scrubbed":13,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:55.303414+0000","scrub_duration":0.027041757999999999,"objects_trimmed":0,"snaptrim_duration":0.0015023230000000001,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":4591,"num_read_kb":29240,"num_write":682,"num_write_kb":13080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":191,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:00.365741+0000","last_change":"2024-09-18T05:17:00.365957+0000","last_active":"2024-09-18T05:17:00.365741+0000","last_peered":"2024-09-18T05:17:00.365741+0000","last_clean":"2024-09-18T05:17:00.365741+0000","last_became_active":"2024-09-18T05:14:41.097952+0000","last_became_peered":"2024-09-18T05:14:41.097952+0000","last_unstale":"2024-09-18T05:17:00.365741+0000","last_undegraded":"2024-09-18T05:17:00.365741+0000","last_fullsized":"2024-09-18T05:17:00.365741+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:17:00.365690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:17:00.365690+0000","last_clean_scrub_stamp":"2024-09-18T05:17:00.365690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:20.852991+0000","scrub_duration":0.003365654,"objects_trimmed":0,"snaptrim_duration":0.00086755100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"171'540","reported_seq":3202,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:15.308426+0000","last_change":"2024-09-18T05:17:15.308805+0000","last_active":"2024-09-18T05:17:15.308426+0000","last_peered":"2024-09-18T05:17:15.308426+0000","last_clean":"2024-09-18T05:17:15.308426+0000","last_became_active":"2024-09-18T05:16:19.904499+0000","last_became_peered":"2024-09-18T05:16:19.904499+0000","last_unstale":"2024-09-18T05:17:15.308426+0000","last_undegraded":"2024-09-18T05:17:15.308426+0000","last_fullsized":"2024-09-18T05:17:15.308426+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'540","last_scrub_stamp":"2024-09-18T05:17:15.308325+0000","last_deep_scrub":"171'540","last_deep_scrub_stamp":"2024-09-18T05:17:15.308325+0000","last_clean_scrub_stamp":"2024-09-18T05:17:15.308325+0000","objects_scrubbed":7,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:19:40.801203+0000","scrub_duration":0.016475055999999998,"objects_trimmed":0,"snaptrim_duration":0.00364015,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3679,"num_read_kb":33211,"num_write":613,"num_write_kb":10118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":7448296,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":176,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:00.046137+0000","last_change":"2024-09-18T05:17:00.046345+0000","last_active":"2024-09-18T05:17:00.046137+0000","last_peered":"2024-09-18T05:17:00.046137+0000","last_clean":"2024-09-18T05:17:00.046137+0000","last_became_active":"2024-09-18T05:13:35.876358+0000","last_became_peered":"2024-09-18T05:13:35.876358+0000","last_unstale":"2024-09-18T05:17:00.046137+0000","last_undegraded":"2024-09-18T05:17:00.046137+0000","last_fullsized":"2024-09-18T05:17:00.046137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:17:00.046092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:17:00.046092+0000","last_clean_scrub_stamp":"2024-09-18T05:17:00.046092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:47:38.098660+0000","scrub_duration":0.003556708,"objects_trimmed":0,"snaptrim_duration":0.00082684999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"171'433","reported_seq":6049,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:05.323131+0000","last_change":"2024-09-18T05:17:05.323398+0000","last_active":"2024-09-18T05:17:05.323131+0000","last_peered":"2024-09-18T05:17:05.323131+0000","last_clean":"2024-09-18T05:17:05.323131+0000","last_became_active":"2024-09-18T05:15:55.213206+0000","last_became_peered":"2024-09-18T05:15:55.213206+0000","last_unstale":"2024-09-18T05:17:05.323131+0000","last_undegraded":"2024-09-18T05:17:05.323131+0000","last_fullsized":"2024-09-18T05:17:05.323131+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'433","last_scrub_stamp":"2024-09-18T05:17:05.323074+0000","last_deep_scrub":"171'433","last_deep_scrub_stamp":"2024-09-18T05:17:05.323074+0000","last_clean_scrub_stamp":"2024-09-18T05:17:05.323074+0000","objects_scrubbed":13,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:19.569461+0000","scrub_duration":0.026754501,"objects_trimmed":0,"snaptrim_duration":0.00060223399999999999,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":6557,"num_read_kb":27685,"num_write":436,"num_write_kb":9094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:55.214180+0000","last_change":"2024-09-18T05:16:55.214272+0000","last_active":"2024-09-18T05:16:55.214180+0000","last_peered":"2024-09-18T05:16:55.214180+0000","last_clean":"2024-09-18T05:16:55.214180+0000","last_became_active":"2024-09-18T05:13:35.868283+0000","last_became_peered":"2024-09-18T05:13:35.868283+0000","last_unstale":"2024-09-18T05:16:55.214180+0000","last_undegraded":"2024-09-18T05:16:55.214180+0000","last_fullsized":"2024-09-18T05:16:55.214180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:16:55.214162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:16:55.214162+0000","last_clean_scrub_stamp":"2024-09-18T05:16:55.214162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:40:43.819334+0000","scrub_duration":0.0012876960000000001,"objects_trimmed":0,"snaptrim_duration":0.00058156199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"171'471","reported_seq":6049,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:10.959165+0000","last_change":"2024-09-18T05:17:10.959465+0000","last_active":"2024-09-18T05:17:10.959165+0000","last_peered":"2024-09-18T05:17:10.959165+0000","last_clean":"2024-09-18T05:17:10.959165+0000","last_became_active":"2024-09-18T05:16:39.077813+0000","last_became_peered":"2024-09-18T05:16:39.077813+0000","last_unstale":"2024-09-18T05:17:10.959165+0000","last_undegraded":"2024-09-18T05:17:10.959165+0000","last_fullsized":"2024-09-18T05:17:10.959165+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'471","last_scrub_stamp":"2024-09-18T05:17:10.959110+0000","last_deep_scrub":"171'471","last_deep_scrub_stamp":"2024-09-18T05:17:10.959110+0000","last_clean_scrub_stamp":"2024-09-18T05:17:10.959110+0000","objects_scrubbed":12,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:28:12.771791+0000","scrub_duration":0.020566137000000002,"objects_trimmed":5,"snaptrim_duration":0.032776543999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5840,"num_read_kb":39783,"num_write":450,"num_write_kb":18319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"171'1174","reported_seq":5011,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:00.222286+0000","last_change":"2024-09-18T05:17:00.222511+0000","last_active":"2024-09-18T05:17:00.222286+0000","last_peered":"2024-09-18T05:17:00.222286+0000","last_clean":"2024-09-18T05:17:00.222286+0000","last_became_active":"2024-09-18T05:13:45.874860+0000","last_became_peered":"2024-09-18T05:13:45.874860+0000","last_unstale":"2024-09-18T05:17:00.222286+0000","last_undegraded":"2024-09-18T05:17:00.222286+0000","last_fullsized":"2024-09-18T05:17:00.222286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'1174","last_scrub_stamp":"2024-09-18T05:17:00.222231+0000","last_deep_scrub":"171'1174","last_deep_scrub_stamp":"2024-09-18T05:17:00.222231+0000","last_clean_scrub_stamp":"2024-09-18T05:17:00.222231+0000","objects_scrubbed":10,"log_size":1174,"log_dups_size":0,"ondisk_log_size":1174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:15:05.065617+0000","scrub_duration":0.021028214,"objects_trimmed":0,"snaptrim_duration":0.0011154260000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":6871,"num_read_kb":44276,"num_write":1455,"num_write_kb":20060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"171'3","reported_seq":94,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:04.962404+0000","last_change":"2024-09-18T05:17:04.962609+0000","last_active":"2024-09-18T05:17:04.962404+0000","last_peered":"2024-09-18T05:17:04.962404+0000","last_clean":"2024-09-18T05:17:04.962404+0000","last_became_active":"2024-09-18T05:16:39.076198+0000","last_became_peered":"2024-09-18T05:16:39.076198+0000","last_unstale":"2024-09-18T05:17:04.962404+0000","last_undegraded":"2024-09-18T05:17:04.962404+0000","last_fullsized":"2024-09-18T05:17:04.962404+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'3","last_scrub_stamp":"2024-09-18T05:17:04.962350+0000","last_deep_scrub":"171'3","last_deep_scrub_stamp":"2024-09-18T05:17:04.962350+0000","last_clean_scrub_stamp":"2024-09-18T05:17:04.962350+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:57:46.095840+0000","scrub_duration":0.0063283330000000002,"objects_trimmed":0,"snaptrim_duration":0.002055411,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"171'449","reported_seq":4773,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:11.332623+0000","last_change":"2024-09-18T05:17:11.332844+0000","last_active":"2024-09-18T05:17:11.332623+0000","last_peered":"2024-09-18T05:17:11.332623+0000","last_clean":"2024-09-18T05:17:11.332623+0000","last_became_active":"2024-09-18T05:15:55.213116+0000","last_became_peered":"2024-09-18T05:15:55.213116+0000","last_unstale":"2024-09-18T05:17:11.332623+0000","last_undegraded":"2024-09-18T05:17:11.332623+0000","last_fullsized":"2024-09-18T05:17:11.332623+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'449","last_scrub_stamp":"2024-09-18T05:17:11.332566+0000","last_deep_scrub":"171'449","last_deep_scrub_stamp":"2024-09-18T05:17:11.332566+0000","last_clean_scrub_stamp":"2024-09-18T05:17:11.332566+0000","objects_scrubbed":11,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:57.648711+0000","scrub_duration":0.021995516999999999,"objects_trimmed":0,"snaptrim_duration":0.00037471100000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":4862,"num_read_kb":21776,"num_write":386,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":127,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:55.206252+0000","last_change":"2024-09-18T05:16:55.206324+0000","last_active":"2024-09-18T05:16:55.206252+0000","last_peered":"2024-09-18T05:16:55.206252+0000","last_clean":"2024-09-18T05:16:55.206252+0000","last_became_active":"2024-09-18T05:15:55.215650+0000","last_became_peered":"2024-09-18T05:15:55.215650+0000","last_unstale":"2024-09-18T05:16:55.206252+0000","last_undegraded":"2024-09-18T05:16:55.206252+0000","last_fullsized":"2024-09-18T05:16:55.206252+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:16:55.206234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:16:55.206234+0000","last_clean_scrub_stamp":"2024-09-18T05:16:55.206234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:26.452829+0000","scrub_duration":0.0012158449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'373","reported_seq":2498,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:10.919392+0000","last_change":"2024-09-18T05:17:10.919631+0000","last_active":"2024-09-18T05:17:10.919392+0000","last_peered":"2024-09-18T05:17:10.919392+0000","last_clean":"2024-09-18T05:17:10.919392+0000","last_became_active":"2024-09-18T05:16:01.899154+0000","last_became_peered":"2024-09-18T05:16:01.899154+0000","last_unstale":"2024-09-18T05:17:10.919392+0000","last_undegraded":"2024-09-18T05:17:10.919392+0000","last_fullsized":"2024-09-18T05:17:10.919392+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'373","last_scrub_stamp":"2024-09-18T05:17:10.919334+0000","last_deep_scrub":"171'373","last_deep_scrub_stamp":"2024-09-18T05:17:10.919334+0000","last_clean_scrub_stamp":"2024-09-18T05:17:10.919334+0000","objects_scrubbed":10,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:11:38.572288+0000","scrub_duration":0.017685843999999999,"objects_trimmed":0,"snaptrim_duration":0.001032123,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":2135,"num_read_kb":5505,"num_write":365,"num_write_kb":5251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":2091093,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":176,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:04.111497+0000","last_change":"2024-09-18T05:17:04.111743+0000","last_active":"2024-09-18T05:17:04.111497+0000","last_peered":"2024-09-18T05:17:04.111497+0000","last_clean":"2024-09-18T05:17:04.111497+0000","last_became_active":"2024-09-18T05:13:35.875509+0000","last_became_peered":"2024-09-18T05:13:35.875509+0000","last_unstale":"2024-09-18T05:17:04.111497+0000","last_undegraded":"2024-09-18T05:17:04.111497+0000","last_fullsized":"2024-09-18T05:17:04.111497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T05:17:04.111443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T05:17:04.111443+0000","last_clean_scrub_stamp":"2024-09-18T05:17:04.111443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:15:15.039621+0000","scrub_duration":0.0034084929999999999,"objects_trimmed":0,"snaptrim_duration":0.00062655499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"171'605","reported_seq":5192,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:15.313161+0000","last_change":"2024-09-18T05:17:15.313161+0000","last_active":"2024-09-18T05:17:15.313161+0000","last_peered":"2024-09-18T05:17:15.313161+0000","last_clean":"2024-09-18T05:17:15.313161+0000","last_became_active":"2024-09-18T05:15:17.899195+0000","last_became_peered":"2024-09-18T05:15:17.899195+0000","last_unstale":"2024-09-18T05:17:15.313161+0000","last_undegraded":"2024-09-18T05:17:15.313161+0000","last_fullsized":"2024-09-18T05:17:15.313161+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'605","last_scrub_stamp":"2024-09-18T05:17:15.312807+0000","last_deep_scrub":"171'605","last_deep_scrub_stamp":"2024-09-18T05:17:15.312807+0000","last_clean_scrub_stamp":"2024-09-18T05:17:15.312807+0000","objects_scrubbed":9,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:01:03.960535+0000","scrub_duration":0.020280481,"objects_trimmed":0,"snaptrim_duration":0.00083719899999999995,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7500,"num_read_kb":38768,"num_write":572,"num_write_kb":10748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":6973886,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"171'2","reported_seq":119,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:00.017271+0000","last_change":"2024-09-18T05:17:00.017500+0000","last_active":"2024-09-18T05:17:00.017271+0000","last_peered":"2024-09-18T05:17:00.017271+0000","last_clean":"2024-09-18T05:17:00.017271+0000","last_became_active":"2024-09-18T05:16:39.075931+0000","last_became_peered":"2024-09-18T05:16:39.075931+0000","last_unstale":"2024-09-18T05:17:00.017271+0000","last_undegraded":"2024-09-18T05:17:00.017271+0000","last_fullsized":"2024-09-18T05:17:00.017271+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'2","last_scrub_stamp":"2024-09-18T05:17:00.017215+0000","last_deep_scrub":"171'2","last_deep_scrub_stamp":"2024-09-18T05:17:00.017215+0000","last_clean_scrub_stamp":"2024-09-18T05:17:00.017215+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:59:47.669547+0000","scrub_duration":0.005610383,"objects_trimmed":0,"snaptrim_duration":0.000731951,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"171'119","reported_seq":327,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:59.001963+0000","last_change":"2024-09-18T05:16:59.001963+0000","last_active":"2024-09-18T05:16:59.001963+0000","last_peered":"2024-09-18T05:16:59.001963+0000","last_clean":"2024-09-18T05:16:59.001963+0000","last_became_active":"2024-09-18T05:13:29.842000+0000","last_became_peered":"2024-09-18T05:13:29.842000+0000","last_unstale":"2024-09-18T05:16:59.001963+0000","last_undegraded":"2024-09-18T05:16:59.001963+0000","last_fullsized":"2024-09-18T05:16:59.001963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'119","last_scrub_stamp":"2024-09-18T05:16:59.001653+0000","last_deep_scrub":"171'119","last_deep_scrub_stamp":"2024-09-18T05:16:59.001653+0000","last_clean_scrub_stamp":"2024-09-18T05:16:59.001653+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:09:27.286983+0000","scrub_duration":0.0084990529999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"171'437","reported_seq":5339,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:11.381095+0000","last_change":"2024-09-18T05:17:11.381400+0000","last_active":"2024-09-18T05:17:11.381095+0000","last_peered":"2024-09-18T05:17:11.381095+0000","last_clean":"2024-09-18T05:17:11.381095+0000","last_became_active":"2024-09-18T05:16:01.898482+0000","last_became_peered":"2024-09-18T05:16:01.898482+0000","last_unstale":"2024-09-18T05:17:11.381095+0000","last_undegraded":"2024-09-18T05:17:11.381095+0000","last_fullsized":"2024-09-18T05:17:11.381095+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'437","last_scrub_stamp":"2024-09-18T05:17:11.381040+0000","last_deep_scrub":"171'437","last_deep_scrub_stamp":"2024-09-18T05:17:11.381040+0000","last_clean_scrub_stamp":"2024-09-18T05:17:11.381040+0000","objects_scrubbed":11,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:10:34.897161+0000","scrub_duration":0.021446930999999999,"objects_trimmed":0,"snaptrim_duration":0.0015649310000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":6584,"num_read_kb":42729,"num_write":374,"num_write_kb":15931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":15236017,"num_keys_recovered":42,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"171'303","reported_seq":4191,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:56.256016+0000","last_change":"2024-09-18T05:16:56.256252+0000","last_active":"2024-09-18T05:16:56.256016+0000","last_peered":"2024-09-18T05:16:56.256016+0000","last_clean":"2024-09-18T05:16:56.256016+0000","last_became_active":"2024-09-18T05:15:55.214600+0000","last_became_peered":"2024-09-18T05:15:55.214600+0000","last_unstale":"2024-09-18T05:16:56.256016+0000","last_undegraded":"2024-09-18T05:16:56.256016+0000","last_fullsized":"2024-09-18T05:16:56.256016+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'303","last_scrub_stamp":"2024-09-18T05:16:56.255960+0000","last_deep_scrub":"171'303","last_deep_scrub_stamp":"2024-09-18T05:16:56.255960+0000","last_clean_scrub_stamp":"2024-09-18T05:16:56.255960+0000","objects_scrubbed":7,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:12:34.680995+0000","scrub_duration":0.017312154999999999,"objects_trimmed":0,"snaptrim_duration":0.00062945099999999995,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3697,"num_read_kb":33449,"num_write":292,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"171'641","reported_seq":2748,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:05.052377+0000","last_change":"2024-09-18T05:17:05.052585+0000","last_active":"2024-09-18T05:17:05.052377+0000","last_peered":"2024-09-18T05:17:05.052377+0000","last_clean":"2024-09-18T05:17:05.052377+0000","last_became_active":"2024-09-18T05:14:44.124064+0000","last_became_peered":"2024-09-18T05:14:44.124064+0000","last_unstale":"2024-09-18T05:17:05.052377+0000","last_undegraded":"2024-09-18T05:17:05.052377+0000","last_fullsized":"2024-09-18T05:17:05.052377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'641","last_scrub_stamp":"2024-09-18T05:17:05.052325+0000","last_deep_scrub":"171'641","last_deep_scrub_stamp":"2024-09-18T05:17:05.052325+0000","last_clean_scrub_stamp":"2024-09-18T05:17:05.052325+0000","objects_scrubbed":8,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:30:32.380522+0000","scrub_duration":0.015833809000000001,"objects_trimmed":0,"snaptrim_duration":0.000499841,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":3587,"num_read_kb":18383,"num_write":752,"num_write_kb":6447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":16055,"num_keys_recovered":29,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"171'308","reported_seq":3389,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:08.387852+0000","last_change":"2024-09-18T05:17:08.388137+0000","last_active":"2024-09-18T05:17:08.387852+0000","last_peered":"2024-09-18T05:17:08.387852+0000","last_clean":"2024-09-18T05:17:08.387852+0000","last_became_active":"2024-09-18T05:13:45.872167+0000","last_became_peered":"2024-09-18T05:13:45.872167+0000","last_unstale":"2024-09-18T05:17:08.387852+0000","last_undegraded":"2024-09-18T05:17:08.387852+0000","last_fullsized":"2024-09-18T05:17:08.387852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'308","last_scrub_stamp":"2024-09-18T05:17:08.387798+0000","last_deep_scrub":"171'308","last_deep_scrub_stamp":"2024-09-18T05:17:08.387798+0000","last_clean_scrub_stamp":"2024-09-18T05:17:08.387798+0000","objects_scrubbed":9,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:18.571108+0000","scrub_duration":0.017115952,"objects_trimmed":0,"snaptrim_duration":0.002578814,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":2832,"num_read_kb":19521,"num_write":259,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"171'480","reported_seq":5210,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:14.960039+0000","last_change":"2024-09-18T05:17:14.960272+0000","last_active":"2024-09-18T05:17:14.960039+0000","last_peered":"2024-09-18T05:17:14.960039+0000","last_clean":"2024-09-18T05:17:14.960039+0000","last_became_active":"2024-09-18T05:16:39.077761+0000","last_became_peered":"2024-09-18T05:16:39.077761+0000","last_unstale":"2024-09-18T05:17:14.960039+0000","last_undegraded":"2024-09-18T05:17:14.960039+0000","last_fullsized":"2024-09-18T05:17:14.960039+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'480","last_scrub_stamp":"2024-09-18T05:17:14.959982+0000","last_deep_scrub":"171'480","last_deep_scrub_stamp":"2024-09-18T05:17:14.959982+0000","last_clean_scrub_stamp":"2024-09-18T05:17:14.959982+0000","objects_scrubbed":9,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:17.867146+0000","scrub_duration":0.016605248999999999,"objects_trimmed":4,"snaptrim_duration":0.017471631000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5191,"num_read_kb":29963,"num_write":520,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"171'422","reported_seq":3739,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:13.952166+0000","last_change":"2024-09-18T05:17:13.952411+0000","last_active":"2024-09-18T05:17:13.952166+0000","last_peered":"2024-09-18T05:17:13.952166+0000","last_clean":"2024-09-18T05:17:13.952166+0000","last_became_active":"2024-09-18T05:13:45.896392+0000","last_became_peered":"2024-09-18T05:13:45.896392+0000","last_unstale":"2024-09-18T05:17:13.952166+0000","last_undegraded":"2024-09-18T05:17:13.952166+0000","last_fullsized":"2024-09-18T05:17:13.952166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'422","last_scrub_stamp":"2024-09-18T05:17:13.952114+0000","last_deep_scrub":"171'422","last_deep_scrub_stamp":"2024-09-18T05:17:13.952114+0000","last_clean_scrub_stamp":"2024-09-18T05:17:13.952114+0000","objects_scrubbed":6,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:59:20.427030+0000","scrub_duration":0.016084688999999999,"objects_trimmed":0,"snaptrim_duration":0.0011318949999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4121,"num_read_kb":17361,"num_write":391,"num_write_kb":13003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"171'625","reported_seq":5968,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:15.007705+0000","last_change":"2024-09-18T05:17:15.008000+0000","last_active":"2024-09-18T05:17:15.007705+0000","last_peered":"2024-09-18T05:17:15.007705+0000","last_clean":"2024-09-18T05:17:15.007705+0000","last_became_active":"2024-09-18T05:13:45.900599+0000","last_became_peered":"2024-09-18T05:13:45.900599+0000","last_unstale":"2024-09-18T05:17:15.007705+0000","last_undegraded":"2024-09-18T05:17:15.007705+0000","last_fullsized":"2024-09-18T05:17:15.007705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'625","last_scrub_stamp":"2024-09-18T05:17:15.007651+0000","last_deep_scrub":"171'625","last_deep_scrub_stamp":"2024-09-18T05:17:15.007651+0000","last_clean_scrub_stamp":"2024-09-18T05:17:15.007651+0000","objects_scrubbed":23,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:22.048051+0000","scrub_duration":0.038827207000000002,"objects_trimmed":0,"snaptrim_duration":0.001596606,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":6945,"num_read_kb":34740,"num_write":596,"num_write_kb":4823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"171'569","reported_seq":9113,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:09.423861+0000","last_change":"2024-09-18T05:17:09.424089+0000","last_active":"2024-09-18T05:17:09.423861+0000","last_peered":"2024-09-18T05:17:09.423861+0000","last_clean":"2024-09-18T05:17:09.423861+0000","last_became_active":"2024-09-18T05:14:15.876134+0000","last_became_peered":"2024-09-18T05:14:15.876134+0000","last_unstale":"2024-09-18T05:17:09.423861+0000","last_undegraded":"2024-09-18T05:17:09.423861+0000","last_fullsized":"2024-09-18T05:17:09.423861+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'569","last_scrub_stamp":"2024-09-18T05:17:09.423808+0000","last_deep_scrub":"171'569","last_deep_scrub_stamp":"2024-09-18T05:17:09.423808+0000","last_clean_scrub_stamp":"2024-09-18T05:17:09.423808+0000","objects_scrubbed":14,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:46.436515+0000","scrub_duration":0.02248143,"objects_trimmed":0,"snaptrim_duration":0.0031437349999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":9783,"num_read_kb":40662,"num_write":558,"num_write_kb":18337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":2459274,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"171'679","reported_seq":4052,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:16:56.917842+0000","last_change":"2024-09-18T05:16:56.917842+0000","last_active":"2024-09-18T05:16:56.917842+0000","last_peered":"2024-09-18T05:16:56.917842+0000","last_clean":"2024-09-18T05:16:56.917842+0000","last_became_active":"2024-09-18T05:14:41.097891+0000","last_became_peered":"2024-09-18T05:14:41.097891+0000","last_unstale":"2024-09-18T05:16:56.917842+0000","last_undegraded":"2024-09-18T05:16:56.917842+0000","last_fullsized":"2024-09-18T05:16:56.917842+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'679","last_scrub_stamp":"2024-09-18T05:16:56.917543+0000","last_deep_scrub":"171'679","last_deep_scrub_stamp":"2024-09-18T05:16:56.917543+0000","last_clean_scrub_stamp":"2024-09-18T05:16:56.917543+0000","objects_scrubbed":13,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:10:19.664679+0000","scrub_duration":0.023328648,"objects_trimmed":0,"snaptrim_duration":0.00056430399999999996,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":7033,"num_read_kb":30921,"num_write":767,"num_write_kb":9608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":117739,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"171'450","reported_seq":3820,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:07.098390+0000","last_change":"2024-09-18T05:17:07.098648+0000","last_active":"2024-09-18T05:17:07.098390+0000","last_peered":"2024-09-18T05:17:07.098390+0000","last_clean":"2024-09-18T05:17:07.098390+0000","last_became_active":"2024-09-18T05:13:45.900744+0000","last_became_peered":"2024-09-18T05:13:45.900744+0000","last_unstale":"2024-09-18T05:17:07.098390+0000","last_undegraded":"2024-09-18T05:17:07.098390+0000","last_fullsized":"2024-09-18T05:17:07.098390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'450","last_scrub_stamp":"2024-09-18T05:17:07.098334+0000","last_deep_scrub":"171'450","last_deep_scrub_stamp":"2024-09-18T05:17:07.098334+0000","last_clean_scrub_stamp":"2024-09-18T05:17:07.098334+0000","objects_scrubbed":8,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:57:41.559054+0000","scrub_duration":0.017292932,"objects_trimmed":0,"snaptrim_duration":0.00084174599999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":4545,"num_read_kb":16351,"num_write":465,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"171'678","reported_seq":3049,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:08.936622+0000","last_change":"2024-09-18T05:17:08.936856+0000","last_active":"2024-09-18T05:17:08.936622+0000","last_peered":"2024-09-18T05:17:08.936622+0000","last_clean":"2024-09-18T05:17:08.936622+0000","last_became_active":"2024-09-18T05:13:45.882039+0000","last_became_peered":"2024-09-18T05:13:45.882039+0000","last_unstale":"2024-09-18T05:17:08.936622+0000","last_undegraded":"2024-09-18T05:17:08.936622+0000","last_fullsized":"2024-09-18T05:17:08.936622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'678","last_scrub_stamp":"2024-09-18T05:17:08.936563+0000","last_deep_scrub":"171'678","last_deep_scrub_stamp":"2024-09-18T05:17:08.936563+0000","last_clean_scrub_stamp":"2024-09-18T05:17:08.936563+0000","objects_scrubbed":11,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:18.247837+0000","scrub_duration":0.019207728,"objects_trimmed":0,"snaptrim_duration":0.001575814,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":5022,"num_read_kb":16163,"num_write":742,"num_write_kb":7893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"171'868","reported_seq":3209,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-18T05:17:09.054791+0000","last_change":"2024-09-18T05:17:09.055013+0000","last_active":"2024-09-18T05:17:09.054791+0000","last_peered":"2024-09-18T05:17:09.054791+0000","last_clean":"2024-09-18T05:17:09.054791+0000","last_became_active":"2024-09-18T05:13:45.900551+0000","last_became_peered":"2024-09-18T05:13:45.900551+0000","last_unstale":"2024-09-18T05:17:09.054791+0000","last_undegraded":"2024-09-18T05:17:09.054791+0000","last_fullsized":"2024-09-18T05:17:09.054791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'868","last_scrub_stamp":"2024-09-18T05:17:09.054737+0000","last_deep_scrub":"171'868","last_deep_scrub_stamp":"2024-09-18T05:17:09.054737+0000","last_clean_scrub_stamp":"2024-09-18T05:17:09.054737+0000","objects_scrubbed":14,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:30.389676+0000","scrub_duration":0.027712745,"objects_trimmed":0,"snaptrim_duration":0.00078209799999999995,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":5820,"num_read_kb":22805,"num_write":1246,"num_write_kb":8989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":358,"num_object_clones":0,"num_object_copies":716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":354,"num_read":182619,"num_read_kb":921779,"num_write":21835,"num_write_kb":363496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":34344528,"num_keys_recovered":142,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6486,"internal_metadata":0},"log_size":19487,"ondisk_log_size":19487,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66812,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55332,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316508,"statfs":{"total":96636764160,"available":96580104192,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.84599999999999997,"15min":0.88300000000000001},"min":{"1min":0.54600000000000004,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5580000000000001,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.59399999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.21,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.88800000000000001,"15min":0.92800000000000005},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.417,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.86099999999999999,"15min":0.91700000000000004},"min":{"1min":0.58299999999999996,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1859999999999999,"5min":1.583,"15min":1.583},"last":0.878}]},{"osd":2,"last update":"Wed Sep 18 05:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.222}]},{"osd":3,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.875,"15min":0.871},"min":{"1min":0.79800000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.266,"5min":1.925,"15min":1.925},"last":1.171},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.99099999999999999,"15min":1.0429999999999999},"min":{"1min":0.73499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4630000000000001,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":1.0029999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93999999999999995,"15min":1.0580000000000001},"min":{"1min":0.60899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.363,"5min":3.488,"15min":3.488},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.90400000000000003,"15min":0.94399999999999995},"min":{"1min":0.67900000000000005,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3069999999999999,"5min":2.512,"15min":2.512},"last":0.96099999999999997}]},{"osd":5,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.034,"15min":1.1379999999999999},"min":{"1min":0.68400000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.482,"5min":3.069,"15min":3.069},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.036,"5min":1.028,"15min":1.1040000000000001},"min":{"1min":0.70299999999999996,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.347,"5min":3.2109999999999999,"15min":3.2109999999999999},"last":1.0249999999999999}]},{"osd":6,"last update":"Wed Sep 18 05:16:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.403,"5min":1.615,"15min":1.615},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.091,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6499999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.113}]}]},{"osd":6,"up_from":61,"seq":261993005093,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34340,"kb_used_data":2012,"kb_used_omap":8,"kb_used_meta":32311,"kb_avail":94337500,"statfs":{"total":96636764160,"available":96601600000,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8265,"internal_metadata":33087415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.71299999999999997,"15min":0.68700000000000006},"min":{"1min":0.48499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.72199999999999998,"15min":0.69399999999999995},"min":{"1min":0.58299999999999996,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.92300000000000004}]},{"osd":1,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.71799999999999997,"15min":0.69799999999999995},"min":{"1min":0.52300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.999}]},{"osd":2,"last update":"Wed Sep 18 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.88700000000000001}]},{"osd":3,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.80500000000000005,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.238,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.84699999999999998,"15min":0.82499999999999996},"min":{"1min":0.496,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0249999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.73699999999999999,"15min":0.71599999999999997},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":1.046},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.496,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.81100000000000005,"15min":0.78900000000000003},"min":{"1min":0.432,"5min":0.311,"15min":0.311},"max":{"1min":1.3280000000000001,"5min":1.494,"15min":1.494},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.89300000000000002,"15min":0.871},"min":{"1min":0.50900000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.1319999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.82699999999999996,"15min":0.80300000000000005},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.014,"5min":0.877,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.204}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55272,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316568,"statfs":{"total":96636764160,"available":96580165632,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.131,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.752}]},{"osd":1,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.103,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.82299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1220000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.92900000000000005}]},{"osd":2,"last update":"Wed Sep 18 05:17:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.877},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.80800000000000005}]},{"osd":3,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.502,"15min":1.502},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.216,"5min":1.804,"15min":1.804},"last":0.90700000000000003}]},{"osd":4,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.80600000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.345,"5min":7.2350000000000003,"15min":7.2350000000000003},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85899999999999999,"15min":0.86899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3180000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.198}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4339999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.091},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.85599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0589999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:16:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.97599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2649999999999999,"5min":1.879,"15min":1.879},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.377,"5min":1.742,"15min":1.742},"last":1.149}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63464,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":61438,"kb_avail":94308376,"statfs":{"total":96636764160,"available":96571777024,"internally_reserved":0,"allocated":2064384,"data_stored":991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":62912966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.81699999999999995,"15min":0.86499999999999999},"min":{"1min":0.63500000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3460000000000001,"5min":2.827,"15min":2.827},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.72199999999999998,"15min":0.67000000000000004},"min":{"1min":0.72199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.77200000000000002}]},{"osd":1,"last update":"Wed Sep 18 05:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.78000000000000003,"15min":0.76700000000000002},"min":{"1min":0.64900000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0960000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.88700000000000001,"15min":0.95299999999999996},"min":{"1min":0.81399999999999995,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1890000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Wed Sep 18 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":1.0669999999999999}]},{"osd":3,"last update":"Wed Sep 18 05:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.80200000000000005,"15min":0.78700000000000003},"min":{"1min":0.755,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.111,"5min":1.133,"15min":1.133},"last":1.113},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.748,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2350000000000001,"5min":4.282,"15min":4.282},"last":0.98499999999999999}]},{"osd":5,"last update":"Wed Sep 18 05:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.621,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.153,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.67700000000000005,"5min":0.307,"15min":0.307},"max":{"1min":1.21,"5min":1.272,"15min":1.272},"last":0.66900000000000004}]},{"osd":6,"last update":"Wed Sep 18 05:16:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.437,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1299999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.016},{"interface":"front","average":{"1min":0.874,"5min":0.83399999999999996,"15min":0.82699999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.84499999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:17:29 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.89500000000000002,"15min":0.85499999999999998},"min":{"1min":0.68999999999999995,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.27,"5min":1.381,"15min":1.381},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.75800000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3899999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.878}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81508,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94290332,"statfs":{"total":96636764160,"available":96553299968,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":81394120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.2649999999999999,"5min":1.276,"15min":1.276},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.024,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.92300000000000004}]},{"osd":1,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.624},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1579999999999999,"5min":1.379,"15min":1.379},"last":1.0649999999999999}]},{"osd":2,"last update":"Wed Sep 18 05:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1459999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.93100000000000005},"min":{"1min":0.5,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.496}]},{"osd":5,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90800000000000003,"15min":0.92200000000000004},"min":{"1min":0.71499999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.373,"15min":1.373},"last":1.1850000000000001}]},{"osd":6,"last update":"Wed Sep 18 05:16:49 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.91300000000000003,"15min":0.88500000000000001},"min":{"1min":0.69899999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88200000000000001,"15min":0.871},"min":{"1min":0.63400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.413}]},{"osd":7,"last update":"Wed Sep 18 05:16:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.73999999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5740000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":1.052},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.304,"5min":2.722,"15min":2.722},"last":1.5429999999999999}]}]},{"osd":2,"up_from":123,"seq":528280977430,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30244,"kb_used_data":2012,"kb_used_omap":11,"kb_used_meta":28212,"kb_avail":94341596,"statfs":{"total":96636764160,"available":96605794304,"internally_reserved":0,"allocated":2060288,"data_stored":991763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12166,"internal_metadata":28889210},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.70599999999999996}]},{"osd":3,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.028},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":1.145}]},{"osd":5,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.0580000000000001}]},{"osd":6,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.296},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.96399999999999997}]},{"osd":7,"last update":"Wed Sep 18 05:16:57 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.256},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.22}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":2068480,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.81899999999999995,"15min":0.72399999999999998},"min":{"1min":0.46200000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0589999999999999,"5min":17.597000000000001,"15min":17.597000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1100000000000001,"5min":1.978,"15min":1.978},"last":0.64200000000000002}]},{"osd":2,"last update":"Wed Sep 18 05:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.88800000000000001}]},{"osd":3,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.95199999999999996,"15min":0.84799999999999998},"min":{"1min":0.625,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.296,"5min":17.638999999999999,"15min":17.638999999999999},"last":1.016},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.97699999999999998,"15min":0.83299999999999996},"min":{"1min":0.496,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1459999999999999,"5min":19.489999999999998,"15min":19.489999999999998},"last":0.93899999999999995}]},{"osd":4,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.75900000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5129999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.67200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.476,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.91400000000000003,"15min":0.91200000000000003},"min":{"1min":0.71999999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.556,"5min":1.762,"15min":1.762},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.157,"15min":1.0740000000000001},"min":{"1min":0.86699999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.417,"5min":14.198,"15min":14.198},"last":1.0840000000000001}]},{"osd":6,"last update":"Wed Sep 18 05:16:43 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.90500000000000003,"15min":0.88700000000000001},"min":{"1min":0.60099999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.24},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3819999999999999,"5min":1.446,"15min":1.446},"last":0.99399999999999999}]},{"osd":7,"last update":"Wed Sep 18 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1699999999999999,"15min":1.097},"min":{"1min":0.77100000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4339999999999999,"5min":14.234,"15min":14.234},"last":1.133},{"interface":"front","average":{"1min":1.109,"5min":1.0209999999999999,"15min":1.0269999999999999},"min":{"1min":0.71899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.5129999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.1619999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59428,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312412,"statfs":{"total":96636764160,"available":96575909888,"internally_reserved":0,"allocated":2125824,"data_stored":1582131,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 05:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.91200000000000003,"5min":1.829,"15min":1.829},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.76200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.3280000000000001,"5min":2.25,"15min":2.25},"last":0.70799999999999996}]},{"osd":2,"last update":"Wed Sep 18 05:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.82099999999999995}]},{"osd":3,"last update":"Wed Sep 18 05:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.61799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.101,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.026},{"interface":"front","average":{"1min":0.875,"5min":0.82599999999999996,"15min":0.79700000000000004},"min":{"1min":0.45200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.173,"5min":9.4220000000000006,"15min":9.4220000000000006},"last":0.84599999999999997}]},{"osd":4,"last update":"Wed Sep 18 05:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83999999999999997,"15min":0.874},"min":{"1min":0.72699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1890000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.89900000000000002,"15min":0.93100000000000005},"min":{"1min":0.71699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4359999999999999,"5min":2.5990000000000002,"15min":2.5990000000000002},"last":1.075}]},{"osd":5,"last update":"Wed Sep 18 05:17:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.92700000000000005,"15min":0.90600000000000003},"min":{"1min":0.70599999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.52,"5min":4.9690000000000003,"15min":4.9690000000000003},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.65300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5649999999999999,"5min":1.911,"15min":1.911},"last":0.91200000000000003}]},{"osd":6,"last update":"Wed Sep 18 05:16:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.095,"5min":0.90700000000000003,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.97599999999999998}]},{"osd":7,"last update":"Wed Sep 18 05:17:32 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":0.98799999999999999,"15min":1.014},"min":{"1min":0.89800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3660000000000001,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.103},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.91900000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0209999999999999,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":1.1899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3838,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2648,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T05:17:36.531 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-18T05:17:36.862 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-18T05:17:36.862 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-18T05:17:36.862 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-18T05:17:36.862 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:40.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-18T05:17:42.964 INFO:tasks.ceph.osd.0:Stopped 2024-09-18T05:17:42.965 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-18T05:17:42.965 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:43.030 INFO:tasks.ceph.osd.1:Stopped 2024-09-18T05:17:43.031 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T05:17:43.031 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:43.120 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T05:17:43.120 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-18T05:17:43.120 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:45.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-18T05:17:45.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-18T05:17:49.222 INFO:tasks.ceph.osd.3:Stopped 2024-09-18T05:17:49.223 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-18T05:17:49.223 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:49.315 INFO:tasks.ceph.osd.4:Stopped 2024-09-18T05:17:49.315 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-18T05:17:49.315 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:49.404 INFO:tasks.ceph.osd.5:Stopped 2024-09-18T05:17:49.404 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-18T05:17:49.404 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:49.484 INFO:tasks.ceph.osd.6:Stopped 2024-09-18T05:17:49.484 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-18T05:17:49.484 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:49.577 INFO:tasks.ceph.osd.7:Stopped 2024-09-18T05:17:49.577 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-18T05:17:49.577 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-18T05:17:49.577 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:49.605 INFO:tasks.ceph.mgr.y:Stopped 2024-09-18T05:17:49.605 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-18T05:17:49.606 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:49.636 INFO:tasks.ceph.mgr.x:Stopped 2024-09-18T05:17:49.637 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-18T05:17:49.637 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-18T05:17:49.637 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:49.673 INFO:tasks.ceph.mon.a:Stopped 2024-09-18T05:17:49.674 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-18T05:17:49.674 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:49.735 INFO:tasks.ceph.mon.c:Stopped 2024-09-18T05:17:49.735 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-18T05:17:49.735 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T05:17:49.760 INFO:tasks.ceph.mon.b:Stopped 2024-09-18T05:17:49.760 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-18T05:17:49.760 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-09-18T05:17:49.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:17:49.795 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-18T05:17:50.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:17:50.224 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-18T05:17:50.378 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:17:50.379 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-18T05:17:50.539 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:17:50.539 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-18T05:17:50.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:17:50.708 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-18T05:17:50.913 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:17:50.914 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-18T05:17:50.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-18T05:17:51.122 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:17:51.123 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-18T05:17:51.269 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:17:51.270 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-18T05:17:51.425 INFO:tasks.ceph:Archiving mon data... 2024-09-18T05:17:51.426 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813/data/mon.a.tgz 2024-09-18T05:17:51.427 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-18T05:17:51.433 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.SzxMjKESyt 2024-09-18T05:17:51.433 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SzxMjKESyt 2024-09-18T05:17:51.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.SzxMjKESyt 2024-09-18T05:17:51.651 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.SzxMjKESyt is 415KB 2024-09-18T05:17:51.712 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.SzxMjKESyt 2024-09-18T05:17:51.718 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813/data/mon.c.tgz 2024-09-18T05:17:51.718 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-18T05:17:51.766 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.zZk0udKcfO 2024-09-18T05:17:51.766 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zZk0udKcfO 2024-09-18T05:17:51.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.zZk0udKcfO 2024-09-18T05:17:52.010 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.zZk0udKcfO is 566KB 2024-09-18T05:17:52.072 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.zZk0udKcfO 2024-09-18T05:17:52.078 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813/data/mon.b.tgz 2024-09-18T05:17:52.078 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-18T05:17:52.084 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.xlFqjgTA97 2024-09-18T05:17:52.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xlFqjgTA97 2024-09-18T05:17:52.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.xlFqjgTA97 2024-09-18T05:17:52.324 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.xlFqjgTA97 is 566KB 2024-09-18T05:17:52.435 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.xlFqjgTA97 2024-09-18T05:17:52.441 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-18T05:17:52.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T05:17:52.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T05:17:52.498 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-18T05:17:52.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-18T05:17:52.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-18T05:17:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-18T05:17:52.557 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-18T05:17:52.561 INFO:tasks.ceph:Archiving crash dumps... 2024-09-18T05:17:52.563 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813/remote/smithi017/crash 2024-09-18T05:17:52.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T05:17:52.584 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813/remote/smithi086/crash 2024-09-18T05:17:52.585 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T05:17:52.615 INFO:tasks.ceph:Compressing logs... 2024-09-18T05:17:52.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T05:17:52.631 DEBUG:teuthology.orchestra.run.smithi086:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T05:18:02.968 INFO:tasks.ceph:Archiving logs... 2024-09-18T05:18:02.969 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813/remote/smithi017/log 2024-09-18T05:18:02.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T05:18:04.056 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813/remote/smithi086/log 2024-09-18T05:18:04.057 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T05:18:04.836 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T05:18:04.846 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T05:18:04.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T05:18:04.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T05:18:04.923 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T05:18:04.934 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T05:18:04.935 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T05:18:04.938 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T05:18:04.948 INFO:teuthology.orchestra.run.smithi017.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T05:18:04.948 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================== 2024-09-18T05:18:04.948 INFO:teuthology.orchestra.run.smithi017.stdout:+hv01.front.sepi 67.205.162.81 3 u 25 64 177 0.082 +1.434 0.703 2024-09-18T05:18:04.948 INFO:teuthology.orchestra.run.smithi017.stdout:*hv02.front.sepi 63.231.80.2 3 u 36 64 177 0.087 -1.016 1.552 2024-09-18T05:18:04.948 INFO:teuthology.orchestra.run.smithi017.stdout:+hv03.front.sepi 74.6.168.72 3 u 34 64 177 0.090 -0.240 0.905 2024-09-18T05:18:04.948 INFO:teuthology.orchestra.run.smithi017.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:18:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T05:18:04.951 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-09-18T05:18:04.951 INFO:teuthology.orchestra.run.smithi086.stdout:+hv01.front.sepi 67.205.162.81 3 u 32 64 177 0.088 +0.761 0.988 2024-09-18T05:18:04.951 INFO:teuthology.orchestra.run.smithi086.stdout:*hv02.front.sepi 63.231.80.2 3 u 33 64 177 0.167 -0.791 0.911 2024-09-18T05:18:04.951 INFO:teuthology.orchestra.run.smithi086.stdout:+hv03.front.sepi 74.6.168.72 3 u 32 64 177 0.198 -1.997 0.951 2024-09-18T05:18:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T05:18:04.951 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T05:18:04.961 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T05:18:04.962 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T05:18:04.999 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T05:18:05.043 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T05:18:05.082 INFO:teuthology.task.internal:Duration was 889.827847 seconds 2024-09-18T05:18:05.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T05:18:05.126 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T05:18:05.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T05:18:05.129 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T05:18:05.166 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T05:18:05.167 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-18T05:18:05.167 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T05:18:05.219 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-09-18T05:18:05.219 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T05:18:05.229 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T05:18:05.229 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T05:18:05.263 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T05:18:05.301 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T05:18:05.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T05:18:05.335 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T05:18:05.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T05:18:05.428 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T05:18:05.429 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T05:18:05.442 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T05:18:05.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T05:18:05.483 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T05:18:05.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T05:18:05.496 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-18T05:18:05.506 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-09-18T05:18:05.528 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T05:18:05.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:18:05.566 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T05:18:05.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T05:18:05.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T05:18:05.586 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T05:18:05.587 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813/remote/smithi017 2024-09-18T05:18:05.587 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T05:18:05.634 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909813/remote/smithi086 2024-09-18T05:18:05.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T05:18:05.656 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T05:18:05.656 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T05:18:05.670 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T05:18:05.701 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T05:18:05.718 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T05:18:05.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T05:18:05.755 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T05:18:05.755 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T05:18:05.757 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T05:18:05.762 INFO:teuthology.orchestra.run.smithi017.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 05:18 /home/ubuntu/cephtest 2024-09-18T05:18:05.763 INFO:teuthology.orchestra.run.smithi086.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 05:18 /home/ubuntu/cephtest 2024-09-18T05:18:05.765 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T05:18:05.793 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T05:18:05.880 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit} duration: 889.8278472423553 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-18T05:18:05.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T05:18:05.981 INFO:teuthology.run:pass